The Health AI Brief

Confabulation (a.k.a. Hallucination) - The Confident LLM Liar

2 min · 19 de may de 2026
Portada del episodio Confabulation (a.k.a. Hallucination) - The Confident LLM Liar

Descripción

It’s not a "hallucination," it’s a "confabulation." Learn why LLMs are designed to be "pleasers" and how that can lead to dangerous medical misinformation. #PatientSafety #DigitalHealth #AIHallucinations #ai in medicine Music generated by Mubert https://mubert.com/render healthaibrief@outlook.com

Comentarios

0

Sé la primera persona en comentar

¡Regístrate ahora y únete a la comunidad de The Health AI Brief!

Prueba gratis

Empieza 7 días de prueba

$99 / mes después de la prueba. · Cancela cuando quieras.

  • Podcasts solo en Podimo
  • 20 horas de audiolibros al mes
  • Podcast gratuitos

Todos los episodios

167 episodios

episode AI-Designed Vaccine: The End of Boosters? artwork

AI-Designed Vaccine: The End of Boosters?

Can artificial intelligence predict viral mutations and stop the next pandemic before it starts? In this episode, we break down the first-in-human clinical trial of a computationally designed universal vaccine candidate developed by the University of Cambridge. We analyse the clinical safety data, the challenges of pre-existing immune imprinting, and the molecular engineering behind this paradigm shift in vaccinology. We explore the transition from reactive booster updates to proactive, broad-spectrum immunogens. We explain how researchers used AI to identify stable viral structures and applied a technique called glycan masking to shield fast-mutating decoy regions, forcing the immune system to target highly conserved areas of the virus. Finally, we discuss why translating these AI-designed antigens to mRNA platforms is the key to unlocking true, universal viral protection. References: - https://www.journalofinfection.com/article/S0163-4453(26)00084-8/fulltext - https://www.nature.com/articles/s41541-024-00950-9 - https://www.nature.com/articles/s41551-023-01094-2 Key Takeaways • Universal Vaccine Design: How artificial intelligence analyses viral family trees to design synthetic antigens that target shared, stable features across multiple viral strains. • The Glycan Masking Strategy: How researchers use sugar molecules as physical shields to cover up mutating decoys, guiding the immune system to focus on stable regions. • Clinical Trial Outcomes: Why the Phase I trial proved exceptionally safe but generated modest immunogenicity, highlighting the limitations of DNA delivery and past immune imprinting. 00:00 – The Challenge of Evolving Viruses 00:32 – AI-Designed Synthetic Vaccine Target 01:17 – Understanding "Decoy Regions" on Viruses 01:36 – Solving the Decoy Problem with Glycan Masking 02:07 – Phase 1 Human Clinical Trial of DNA Vaccine (pEVAC-PS) 03:08 – Success with mRNA Delivery in Animal Models 03:40 – Key Takeaways and Next Steps #UniversalVaccine #HealthAI #ComputationalBiology #VaccineResearch #ClinicalTrials #mRNA #Immunology #GlobalHealth #PreventativeMedicine

Ayer4 min
episode Microsoft & Mayo Clinic Unveil New Healthcare AI Alliance artwork

Microsoft & Mayo Clinic Unveil New Healthcare AI Alliance

Struggling to navigate the flood of patients using consumer AI for medical advice? Discover how the new Microsoft and Mayo Clinic clinical healthcare AI model aims to safely bridge the gap between consumer demand and clinical validation. In this episode, we consider the strategic partnership between Microsoft and the Mayo Clinic to build a proprietary frontier AI model designed specifically for clinical environments. We break down the mechanics of the agreement, including why Mayo is retaining full model ownership, how the model will be distributed via Azure Foundry APIs, and the major hurdles of clinical validation, automation bias, and regulatory compliance. Key Takeaways: • Understand the structural design of the Microsoft-Mayo partnership and how model ownership remains with the clinical institution to protect patient trust. • Learn about the operational risks of clinical AI deployment, specifically the challenge of automation bias and how to prevent diagnostic errors. • Discover how this healthcare-specific foundation model compares to competitive offerings from Google, OpenAI, and Epic Systems. 00:00 – The Migration of Patients to Consumer AI 00:35 – The Microsoft and Mayo Clinic Strategic Alliance 01:14 – Governance and Structural Model Ownership 01:50 – Phased Validation and Internal Testing 02:16 – The Role of Longitudinal Clinical Data in Training 02:57 – Generalization Challenges Across Diverse Populations 03:52 – Analysing the Competitive Landscape (Epic, Google, Microsoft) 05:01 – Regulatory Guardrails and Risk-Sharing Frameworks 05:49 – Addressing Automation Bias at the Point of Care 06:26 – Data Privacy and Re-identification Risks 07:08 – Structured Validation Over Rapid Commercialization 07:32 – Strategic Outlook: Moving Beyond AI Hype Clinical Governance & Educational Disclosure This analysis is for educational and informational purposes only. It provides a technical review of AI in healthcare and does not constitute medical advice or treatment. • Professional Accountability: If you are a healthcare professional, ensure your use of AI complies with local Trust policies and professional standards (GMC/NMC/HCPC). • Evidence-Based Review: These views are my own and do not represent the official position of my University or Hospital Trust. • Patient Safety: This video does not establish a doctor-patient relationship. Always seek the advice of a qualified healthcare provider regarding any medical condition. Music generated by Mubert https://mubert.com/render https://substack.com/@healthaibrief #HealthcareAI #MedTech #ClinicalAI #HealthIT #DigitalHealth #MayoClinic #MicrosoftAzure #HealthTech #MedicalAI #ClinicalInformatics

5 de jun de 20268 min
episode Persona Adoption (The ‘Expert’ Hack) - Become the Attending Consultant artwork

Persona Adoption (The ‘Expert’ Hack) - Become the Attending Consultant

Never ask "What is this symptom?" Ask "You are a Board-Certified Neurologist with 30 years of experience..." We explain the "Role-Prompting" phenomenon and how assigning a persona changes the latent space the AI navigates, resulting in more professional and accurate clinical outputs. 𝐂𝐥𝐢𝐧𝐢𝐜𝐚𝐥 𝐆𝐨𝐯𝐞𝐫𝐧𝐚𝐧𝐜𝐞 & 𝐄𝐝𝐮𝐜𝐚𝐭𝐢𝐨𝐧𝐚𝐥 𝐃𝐢𝐬𝐜𝐥𝐨𝐬𝐮𝐫𝐞: This concise summary of AI technology is for 𝐞𝐝𝐮𝐜𝐚𝐭𝐢𝐨𝐧𝐚𝐥 𝐚𝐧𝐝 𝐢𝐧𝐟𝐨𝐫𝐦𝐚𝐭𝐢𝐨𝐧𝐚𝐥 𝐩𝐮𝐫𝐩𝐨𝐬𝐞𝐬 𝐨𝐧𝐥𝐲. It provides a technical analysis of AI capabilities in healthcare and does not constitute medical advice, diagnosis, or treatment. • 𝐂𝐥𝐢𝐧𝐢𝐜𝐚𝐥 𝐀𝐜𝐜𝐨𝐮𝐧𝐭𝐚𝐛𝐢𝐥𝐢𝐭𝐲: If you are a healthcare professional, ensure any implementation of AI tools complies with your local Trust’s policies, data governance protocols, and professional regulatory standards (GMC/NMC/HCPC or equivalent). • 𝐈𝐧𝐝𝐞𝐩𝐞𝐧𝐝𝐞𝐧𝐭 𝐄𝐯𝐢𝐝𝐞𝐧𝐜𝐞-𝐁𝐚𝐬𝐞𝐝 𝐑𝐞𝐯𝐢𝐞𝐰: The views expressed are my own and do not represent the official position of any University, Hospital Trust, employer, or regulatory body. • 𝐏𝐚𝐭𝐢𝐞𝐧𝐭 𝐒𝐚𝐟𝐞𝐭𝐲: This video does not establish a doctor-patient relationship. Members of the public should always seek the advice of a qualified healthcare provider regarding any medical condition. Music generated by Mubert https://mubert.com/render https://substack.com/@healthaibrief #PersonaPrompting #MedicalConsultant #AdvancedAI #ai in medicine

2 de jun de 20262 min
episode Citation Mandate in RAG - Don’t Trust, Verify - Why Citations are the Only Way to Use RAG Safely artwork

Citation Mandate in RAG - Don’t Trust, Verify - Why Citations are the Only Way to Use RAG Safely

If your RAG system doesn't tell you where it found the answer, it’s a liability. In this episode, we discuss "Grounding"—the art of forcing your AI to cite specific PubMed IDs or hospital policy page numbers. Learn how to turn an LLM from a "guesser" into a verifiable medical librarian. 𝐂𝐥𝐢𝐧𝐢𝐜𝐚𝐥 𝐆𝐨𝐯𝐞𝐫𝐧𝐚𝐧𝐜𝐞 & 𝐄𝐝𝐮𝐜𝐚𝐭𝐢𝐨𝐧𝐚𝐥 𝐃𝐢𝐬𝐜𝐥𝐨𝐬𝐮𝐫𝐞: This concise summary of AI technology is for 𝐞𝐝𝐮𝐜𝐚𝐭𝐢𝐨𝐧𝐚𝐥 𝐚𝐧𝐝 𝐢𝐧𝐟𝐨𝐫𝐦𝐚𝐭𝐢𝐨𝐧𝐚𝐥 𝐩𝐮𝐫𝐩𝐨𝐬𝐞𝐬 𝐨𝐧𝐥𝐲. It provides a technical analysis of AI capabilities in healthcare and does not constitute medical advice, diagnosis, or treatment. • 𝐂𝐥𝐢𝐧𝐢𝐜𝐚𝐥 𝐀𝐜𝐜𝐨𝐮𝐧𝐭𝐚𝐛𝐢𝐥𝐢𝐭𝐲: If you are a healthcare professional, ensure any implementation of AI tools complies with your local Trust’s policies, data governance protocols, and professional regulatory standards (GMC/NMC/HCPC or equivalent). • 𝐈𝐧𝐝𝐞𝐩𝐞𝐧𝐝𝐞𝐧𝐭 𝐄𝐯𝐢𝐝𝐞𝐧𝐜𝐞-𝐁𝐚𝐬𝐞𝐝 𝐑𝐞𝐯𝐢𝐞𝐰: The views expressed are my own and do not represent the official position of any University, Hospital Trust, employer, or regulatory body. • 𝐏𝐚𝐭𝐢𝐞𝐧𝐭 𝐒𝐚𝐟𝐞𝐭𝐲: This video does not establish a doctor-patient relationship. Members of the public should always seek the advice of a qualified healthcare provider regarding any medical condition. Music generated by Mubert https://mubert.com/render https://substack.com/@healthaibrief #RAG #EvidenceBasedMedicine #HealthData #VerifyAI #aiinmedicine

28 de may de 20261 min
episode ‘Chain of Verification’ - The AI Double-Check to Prevent Hallucinations artwork

‘Chain of Verification’ - The AI Double-Check to Prevent Hallucinations

Don't take the first answer. Learn the "Chain of Verification" technique: forcing the AI to audit its own medical reasoning before it presents the final note to you. It's like having a resident and an attending in one prompt. 𝐂𝐥𝐢𝐧𝐢𝐜𝐚𝐥 𝐆𝐨𝐯𝐞𝐫𝐧𝐚𝐧𝐜𝐞 & 𝐄𝐝𝐮𝐜𝐚𝐭𝐢𝐨𝐧𝐚𝐥 𝐃𝐢𝐬𝐜𝐥𝐨𝐬𝐮𝐫𝐞: This concise summary of AI technology is for 𝐞𝐝𝐮𝐜𝐚𝐭𝐢𝐨𝐧𝐚𝐥 𝐚𝐧𝐝 𝐢𝐧𝐟𝐨𝐫𝐦𝐚𝐭𝐢𝐨𝐧𝐚𝐥 𝐩𝐮𝐫𝐩𝐨𝐬𝐞𝐬 𝐨𝐧𝐥𝐲. It provides a technical analysis of AI capabilities in healthcare and does not constitute medical advice, diagnosis, or treatment. • 𝐂𝐥𝐢𝐧𝐢𝐜𝐚𝐥 𝐀𝐜𝐜𝐨𝐮𝐧𝐭𝐚𝐛𝐢𝐥𝐢𝐭𝐲: If you are a healthcare professional, ensure any implementation of AI tools complies with your local Trust’s policies, data governance protocols, and professional regulatory standards (GMC/NMC/HCPC or equivalent). • 𝐈𝐧𝐝𝐞𝐩𝐞𝐧𝐝𝐞𝐧𝐭 𝐄𝐯𝐢𝐝𝐞𝐧𝐜𝐞-𝐁𝐚𝐬𝐞𝐝 𝐑𝐞𝐯𝐢𝐞𝐰: The views expressed are my own and do not represent the official position of any University, Hospital Trust, employer, or regulatory body. • 𝐏𝐚𝐭𝐢𝐞𝐧𝐭 𝐒𝐚𝐟𝐞𝐭𝐲: This video does not establish a doctor-patient relationship. Members of the public should always seek the advice of a qualified healthcare provider regarding any medical condition. Music generated by Mubert https://mubert.com/render https://substack.com/@healthaibrief #QualityImprovement #AISafety #ClinicalReasoning #aiinmedicine

26 de may de 20262 min