AI Can't Replace Your Doctor: Why the Headlines Are Lying to You

AI Can't Replace Your Doctor: Why the Headlines Are Lying to You

Those viral headlines claiming AI diagnoses better than doctors? They're based on fundamentally flawed research—and believing them could be dangerous to your health. In this episode, I break down the alarming trend of studies from prestigious journals like Science and JAMA Network Open claiming large language models outperform physicians in diagnostic reasoning. The problem? These studies exist entirely outside the realm of actual clinical medicine. Here's what they actually tested: They gave ChatGPT-style AI and physicians the same written notes about patients neither ever met—then compared who could guess the diagnosis better from text alone. That's not medicine. That's a reading comprehension test. Real medicine is irreducibly multimodal. When you sit with your doctor, they're simultaneously processing your facial expressions, your tone of voice, your body language, your lab values, your imaging, and that clinical intuition built from years of experience. They notice when you claim "high pain tolerance" but wince at a light touch. They read between the lines of what you said—and what you didn't say. None of this is accessible to a text-based language model.We also explore why "being right most of the time" isn't good enough when lives are at stake. LLMs are probabilistic tools—they predict statistically likely answers. But medicine requires considering this specific patient, not how previous patients typically presented. Think AI facial recognition is reliable? Tell that to the Nevada man detained for 12 hours after AI flagged him as a "100% match" for someone else—despite having three forms of ID in his wallet. Or the grandmother jailed for over six months for a crime committed 1,200 miles away because generative AI flagged her as a suspect. If we can't trust AI to reliably identify faces, why would we trust probabilistic language models with medical diagnoses? This episode covers what every patient and medical professional needs to understand: the difference between probabilistic and deterministic AI systems, how to recognize badly trained models, why "external validation" claims deserve skepticism, and why the most dangerous outcome isn't the AI itself—it's the false narrative convincing the public that doctors are obsolete. AI has a role in medicine—but it's task-specific tools for imaging analysis, waveform recognition, and structured data patterns. Not chatbots making diagnostic guesses about your life. The studies got clicks. The conclusions were irresponsible. And someone needs to say it out loud.

The Limits of Chatbots in Clinical Decision‑Making

Chatbots and large language models are becoming increasingly common in everyday life, but their growing presence in healthcare has raised an important question: Should probabilistic AI systems be used to help make medical decisions? This episode takes a clear, grounded look at why the answer is far more complicated—and potentially far more dangerous—than many people realize. Modern chatbots work by predicting the most statistically likely response based on patterns found in massive amounts of text. That makes them great for conversation, brainstorming, and general information, but not for something as complex and high‑stakes as medical diagnosis. In clinical settings, symptoms like persistent cough and chest pain can point to a wide range of possible conditions. A probabilistic model might default to the most common explanation, but medicine doesn’t work on majority statistics—it works on understanding nuance, context, risk, and rare but critical exceptions. This episode explores how relying on “most likely” answers can lead to missed diagnoses, delayed treatments, and dangerous oversights. You’ll hear how serious conditions such as pulmonary embolism or early lung cancer can present with the same symptoms as common respiratory infections, making a simplistic, probability‑driven guess both insufficient and unsafe. We also dive into the accuracy paradox—how an AI system can appear highly accurate while still being clinically untrustworthy, simply because it always chooses the dominant category. Beyond the risks, this episode highlights what real medical reasoning involves: integrating visual cues, patient history, audio signals, imaging studies, laboratory data, physiological waveforms, and much more. Human clinicians synthesize all these inputs at once, something a probabilistic chatbot was never designed to do. By understanding this difference, listeners will gain a deeper appreciation for the limitations of current AI tools and why responsible, deterministic models are essential in healthcare. Whether you’re a clinician, medical student, AI researcher, or simply curious about how technology intersects with patient care, this episode offers a clear and accessible exploration of why chatbots, despite their impressive capabilities, should not be mistaken for diagnostic tools.

Viral AI-Beats-Doctors Study

Another week, another headline declaring AI has officially surpassed physicians. This time, it's a study published in Science on April 30, 2026, claiming that OpenAI's o1 model "outperformed physician baselines" across multiple diagnostic reasoning tasks. The research comes from Harvard, Stanford, and Beth Israel Deaconess Medical Center. It's rigorous. It's peer-reviewed. And it's already being cited as proof that doctors are obsolete. But here's what those viral headlines won't tell you: the study tested AI on text alone. No images. No audio. No physical exams. No watching a patient walk through the door in distress before they utter a single word. No recognizing the subtle facial asymmetry that suggests stroke. No hearing the quality of a cough. No feeling a mass during examination. No interpreting the fear in a patient's eyes. In other words—not real medicine. In this episode, we unpack why this study, despite its methodological rigor, may be doing more harm than good. We explore the "headline-to-reality pipeline"—how clickbait economics strips away the authors' own caveats until all that remains is a misleading soundbite. We discuss the real-world consequences: misinformed patients with unrealistic expectations, demoralized clinicians, misallocated healthcare resources, and a generation of medical trainees learning exactly the wrong lessons about AI. Perhaps most critically, we address the "chatbot conflation problem." When the public hears "AI in medicine," they picture ChatGPT. But as of late 2025, over 850 AI-enabled medical devices have received FDA clearance—more than 70% related to medical imaging. These task-specific systems detecting pulmonary nodules, identifying intracranial hemorrhages, and flagging diabetic retinopathy are fundamentally different from large language models answering text prompts. Different architecture. Different validation. Different regulatory pathways. Different levels of evidence. Lumping them together under "AI" does a disservice to both. We also tackle a question the headlines never ask: What would a fair evaluation of AI in medicine actually look like? Hint—it would require multimodal inputs, messy real-world data, and a fundamentally different benchmark: not "Can AI beat doctors?" but "Do doctors WITH AI outperform doctors WITHOUT AI?" Finally, we make the case for why medical education must lead this conversation. If we don't teach our students—and frankly, the broader public—the critical distinctions between AI tools, what happens? Clinicians lose trust not just in overhyped chatbots, but in all medical AI, including the FDA-cleared tools actually saving lives. That erosion of trust could take a generation to repair. The technical findings of this study may be sound. But science doesn't exist in a vacuum. It exists in a media ecosystem that rewards sensationalism, in a healthcare system desperate for solutions, and in a culture increasingly willing to believe AI can do anything. The responsible approach is to be louder about limitations than findings. Because right now, we're celebrating an AI that aced a written exam—while the actual test, the messy, multimodal, deeply human reality of clinical medicine, remains completely ungraded. What You'll Learn: • Why text-based AI evaluations fundamentally misrepresent clinical medicine • The critical distinction between task-specific medical AI and general chatbots • How clickbait economics transforms nuanced research into dangerous misinformation • What fair AI evaluation in healthcare would actually require • Why medical educators must lead the conversation on AI literacy Resources Mentioned: • Brodeur PG, et al. "Performance of a large language model on the reasoning tasks of a physician." Science. 2026;392(6797):524-527 • FDA AI-Enabled Medical Device Database • Clinical AI Course (NYIT College of Osteopathic Medicine)

Medical Education Must Teach AI Differently

Artificial intelligence is rapidly moving into classrooms, clinics, and daily healthcare decision making, but much of the public conversation is built on a dangerous misunderstanding. Too often, people now treat artificial intelligence as if it simply means chatbots. In this episode, Dr. Milan Toma explains why that confusion matters and why healthcare professionals must learn to distinguish between conversational tools and task specific medical systems. This episode explores the long history of artificial intelligence in medicine, why chatbots are optimized for fluent language rather than true clinical understanding, and why strong performance on text based clinical vignettes should not be mistaken for real world diagnostic ability. Dr. Toma also examines the risks of artificial intelligence sycophancy, the danger of overfitting, the limits of accuracy as a metric, and how data leakage or hidden shortcuts can make weak systems look impressive during development. Most importantly, this is a conversation about education and patient safety. Healthcare professionals need more than basic exposure to artificial intelligence tools. They need to understand how different systems work, how they fail, how to evaluate claims critically, and why clinicians must work closely with developers before these tools are trusted in practice. The goal is not simply to teach people how to use artificial intelligence. It is to teach them how to question it, evaluate it, and apply it responsibly. The future of healthcare will include artificial intelligence, but safe healthcare depends on how well we teach people to understand it.

The Overfitting Trap

Introduction: A Tale of Two Rounds Every attending physician has seen the "Star Student" who can quote the New England Journal of Medicine verbatim but freezes when a patient doesn't follow the script. In this episode, we introduce Student A and Student B. * Student A (The Memorizer): They have a mental database of every practice vignette. They are fast, confident, and statistically "perfect" on paper. * Student B (The Thinker): They are slower. They visualize the blood flow, the cellular response, and the "why" behind the symptoms. We discuss why the current "Gold Rush" of Medical AI is accidentally scaling Student A to an industrial level, creating systems that look like geniuses in a lab but perform like novices in a clinic. In machine learning, overfitting is the statistical equivalent of "rote memorization." We break down the mechanics of how a model loses the forest for the trees. How do you "interview" an AI to see if it actually knows its stuff? You look at its Learning Curves. We explain how to read these graphs like a clinical EKG. * The Divergence Warning: When training accuracy rockets to 100% while validation accuracy (the "real world" test) plateaus or drops, you aren't looking at a breakthrough; you’re looking at a memory bank. * The Convergence Goal: A healthy model shows two lines that "hug" each other as they rise. This signifies that what the model learns in the "textbook" is actually applying to the "patient." Why do models overfit? Often, it’s because they found a shortcut. We explore the "Red Flags" that developers—and clinicians—need to watch for: 1. Spurious Correlations: The model learns that "Patients with X-rays taken on a portable machine are sicker," rather than learning what is in the X-ray. 2. Data Leakage: Including variables that already "hint" at the answer (e.g., predicting a condition using the medication used to treat it). 3. Institutional Bias: Memorizing how one specific hospital operates rather than how a disease operates. We tackle the most dangerous metric in healthcare: Raw Accuracy. > "If 95% of your patients are healthy, a model can be 95% accurate by simply predicting 'Healthy' for every person it sees. It has a 0% success rate at finding disease, yet it gets a 95% grade. This isn't just bad math—it's dangerous medicine." We discuss why Sensitivity and Specificity are the only metrics that truly matter in a clinical setting. How do we build "Student B" AI? It requires a fundamental shift in development: * External Validation: Testing the model on data from a completely different hospital or geographic region. * Patient-Level Splits: Ensuring the model never sees the same patient in training and testing. * Clinician-in-the-Loop: Why doctors must be involved in feature selection to spot "leaky" data that a data scientist might miss. We wrap up the episode with a practical toolkit. Before you trust an AI system with your family, ask the developers these five questions: 1. Was data split at the patient level? (Did you prevent the model from memorizing specific individuals?) 2. Were leaky features identified and removed? (Is the model cheating using "proxy" data?) 3. What do the training curves show? (Can I see the "EKG" of how this model learned?) 4. How was class imbalance handled? (What is your Sensitivity for the actual disease cases?) 5. Was there external validation? (Has this worked at a hospital that isn't yours?) Real medicine is messy. It’s atypical symptoms, patients with five comorbidities, and "unusual" presentations. If we want AI to be a partner in the clinic, we need it to be a "Student B." We need it to understand the pathophysiology of the data, not just the answers on the test. Join us as we move past the hype and toward a future of robust, reliable, and truly intelligent medical AI. Based on the work and research of Dr. Milan Toma and synthesized from over 40 peer-reviewed studies on clinical AI evaluation.