Insights/Clinician Learning Brief

AI Now Writes More Empathetic Answers Than Most Oncologists

Topics: AI oversight, Workflow-based education, Communication skills
Coverage Feb. 3–9, 2025

Abstract

Chatbots scored higher on empathy and readability than oncologists on real patient questions, creating demand for CME that teaches verification and hybrid oversight skills.

Key Takeaways

  • AI may outperform clinicians on patient-facing prose before it can be trusted as a diagnostic partner.
  • CME AI education should focus less on tool awareness and more on verification behaviors: prompting, hallucination checks, revision, and escalation.
  • If AI training is tied to certification or compliance, it needs to feel like practice—not another administrative task.

AI chatbots scored higher on empathy and readability than board-certified oncologists when answering real patient questions posted on social media. The strongest public data this week came from oncology, yet the implication for CME providers is portable: clinicians need repeated practice treating AI output as a fluent first draft that still requires human verification and escalation.

The learning need is no longer basic AI literacy

In a Medscape discussion of a recent oncology analysis, Maurie Markman described a study comparing responses from verified oncologists and an AI chatbot to 200 public cancer questions from social media. The reported finding was striking: the best AI platform scored higher than physicians on quality, empathy, and readability.

That does not make AI clinically autonomous. The Medscape source itself framed the result as a snapshot and stressed the need for monitoring, especially around hallucinations. A separate oncology thread made a related point about diagnosis. Lakshmi Krishnan wrote, “When ChatGPT outperformed docs in diagnosis, it made me reflect beyond the man vs machine debate.” Her thread points away from replacement talk and toward a different question: what does good clinician oversight look like when the machine’s first answer is often fluent and sometimes impressive?

For CME providers, that changes the shape of AI education. A module that explains what large language models are will age quickly. The durable need is rehearsal: ask learners to prompt an AI system, identify overconfident language, check source-dependent claims, rewrite patient-facing explanations, and decide when the answer must be escalated to a human clinician or a specialty team.

We saw a related pattern in an earlier brief on point-of-care chatbots turning clinical questions into accredited learning. This week’s signal is sharper because it moves the issue from access to judgment. If AI can produce a more empathetic draft than a busy clinician, the educational task is not to defend the clinician’s pride. It is to teach the clinician how to edit, verify, and own the final answer.

What CME Providers Should Do Now

  • Audit AI-related activities for explicit human-oversight checkpoints, not just general warnings about hallucinations.
  • Build short simulations in which learners critique and correct AI-generated patient responses before seeing an expert model answer.
  • Include escalation criteria: when the AI draft is useful, when it is incomplete, and when it should not be used without specialist review.

If this continues

AI education will become part of everyday clinical workflow training, not a separate innovation track. The risk is that providers turn it into another compliance module. A separate X thread about ABIM certification paperwork offers a useful reminder: clinicians quickly recognize education that feels like administrative obligation. AI oversight training will land better if it looks like the work itself—draft, challenge, revise, escalate—rather than a lecture about tools.

Sources

  1. 01
    YouTube

    AI Chatbots vs Oncologists: The Future of Medical Advice?

    Medscape · · cited segment 0:00-3:02

    Medscape video demonstrates ChatGPT producing superior empathy and readability scores versus verified oncologists on social-media cancer questions.

    Open source
  2. 02
    X post

    X post by Lakshmi Krishnan, MD, PhD

    @TheLakshmiK ·

    Practicing oncologist thread confirms AI can outperform on rote diagnostic items yet still requires human escalation for nuance and context.

    "My latest for @statnews. When ChatGPT outperformed docs in diagnosis, it made me reflect beyond the man vs machine debate. As a physician and historian, I explore how this moment invites us to reimagine diagnosis itself..."

    Show captured excerpt
    Open source
  3. 03
    X post

    X post by IMCrit

    @IM_Crit_ ·

    Clinicians describe ABIM communications as 'pay or perish' and recertification as wasteful bureaucracy.

    "Board certification used to be a honor, not a mandatory requirement, but it has evolved that way American Board of Internal Medicine sends us this "friendly" letter: pay or perish #medtwitter"

    Show captured excerpt
    Open source

Turn learner questions into outcomes data

ChatCME surfaces the questions clinicians actually ask — so you can build activities that close real knowledge gaps.

Request a demo