Insights/Clinician Learning Brief

Clinicians Still Lack Verified AI Skills as Ethics Papers Lag Behind Adoption

Topics: AI oversight, Learning design
Coverage Nov. 4–10, 2024

Abstract

Educator discussion sharpened the AI-in-CPD gap: practicing clinicians need verification habits and ethics support, not just tool orientation.

Key Takeaways

  • The AI education gap is no longer just about low CPD coverage; it is about whether clinicians can verify outputs and recognize ethical risks.
  • A reviewed corpus of 278 AI-in-medical-education papers included only 3% focused on CPD and 14 papers addressing ethics.
  • Frameworks such as SAMR and FACETS give CME teams a way to move beyond tool demos toward structured assessment and reporting.

AI education is moving faster than clinicians’ verification habits. Educator voices highlight that ChatGPT and AI-enabled tools are already in daily use for writing, searching, and assessment, yet hallucinated or biased outputs can pass unchecked into clinical reasoning. The evidence base remains educator-led with limited independent practicing-clinician corroboration, but the implication for CME is direct: verification and ethics must be treated as core competencies rather than optional add-ons.

The CPD gap now has a verification problem

In a PAPERs Podcast discussion of a BEME scoping review, medical educators described everyday AI use that is already ahead of training norms: ChatGPT and AI-enabled search tools are being used for writing, searching, assessment support, and workflow shortcuts. The concrete worry was not abstract resistance to AI. It was that hallucinated or biased outputs can move through learning and clinical reasoning workflows without being checked.

That changes the provider problem. In an earlier brief on AI research bypassing practicing clinicians, the issue was largely a literature imbalance: AI medical education work was heavily weighted toward UGME and GME. This week’s discussion adds operational detail. The reviewed corpus included 278 papers, but only 3% focused on CPD; only 14 addressed ethics topics such as algorithmic bias, transparency, informed consent, and privacy. For CME providers, that means the shortage is not simply “more AI content for clinicians.” It is more education that teaches clinicians how to verify, disclose, question, and safely apply AI outputs in practice.

The same review discussion, also available in the video version, pointed to SAMR as a useful way to classify whether AI is merely substituting for an old task, augmenting it, modifying it, or redefining it. That matters for instructional design. A session that demonstrates prompt-writing sits at a different level than an activity requiring clinicians to compare AI-generated recommendations against source evidence, identify bias or missing context, and decide what can be used in patient care.

FACETS offers a related discipline for reporting and comparing AI education work. For CME teams, the useful move is to apply those frameworks internally before building another AI module: Is the activity teaching verification? Is it surfacing consent and privacy decisions? Is it assessing whether the clinician can recognize when AI output is plausible but unsupported? If not, the activity may improve familiarity without improving judgment.

What CME Providers Should Do Now

  • Audit current AI education for explicit verification steps: source checking, uncertainty recognition, and escalation when outputs conflict with evidence.
  • Add short ethics cases on bias, consent, transparency, and privacy rather than treating ethics as a single introductory slide.
  • Use SAMR to label the learning objective: substitution, augmentation, modification, or redefinition. Do not assess all four with the same quiz format.

What to reconsider

The week’s signal is not that CME should chase every new AI tool. It is that tool familiarity without verification practice may leave practicing clinicians overconfident at exactly the wrong point in the workflow. CME teams should reconsider whether their AI content is teaching clinicians to use AI, or teaching them to judge AI when it sounds convincing.

Sources

  1. 01
    Podcast

    #71 - UPDATED First we build the AI, then the AI builds us

    The PAPERs Podcast · · cited segment 1:35-3:46

    Papers Podcast hosts discuss BEME 278-paper scoping review, highlighting 'dabbler' behavior, learner hallucination risks, 3 % CPD focus, and 14 ethics papers.

    Open source
  2. 02
    YouTube

    #71 - UPDATED First we build the AI, then the AI builds us

    Teachning and Learning at KI · · cited segment 1:35-3:43

    Same review unpacked with SAMR/FACETS frameworks and concrete examples of AI use in assessment (MCQ generation, narrative feedback, virtual OSCEs).

    Open source

Turn learner questions into outcomes data

ChatCME surfaces the questions clinicians actually ask — so you can build activities that close real knowledge gaps.

Request a demo