Insights/Clinician Learning Brief

From Milestones to Quintuple Aim: CME Must Now Prove Patient Outcomes

Topics: Outcomes planning, Learning design, Workflow-based education
Coverage Jan 15–21, 2024

Abstract

CME activities must demonstrate contributions to population health, cost, experience, well-being, and equity; open educational resources require needs assessment, team development, and attention to cultural portability.

Key Takeaways

  • Outcomes-based education is being framed less as milestone documentation and more as a lever for population health, cost, patient experience, workforce well-being, and equity.
  • Digital educational resources need stronger production discipline: needs assessment, team review, visual design choices, and clearer evidence limits.
  • Localization is becoming part of quality, not a downstream translation step.

An ACGME leader traced 22 years of outcomes-based education to a new endpoint: trainee competencies must ultimately improve population health, reduce costs, enhance patient experience, support workforce well-being, and advance equity. The week’s second signal, from open educational resources, points to the same operational problem: CME teams are being asked to prove impact while many content workflows still look built for distribution first and outcomes second.

Milestones are no longer enough

On the Faculty Factory podcast, Eric Holmboe traced the arc from the ACGME Outcomes Project through milestones and entrustable professional activities, then pushed the endpoint beyond trainee competence: education should help serve the public and the communities clinicians care for. In that framing, the “ultimate outcomes” are not only whether learners can perform but whether education contributes to population health, cost, patient experience, workforce well-being, and equity (Faculty Factory).

For CME providers, the implication is not to add a bigger outcomes paragraph to the activity file. It is to decide earlier what kind of downstream change the activity is trying to influence and what evidence could plausibly show movement. The source is GME-focused, with internal-medicine examples, but the operating question travels well to CME: are we measuring the learner’s completion of an educational step, or the education’s contribution to a real care aim?

Holmboe also pointed to faculty gaps in quality improvement, patient safety, interprofessional work, and systems-based practice. That connects directly to an earlier brief on clinician-educators wanting coaching programs, not more lectures: if faculty are expected to observe, coach, and assess in daily work, CME cannot treat faculty development as a separate add-on. The concrete question for CME teams is whether assessment, coaching, and QI support are built into the learner’s workday—or merely appended after the content is consumed.

Open resources need quality controls

A separate educator discussion focused on open educational resources: podcasts, blogs, infographics, wikis, and other low-cost digital materials that can be shared or adapted. The discussion of an OER guideline paper was useful because it did not simply celebrate access. It raised the harder question of quality: who built the resource, what need did it answer, how is it kept current, and how should learners know what to trust (Teaching and Learning at KI).

The strongest recommendations discussed were familiar but often underbuilt in digital content operations: conduct a needs assessment, work through a virtual community of practice rather than as a solo creator, and use visual formats such as infographics or graphical abstracts when they fit the learning task. The conversation also flagged real unknowns: evidence is limited outside Western, English-language contexts; the best way to integrate OER into curricula is unsettled; and industry support raises ethics questions that need clear handling (The PAPERs Podcast).

This evidence comes mainly from educator podcast discussion of a guideline paper, not a broad sample of practicing-clinician behavior. Still, it gives CME teams a useful test: if a podcast, infographic, or blog is being used as serious education, does it have the same needs logic, review discipline, updating plan, and conflict-handling clarity that the provider would expect from a larger activity?

What CME Providers Should Do Now

  • For priority activities, name one intended quintuple-aim contribution before format selection: population health, cost, patient experience, workforce well-being, or equity.
  • Build faculty-facing components around observation, feedback, QI, and systems practice inside the clinical workflow, not as detached prework or postwork.
  • For reusable digital resources, document the needs assessment, review model, update cadence, and assumptions about learner context before scaling distribution.

What to reconsider

The week’s quiet but useful message is that “quality” is becoming harder to separate from context. A provider-owned Write Medicine episode on building CME for Africa described a localization model that uses local writers, reviewers, designers, translation, and pilots because imported content may miss available medicines, local practice, beliefs, and patient realities (Write Medicine). This is a single CME-operator example, not broad clinician consensus. But it sharpens the same question raised by the outcomes and OER conversations: when CME teams say an activity is scalable, do they mean it can be distributed widely, or that it can still produce credible learning and care outcomes in the settings where it lands?

Sources

  1. 01
    Podcast

    Why to Consider Transforming to an Outcomes-Based System with Eric S. Holmboe, MD

    Faculty Factory · · cited segment 3:15-5:22

    ACGME leader traces the policy arc and highlights faculty gaps in QI and interprofessional training plus the need to integrate assessment into existing workflows.

    Open source
  2. 02
    YouTube

    #35 - "I heard it on a podcast… “: Best practices for developing quality open access education re...

    Teachning and Learning at KI · · cited segment 1:37-3:38

    Educators highlight strong support for needs assessments, near-peer virtual CoPs, and graphical abstracts while noting recommendation heterogeneity.

    Open source
  3. 03
    Podcast

    #35 - "I heard it on a podcast… “: Best practices for developing quality open access education resources.

    The PAPERs Podcast · · cited segment 1:37-3:38

    Podcast endorsement of format with caveats on cognitive bottlenecking and dual-tasking plus flags on non-Western perspectives, curriculum integration, and industry ethics.

    Open source
  4. 04
    Podcast

    Building a Global CME/CE Program

    Write Medicine · · cited segment 14:36-16:39

    CME operator details MILO initiative hiring and training local African writers, reviewers, and designers plus translation and pilot studies to overcome unavailable medicines and practices.

    Open source

Turn learner questions into outcomes data

ChatCME surfaces the questions clinicians actually ask — so you can build activities that close real knowledge gaps.

Request a demo