Assessment Equity Requires a Stated Orientation

Key Takeaways

• Assessment equity can mean fairness, inclusion, or justice; each points to different design choices and outcome measures.
• CME teams should state the chosen orientation before building assessments, rubrics, learner analytics, or outcomes plans.
• A technically stronger assessment can still miss equity harms if the wrong orientation is assumed but never named.

Assessment equity surfaced this week as a choice CME teams have to make before design begins. A fairness-oriented activity might improve standardization, reduce rater bias, and strengthen validity evidence; a justice-oriented approach might instead ask whose standards are being used, who holds decision power, and whether the assessment system itself should be rebuilt. This is a narrow signal from a single academic audio source, not broad clinician corroboration, but the design implication is concrete.

Equity is not one assessment strategy

The useful point in this week’s education conversation is that “equity” in assessment can point to three different orientations: fairness, inclusion, or justice. In the Medical Education audio paper, fairness is framed around reducing bias and construct-irrelevant variance; inclusion around accessibility, flexibility, participation, and co-design; justice around power, history, culture, and rebuilding systems with marginalized users in central roles.

Those are not interchangeable labels. Fairness may push a CME provider toward standardized items, rater training, psychometric review, and comparisons across learner groups. Inclusion may push toward accessible formats, learner participation in design, and shared interpretation of assessment data. Justice may push toward questioning who defined the competency, whose knowledge counts, and whether the assessment structure reinforces the disparity it claims to measure.

That matters because CME assessment plans often collapse these choices into generic language: equitable, unbiased, inclusive, accessible. The audio paper’s clearest warning is that each orientation uses different methods and outcome measures. As the paper puts it, “Process equity is the equity of how assessment is done, its design, context, and use.” If the team has not named the orientation, it can end up mixing methods that look aligned on paper but answer different questions.

For CME providers, the implication is less about adopting a new equity vocabulary and more about governance. Before revising a pre/post test, outcomes rubric, case simulation, faculty scoring guide, or learner analytics dashboard, teams should ask: are we trying to make the measure more impartial, make participation more accessible, or challenge the assumptions behind what we measure? We saw a related assessment problem in an earlier brief on ability-based progression: once learning moves from time spent to ability demonstrated, the assessment frame carries more weight. This week’s signal adds that equity claims need the same upfront precision.

What CME Providers Should Do Now

• Add an “equity orientation” field to assessment briefs: fairness, inclusion, justice, or a deliberately justified combination.
• Match metrics to the orientation before launch; do not use performance-gap data as the only equity measure if the stated goal is inclusion or justice.
• Review current assessment language for vague terms such as equitable, unbiased, inclusive, or accessible, and replace them with the actual design commitment.

What to reconsider

The assessment conversation is also being pulled by AI, but this week’s stronger lesson sits underneath the tool question. In a separate educator discussion, a pediatric cardiology educator described AI use as changing what learners can retrieve, summarize, and present, which forces educators to assess critique, defense, and judgment rather than answer production alone (Faculty Feed).

That makes the equity orientation choice more important, not less. If CME teams redesign assessment for AI-era learning without first deciding what kind of equity they mean, they may improve measurement mechanics while leaving the underlying equity claim unexamined. The immediate audit is simple: find one active assessment project and ask whether its equity language, methods, and outcomes are all pointing in the same direction.