From questions to measurable outcomes

ChatCME analytics turn real learner questions and citations into participation trends, evidence-use signals, themes, and objective alignment. See what your activities achieve and where to improve.

Request a demo

What you see at a glance

Participation and engagement

Unique learners, sessions, questions per session, median dwell time

Evidence use

Citation opens, slide and timestamp interactions, reference views

Themes

Clustered question topics mapped to your learning objectives

Objective alignment

Message-level alignment rate and coverage by objective

Portfolio views

Compare programs, sites, and conferences over time

Exports

CSV with message-level fields for deeper analysis

Analytics in action

See how ChatCME analytics surface participation patterns, objective alignment, evidence use, and actionable insights across your programs.

Real-time dashboards

  • •Track engagement metrics as learners interact with content
  • •Monitor objective alignment rates and coverage in real time
  • •Identify trending themes and knowledge gaps

Actionable insights

Filter by date range, program, site, or conference. Export CSV for deeper analysis or share summary views with stakeholders.

Dashboard showing participation, objective alignment, and evidence use

Objective alignment analytics

Configure objectives in Admin Console

Measure how well the activity drives inquiry toward your stated objectives.

  • •Alignment rate: share of messages aligned to one or more objectives
  • •Coverage by objective: messages and sessions per objective with trends
  • •Unaligned queue: review unaligned or ambiguous messages to refine objectives or content
  • •Editor control: review and override alignment with confidence scores; all changes are logged

Why it matters

Objective alignment shows whether questions concentrate on the knowledge and decisions your faculty set out to address.

Evidence-use analytics

See how often learners verify information and where they look.

  • •Citation engagement: opens per session and per answer
  • •Slide and timestamp trails: which slides and timecodes learners jump to most
  • •Reference interactions: quote and summary views, document opens
  • •Heatmaps: concentrated attention by slide or section

These signals help you identify content that drives verification and follow-up reading.

Theme mining

Understand what learners are really asking.

  • •Topic clusters from natural-language questions
  • •Mapping to objectives to confirm coverage and reveal gaps
  • •Trend lines that show rising, stable, and falling themes
  • •Exemplar questions (de-identified) to give faculty quick context

Use themes to adjust modules, update slides, and plan the next activity.

Cohorts and portfolio rollups

Slice by context to see where impact is strongest.

  • •Cohort filters when available: specialty, career stage, region
  • •Program, site, and conference views with consistent metrics
  • •Time windows for before-and-after comparisons and longitudinal tracking

Rollups help teams prioritize updates across a portfolio while preserving activity isolation.

CSV export and data dictionary

Export message-level data for audits, research, and custom reporting.

Included fields

Identifiers

  • message_id
  • session_id
  • program_id
  • user_hash (pseudonymized)

Objective alignment

  • objective_id
  • objective_label
  • alignment_label (aligned, unaligned, ambiguous)
  • alignment_score (0–1)

Metadata

  • timestamp
  • slide_number
  • video_timecode when applicable

Sources

  • citation_ids[] for source snippets used in the answer

Also available

  • •Session metrics and event counts by date range
  • •Theme labels with example questions (de-identified)

Signals captured

Analytics are built from privacy-safe event data.

  • •Conversation: message sent, response shown
  • •Verification: citation opened, reference view, slide viewed, video progress
  • •Feedback: thumbs up, thumbs down with optional reason, message copied, share started
  • •Objective alignment: alignment label and confidence score on each learner message

International and accessibility support

  • •50+ languages for content ingestion and answer rendering
  • •WCAG-aligned UI patterns for keyboard and screen readers
  • •Kiosk mode for conferences and onsite deployments

Optional module: measured learning outcomes

When you need to claim learning outcomes directly, we offer an optional module that we can discuss with you.

  • •Pre and post knowledge checks tied to learning objectives
  • •Competence scale for confidence in key tasks
  • •Commitment to change with a 30 to 60 day follow-up on implementation and barriers
  • •Transparent methods with sample sizes and effect sizes

This module complements analytics and objective alignment. Talk to us about enablement and rollout options.

Privacy and independence

Security & trust details →

De-identified by design

No learner-level reporting to supporters

Independence preserved

Supporters do not have editorial access

Security

Encryption in transit and at rest, least privilege access, audit logs

PHI

Not required for typical CME use; HIPAA safeguards under BAA when applicable

Frequently asked questions

Request a demo