Your Staff Are Already
Using AI to Do
NBME's Work.
Do You Know How?
Every team at NBME — psychometricians, item developers, assessment designers, technology teams, operational staff — is already using AI tools in their day-to-day work. Some are using it well. Many are using it in ways that put the integrity of NBME's assessments, the confidentiality of candidate data, and the rigour your mission demands at serious and avoidable risk.
Assessment data, candidate information and test content are your most protected assets. AI changes the risk equation.
- Item writers and assessment developers pasting draft test content into consumer AI tools — exposing high-stakes examination material to third-party servers with no data retention controls
- Candidate data — scores, identifiers, performance patterns — handled by AI tools outside any approved data governance framework
- No shared protocol across teams on which AI tools are approved for which data types — creating inconsistent practice and unmanaged liability
- AI models producing plausible but incorrect outputs in psychometric or clinical contexts — staff without the fluency to identify and challenge those errors before they enter a workflow
- Significant manual overhead in reporting, documentation, research synthesis, and internal communication that AI could handle safely and consistently — freeing staff for higher-value assessment work
- Health professionals and educators looking to NBME for leadership on AI in assessment — a responsibility that requires NBME's own teams to model genuine AI fluency, not cautious avoidance
Optimal care for all depends on assessments that keep pace with how medicine and technology evolve together.
NBME's mission is to advance the assessment of health care professionals to achieve optimal care for all. That mission does not pause while the healthcare system transforms around it. AI is already reshaping how clinicians work, how medical knowledge is produced and accessed, and how health professionals are trained. The organisations responsible for assessing those professionals need to understand AI deeply enough to assess its role in clinical competence — and that starts with their own teams.
This is not about technology for its own sake. It is about ensuring that the people who design, build, and deliver the assessments that protect patients have the AI fluency to do that work responsibly in a world where AI is present in every clinical setting their candidates will enter.
Three phases. Designed to match where your organisation is right now.
We do not come in with a fixed programme and ask NBME to fit into it. We start with where your teams are and build from there. Most organisations begin with Phase 1 and move to Phases 2 and 3 once they see the results. Every phase stands on its own and delivers value independently.
A focused 90 to 120 minute hands-on session for any team at NBME. Not a lecture. Not a slide overview. A live, interactive session where every participant works with AI tools directly under facilitated guidance.
A 2 hour hands-on build session where participants go from using AI to building AI agents. Designed for teams with recurring, structured workflows that currently depend on manual effort — and should not have to.
For organisations ready to move beyond individual training and build AI capability into how the work gets done. We work alongside your teams as a trusted AI partner — mapping workflows, identifying automation opportunities, and building the internal capability that sustains after our engagement ends.
Every team has a different relationship with AI. Every team has something to gain.
We design each cohort around the actual work of the people in the room. The session for item development teams looks different from the session for psychometricians, which looks different from the session for technology or operations teams. The framework is consistent. The application is specific.
Safe, approved use of AI for item writing efficiency, content review, and format variation — without any confidential examination material leaving a controlled environment.
AI for literature synthesis, report drafting, data summarisation, and research communication — with a clear understanding of where AI output requires human verification in a high-stakes context.
Practical AI fluency for teams building and maintaining assessment platforms — including understanding AI capabilities relevant to the tools their candidates will encounter in clinical practice.
AI for documentation, status reporting, stakeholder communication, and process efficiency — the administrative overhead that consumes time that could go toward mission-critical work.
AI fluency for teams who work with medical schools, healthcare organisations, and professional bodies — ensuring NBME speaks credibly about AI in assessment when partners and clients raise it.
Strategic AI literacy for leaders making decisions about AI's role in assessment development, platform capability, and NBME's positioning on AI in healthcare evaluation.
The organisations that set standards must demonstrate them.
NBME sets the standard for how healthcare professionals are assessed. Medical schools, healthcare systems, licensing bodies, and clinicians themselves look to NBME for rigour and leadership in evaluation. When AI begins to reshape how clinical competence is demonstrated and assessed — and it already is — NBME's voice on that question needs to come from a place of genuine working knowledge, not from the sidelines.
Building AI fluency across NBME's staff is not overhead. It is how NBME stays credible as the organisation that defines what it means to be a safe and competent health professional in a world where AI is part of clinical practice.
The assessment professionals and researchers who go through this programme do not just become better at their jobs. They become part of an organisation that can speak with authority about AI in healthcare assessment — because they have done it themselves.
Different industries. Different challenges. One consistent result.
Every engagement below is real and anonymised to protect our clients. The common thread across all of them is the same situation NBME faces today — teams using AI without a shared framework, data at risk they did not know was at risk, and the potential to gain significant capability that was sitting unused.
Compliance-Bounded AI Rollout
Leadership and Analyst Dual Track
Full Three-Phase Engagement
Workflow Automation Programme
A lasting AI capability that protects your mission and accelerates your work
Every staff member leaves with a clear, internalised protocol for which AI tools are safe for which data types. Examination content, candidate information, and research data stay within approved boundaries — not by policy, but by practised habit.
The documentation, reporting, research synthesis, and internal communication that consumes hours of expert time every week — handled safely and efficiently by AI. Those hours go back to the assessment work only NBME's people can do.
NBME teams who understand AI well enough to engage credibly when healthcare organisations, medical schools, and policymakers ask about AI's role in assessment. That credibility is part of how NBME fulfils its mission in a world where AI is already in the clinic.
We start small and build proof before we ask for scale.
NBME does not need a firm-wide mandate on day one. We propose starting with a single cohort — one team, one phase, 90 minutes. The outcomes from that session become the evidence base that makes the case internally for the next cohort and the next phase. Expansion happens because people who went through the programme pull their colleagues in — not because of a top-down directive.
One team. One phase. 90 minutes. Real outcomes you can point to immediately.
Measurable participant outcomes become the case for expanding to the next team.
Expand across teams and departments. Content adapted for each team's specific context.
Phase 3 consulting, quarterly updates, capability evolution as AI continues to develop.
ICAgile Accredited Provider · HQ Singapore · Delivering Globally