
For my upcoming presentation on AI in medical education, I have posted a set of practical materials to support preceptors with narrative assessment and coaching language, including guidance on when AI support can be helpful, and when it should not be used. These resources were developed for our upcoming faculty development retreat, and are now available for our physicians to access anytime.
What’s included
- A short narrative assessment exercise (two scenarios) to practice rewriting “meh” comments into specific, actionable coaching language
- A structured activity that explores using AI as a data analyst for resident feedback (themes, patterns, and what can go wrong)
- A “Minimum Evidence Scorecard” to support thoughtful, defensible decisions about AI tools in clinical education
How to access the materials
You can view and download the package here:
Materials link: https://drive.google.com/file/d/1VP0ZahYwtkGVhuFsuwkAFvRIinWmROmc/view?usp=sharing
For our AI data analyst exercise, you will need to copy, paste, and download the following educational sample comments with the assigned prompt. All comments are hypothetical and created solely for faculty development. Any resemblance to real individuals or events is coincidental.
AI Prompt: “Review the 10 assessment comments below. Give me exactly 5 bullets:
2 themes: learner strengths
2 themes: learner growth areas
1 signal of rater variability
Use only what is written. Do not add facts.”
Educational Sample Comments:
· “Pleasant and engaged, did a good job today. Solid knowledge base. Keep reading around cases.”
· “Strong rapport and empathy, patient felt heard. Could improve agenda-setting at the start to keep the visit focused.”
· “Reviewed meds accurately and checked adherence barriers. Good safety thinking. Next step: summarize the plan out loud at the end and confirm patient understanding.”
· “Did fine overall, but was slow. Needs to be more efficient and more confident in decisions.”
· “Good history, but missed red flags initially for chest pain, asked after prompting. Please use a consistent red-flag checklist early.”
· “Professional and hardworking. Documentation was at times incomplete.”
· “Handled a challenging patient respectfully, but avoided setting boundaries when the patient requested antibiotics for a viral illness. Coaching point: practice a clear, evidence-based refusal with alternatives.”
· “Good job, very thorough. Ran 15 minutes over time and did not prioritize. Work on focusing your questions and closing with a clear plan.”
· “Demonstrated good clinical reasoning in abdominal pain, proposed a differential and safety net. Would like to see more explicit follow-up instructions documented.”
· “Excellent resident, no concerns.”
See you on Friday!
Dr. Jacqueline P. Ashby, EdD, MSc
Assessment and Evaluation Co-Lead, UBC Family Medicine Residency Program
Faculty Development Coach, Team-Based Primary Care Learning Centre











