Topic: Simulation-Based Assessment
Presented by: David A. Cook, MD, MHPE
Ptofessor of Medical Education, Mayo Clinic - Rochester
Professor of Medicine, Mayo Clinic - Rochester
Space is limited - please RSVP!
Co-sponsored by WWAMI Institute for Simulation in Healthcare (WISH)
This workshop will present a comprehensive approach to developing a rigorous validity argument for simulation-based educational assessments. Using practical cases and examples from published research Dr. Cook will illustrate how to structure the validity argument using five sources of evidence: content, response process, internal structure, relations to other variables, and consequences. Participants will discuss the critical relationship between reliability and validity, and review various methods to measure reliability. They will also how to discuss choose among various potential outcomes when planning a course evaluation or research study.
At the completion of this workshop, participants will be able to:
- Define validity, and explain why validity applies to the interpretation of an instrument’s scores (not the instrument itself)
- Describe shortcomings in published evidence for simulation-based assessment
- Use five sources of validity evidence to structure a coherent validity argument
- Contrast different methods for measuring the reliability of instrument scores, and discuss the contribution of reliability to validity
- Outline an 8-step approach to assessment validation