FAME: Fundamentals of Assessment in Medical Education

Faculty

Course Directors

John (Jack) R. Boulet, PhD

Dr. John Boulet

Dr. Boulet serves as FAME Course co-director. He is Associate Vice President, Research and Data Resources, for the Foundation for Advancement of International Medical Education and Research (FAIMER) and Assistant Vice President, Research and Evaluation, for the Educational Commission for Foreign Medical Graduates (ECFMG). For the past 15 years, Dr. Boulet has worked on the development of performance-based credentialing assessments in medicine. He has published extensively in the field of medical education, focusing specifically on measurement issues pertaining to performance-based assessments, including objective structured clinical examinations (OSCEs) and various mannequin-based evaluation methodologies. As part of ongoing FAIMER research activities, he is coordinating the development, linking, and mining of data resources that can help inform national and international policies concerning health workforce distribution. Dr. Boulet currently serves on the editorial boards for Advances in Health Sciences Education, Education for Health, and Simulation in Healthcare. He is the deputy editor for Medical Education.

Ann King, MA

Dr. Ann King

Ms. King serves as FAME Course co-director. Ann is an Assessment Scientist in the Measurement Consulting Services unit at the National Board of Medical Examiners. Her current activities include teaching medical school faculty to develop better assessment tools; conducting research and development on the assessment instruments used in the clinical skills arena; and improving the understanding of clinical decision making. Previously, Ann was responsible for the test development unit that launched the United States Medical Licensing Exam, Step 2 Clinical Skills Exam in 2004. Ann has more than twenty-five years in the field of clinical skills assessment including more than 20 years at the NBME. She has mentored leaders in medical education at more than 100 medical schools in the United States and abroad. She has published and presented extensively on high stakes assessments using standardized patients. In 2004 Ann received the Outstanding Educator Award from the Association of Standardized Patients of which she is a founder.

Faculty

André F. De Champlain, PhD

André F. De Champlain

Dr. De Champlain is Chief Research Psychometrician at the Medical Council of Canada. He is involved in a number of new initiatives at Council, including the review of current scoring and standard setting methodologies for MCC examinations, as well as several research studies aimed at better informing and supporting policy and current developments.

Dr. De Champlain previously held the position of Director for Innovations in Testing at the National Board of Osteopathic Medical Examiners, where he was chiefly responsible for overseeing developmental and psychometric research efforts aimed at supporting the inclusion of innovative item types and maintenance of licensure tools in COMLEX-USA, the licensing examination program for Osteopathic physicians in the United States. Prior to this position, he spent nearly 15 years at the National Board of Medical Examiners, where he acted as research psychometrician for several USMLE examinations, as well as international testing programs.

Dr. De Champlain has published extensively over the past two decades on a broad range of topics, most of which relate to novel applications of psychometric models in medical education. His most recent publications have focused on the use of correspondence analysis and survival data analysis to gather validity evidence for high stakes medical licensing examination programs. He has been the recipient of several research awards, including best paper honors bestowed by the Association of American Medical Colleges (1998) and the American Educational Research Association (2001).

W. Dale Dauphinee, MD, FRCPC

Dr. Dale Dauphinee

Dr. Dale Dauphinee is the former Chair and Professor in the Department of Medicine at McGill University who also served as the founding Director of the Division of Clinical Epidemiology at the Royal Victoria Hospital, the Associate Dean of Medicine (Medical Education) and the Director of the McGill Center for Medical Education Research. From 1993-2006 he was the Executive Director of the Medical Council of Canada where he established its first in-house research program, an external research grants program, directed their pioneering move adaptive on-line assessment methods, and created the national physician identifier and physician credential verification services. During that time he received many awards for distinguished service, including the John Hubbard Award from the National Board of Medical Examiners for excellence in contributions to medical assessment and evaluation. He sits on several editorial and international advisory boards. He continues to conduct research into workforce production, developing informatics infrastructure and assessment outcomes strategies, as well as consulting and advising universities, national professional bodies, governments, and health sciences educational programs internationally.

Anthony Errichetti, PhD

Dr. Anthony Errichetti

Dr. Errichetti earned his Ph.D. in Psychoeducation from Temple University and completed the Comprehensive Course in Medical Simulation at the Harvard University Center for Simulation. He is Chief of Virtual Medicine and Professor in the Department of Psychiatry and Behavioral Medicine at New York College of Osteopathic Medicine (NYCOM). He established and is the Director of the Institute for Clinical Competence at NYCOM and St. Barnabas Hospital, Bronx, New York. In this capacity he has designed and implemented patient simulation learning and assessment modules for medical students, residents, physicians and nurses through multi-modal patient simulations. He is also a consultant for medical schools and health sciences programs around the United States on simulation program development, and on implementing protocols to prepare Standardized Patients and clinical faculty to assess communication and provide debriefing. He has also developed doctor-patient and health team communication assessment rubrics. He has designed and will direct a Master of Science in Health Care Simulation program at NYCOM, accepting students for September 2012.

Marc Gessaroli, PhD

Marc Gessaroli

Dr. Gessaroli is Associate Vice President Operations Research at the National Board of Medical Examiners. He has worked in psychometrics and applied statistics for over 25 years both teaching graduate level courses in educational measurement and statistics at the University of Ottawa and carrying out both applied and theoretical psychometric work related to NBME exam programs. During his 17 years at the NBME, Dr. Gessaroli has had responsibility for the psychometric integrity of USMLE Step 1 as well as several medical school subject examinations and client programs. His current research focuses on developing psychometric methods to ensure fairness in comparing test scores when examinations are administered in different cultures and different languages.

Melissa Margolis, PhD

Melissa Margolis

Dr. Margolis is a Measurement Scientist in the Measurement Consulting Services unit at the National Board of Medical Examiners. Her present responsibilities involve coordination and oversight of standard setting activities for the USMLE program, including development of novel standard setting procedures for the clinical skills and CCS examination formats. Dr. Margolis also provides consulting services relating to evaluation and improvement of high-stakes assessments; domestic and international clients have included the American College of Veterinary Preventive Medicine, the American Osteopathic Board of Orthopedic Surgeons, the Royal Colleges of Physicians, Radiologists, and Surgeons in the United Kingdom, and the National Medical Examination Center in China. Dr. Margolis has published extensively in the educational measurement and medical education literature. Recent publications include a chapter on reliability and validity in the Practical Guide to the Evaluation of Clinical Competence and a chapter on licensure and certification in the fourth edition of Educational Measurement.

Ingrid Philibert, PhD, MBA

Dr. Ingrid Philibert

Dr. Philibert is the Senior Vice President, Department of Field Activities at the Accreditation Council for Graduate Medical Education (ACGME). She is responsible for the Council's 31 MD and PhD accreditation field representatives, for all aspects of the approximately 2,000 site visits conducted annually at accredited program and sponsoring institutions, and for related data collection, policies and procedures, and professional and program development efforts.

She also serves as the Managing Editor for the Journal of Graduate Medical Education and staffs the Journal Oversight Committee and Editorial Board.

Dr. Philibert received master's degrees in hospital and health care administration and business administration, and a doctor of philosophy degree, all from the University of Iowa.

She serves as a member of the National Board of Medical Examiners' Center for Innovation Advisory Committee, Patient Safety Committee, Professional Behaviors Advisory Committee, and International Program Advisory Committee and has been at At-Large member of the NBME Board of Directors since March 2007. She also has served as a member of the National Board of Examiners for the Malcolm Baldrige National Quality Award for 2000, 2001, 2004 and 2005 and as Senior/Alumni Examiner for 2006, 2008, 2009 and 2010. Her research interests are patient hand-offs in teaching settings, simulation and rehearsal in medical education, and the effect of limits on resident duty hours on resident learning and acquisition of competence and the provision of clinical care in teaching institutions.

Lesley Southgate DBE DSc FRCS FRCGP

Leslie Southgate

Professor Dame Lesley Southgate is Professor of Medical Education at St George's Hospital Medical School. She is a general practitioner and was active in patient care until she became President of the RCGP in 2000. From 1996-2004 she led the GMC President's programme to develop and implement the assessment methods for the GMC performance procedures for the medical profession. She was a member of the Postgraduate Medical Education Training Board (PMETB) to November 2006 where she chaired the Statutory Committee on Assessment and its subcommittee on examinations in postgraduate training until January 2006. She is the principal author of the Board's paper on principles for assessment, now a requirement for all postgraduate assessment programmes in the UK.

She is known internationally and nationally for her work on the assessment of competence and performance of physicians and in 2008 was awarded the prestigious Hubbard award by the US National Board of Medical Examiners for outstanding contribution to assessment of competence and performance of doctors in the international arena. Dame Lesley was elected a Board Member at large at the 2009 NBME annual meeting and now takes an active part in the work of the Board.

International work includes a connection with the Medical Academy of St Petersburg where she is a distinguished international professor and support for the Egyptian Board of Medical Specialties in the development of the certifying examinations for family medicine (MRCGP Int.).

Currently Dame Lesley has three principal roles. She is the project lead for assessment for the UK programme, Modernising Scientific Careers. She is also the lead for curriculum development in an EU programme to improve the quality of life for people infected with or affected by HIV/AIDS in Libya. This work was suspended in February 2011. Dame Lesley is also President and Founder member of the recently established European Board of Medical Assessors, (EBMA) a not for profit Foundation based in Rome, to promote excellence in the assessment of clinical competence across the EU. The executive includes, Prof Cees van der Vleuten and Prof Walter Ricciardi.

From January 2012, Dame Lesley will also be a visiting professor at the Catholic University of the Sacred Heart, in Rome.

David B. Swanson, PhD

Dr. David Swanson

Dr. Swanson is currently the Vice President for Program Development and Special Projects in the Assessment Programs unit at the National Board of Medical Examiners (NBME). In that role, he works broadly on new NBME programs and services, international programs, and development of new assessment formats.

Beginning in 1981, he directed the ABIM Computer-Based Examination project and conducted research on written and computer-based clinical simulations, the use of standardized patients for assessment of clinical skills, and measurement of communication skills and professionalism with ratings from real patients. He joined the NBME staff in 1988, directing USMLE Step 1 until 2001. He served as the Vice President for Test Development Services until early 2010, when he moved into his current position.

Dr. Swanson has co-authored and presented several hundred papers. Topics include assessment of medical decision making with multiple-choice tests, patient management problems, and computer-based clinical simulations; assessment of clinical skills with standardized patients; issues in computer-based testing; patterns of performance on admissions, licensure and certification examinations; and use of the internet for construction of customized examinations for use by medical schools. He has also conducted item-writing and other assessment-related workshops at dozens of medical schools and professional conferences nationally and internationally.