My name is David Fetterman. I’m President & CEO of Fetterman & Associates, an international evaluation consulting firm (with 25 years experience at Stanford University) and past-president of the American Evaluation Association (AEA). I am probably best known for empowerment evaluation work (helping people learn how to evaluate their own programs). For examples see our blog and an article about empowerment evaluation in the School of Medicine at Stanford University in Academic Medicine, and the book Empowerment Evaluation in the Digital Villages: Hewlett-Packard’s $15 Million Race Toward Social Justice, Stanford University Press
One of my recent evaluations, conducted with my Stanford School of Medicine students, focused on LGBT curricular training in medical schools throughout the U.S. and Canada. The results – a median reported time of 5 hours of LGBT-related content in the entire curriculum – were published in this article in the Journal of the American Medical Association (JAMA). It received considerable attention in the press, in part because it is as much a human rights issue as a medical education issue. I’ll share a few tips and tricks that emerged from conducting and publishing this study.
Hot Tip: We used an online survey program to ask Deans of Schools of Medicine to evaluate their institutions’ level of coverage of 16 LGBT related topics. Online survey tools, such as SurveyMonkey, save time and money and sort data almost instantaneously. Surveying Deans automatically enhances the credibility of findings (especially if findings suggest minimal coverage of the material, as in our case).
Reporting survey findings was as much a social responsibility as a scholarly one. See Anne Dohrenwend’s challenge to speak out about gay rights in Academic Medicine.
Cool Trick: Videoconferencing programs, including Skype, ooVoo, and Google Hangouts are invaluable tools to facilitate communication with team members at remote sites. Most team members were located across the country, completing residency requirements. Videoconferencing allowed us to function remotely and inexpensively.
Rad Resource: The Association of American Medical Colleges maintains a curriculum management and Information (CurrMIT) database that helps you determine the coverage of specific topics in medical schools. This database was particularly useful as a form of triangulation when our reporting format – “reported hours of instruction” – was questioned in a draft of our article.
Recommended LGBT cultural competence resources:
Lesson Learned: Be prepared for significant opposition to unpopular or controversial findings. Be prepared to speak with the press. Highlight key findings and recommendations simply and concisely and be prepared to see how journalists use the information (see example of highlighted findings in New York Times.) Appreciate your team and enjoy the media blitz for as long as it lasts.
aea365 is sponsored by the American Evaluation Association and provides a Tip-a-Day by and for evaluators. We’re celebrating LGBT Evaluation week with our colleagues in AEA’s LGBT Topical Interest Group. Do you have questions, concerns, kudos, or content to extend this aea365 contribution? Please add them in the comments section for this post on the aea365 webpage so that we may enrich our community of practice.