Bias may exist in rating of medical trainees
Peter Yeates, M.B.B.S., M.Clin.Ed., of the University of Manchester, United Kingdom, and colleagues conducted a study to examine whether observations of the performance of postgraduate year 1 physicians influence raters' scores of subsequent performances.
"The usefulness of performance assessments within medical education is limited by high interrater score variability, which neither rater training nor changes in scale format have successfully ameliorated. Several factors may explain raters' score variability, including a tendency of raters to make assessments by comparing against other recently viewed learners, rather than by using an absolute standard of competence. This has the potential to result in biased judgments," according to background information in the article.
The study consisted of an internet-based randomized experiment using videos of Mini Clinical Evaluation Exercise (Mini-CEX) assessments of postgraduate year 1 trainees interviewing new internal medicine patients. Participants were 41 attending physicians from England and Wales experienced with the Mini-CEX, with 20 watching and scoring 3 good trainee performances and 21 watching and scoring 3 poor performances. All then watched and scored the same 3 borderline video performances. The study was completed between July and November 2011.
The researchers found that attending physicians exposed to videos of good medical trainee performances rated subsequent borderline performances lower than those who had been exposed to poor performances, consistent with a contrast bias. The implication is that a rater of a trainee's performance may be unconsciously influenced by the previous trainee, rather than objectively assessing the individual in isolation.
"With the movement toward competency-based models of education, assessment has largely shifted to a system that relies on judgments of performance compared with a fixed standard at which competence is achieved (criterion referencing). Although this makes conceptual sense (with its inherent ability to reassure both the profession and the public that an acceptable standard has been reached), the findings in this study, which are consistent with contrast bias, suggest that raters may not be capable of reliably judging in this way."
More information: JAMA. 2012;308:2226-2232.
Journal reference: Journal of the American Medical Association
Provided by JAMA and Archives Journals
- Trainee presence during endobronchial ultrasound increases complications Oct 22, 2012 | not rated yet | 0
- Who says girls can't compete athletically with boys? May 31, 2012 | not rated yet | 0
- Significant gap between best and worst Maths Trainee Teachers in England Mar 31, 2011 | not rated yet | 0
- New colonoscopy skills assessment tool developed for trainees Dec 15, 2010 | not rated yet | 0
- NIDA raises the curtain on addiction Apr 18, 2011 | not rated yet | 0
- Motion perception revisited: High Phi effect challenges established motion perception assumptions Apr 23, 2013 | 3 / 5 (2) | 2
- Anything you can do I can do better: Neuromolecular foundations of the superiority illusion (Update) Apr 02, 2013 | 4.5 / 5 (11) | 5
- The visual system as economist: Neural resource allocation in visual adaptation Mar 30, 2013 | 5 / 5 (2) | 9
- Separate lives: Neuronal and organismal lifespans decoupled Mar 27, 2013 | 4.9 / 5 (8) | 0
- Sizing things up: The evolutionary neurobiology of scale invariance Feb 28, 2013 | 4.8 / 5 (10) | 14
Classical and Quantum Mechanics via Lie algebras
Apr 15, 2011 I'd like to open a discussion thread for version 2 of the draft of my book ''Classical and Quantum Mechanics via Lie algebras'', available online at http://lanl.arxiv.org/abs/0810.1019 , and for the...
- More from Physics Forums - Independent Research
More news stories
High blood glucose is associated with poor outcomes in hospitalized patients, and use of intensive insulin therapy (IIT) to control hyperglycemia is a common practice in hospitals. But the recent evidence does not show a ...
Other 19 hours ago | not rated yet | 0
Two out of five medical students have an unconscious bias against obese people, according to a new study by researchers at Wake Forest Baptist Medical Center. The study is published online ahead of print in the Journal of ...
Other May 23, 2013 | not rated yet | 0
Nanyang Technological University's (NTU) new medical school will be pioneering the use of plastinated bodies for medical education in Singapore.
Other May 23, 2013 | not rated yet | 0
A 2012 survey of internal medicine residents at Massachusetts General Hospital (MGH) – one of the nation's leading teaching hospitals – found that more than half rated the training they had received in addiction and other ...
Other May 22, 2013 | 5 / 5 (1) | 0
Early use of tracheostomy for mechanically ventilated patients not associated with improved survival
For critically ill patients receiving mechanical ventilation, early tracheostomy (within the first 4 days after admission) was not associated with an improvement in the risk of death within 30 days compared to patients who ...
Other May 21, 2013 | not rated yet | 0
Two mutations central to the development of infantile myofibromatosis (IM)—a disorder characterized by multiple tumors involving the skin, bone, and soft tissue—may provide new therapeutic targets, according to researchers ...
5 hours ago | 5 / 5 (1) | 0 |
(Medical Xpress)—A new study by researchers in the US has shown that an ancient virus can be modified to help in the fight against the simian immunodeficiency virus SIV, which is the equivalent in monkeys ...
10 hours ago | 5 / 5 (3) | 0 |
Women at a particular stage in their monthly menstrual cycle may be more vulnerable to some of the psychological side-effects associated with stressful experiences, according to a study from UCL.
7 hours ago | 5 / 5 (1) | 0 |
Talking on a hands-free device while behind the wheel can lead to a sharp increase in errors that could imperil other drivers on the road, according to new research from the University of Alberta.
4 hours ago | not rated yet | 0
Biological processes are generally based on events at the molecular and cellular level. To understand what happens in the course of infections, diseases or normal bodily functions, scientists would need to ...
8 hours ago | 5 / 5 (2) | 0 |
Kate O'Reilly's spring allergy survival kit includes the usual stuff - nasal sprays, allergy pills and a box of tissues. This season, she's added a new weapon to her line of defense: an app on her smartphone.
5 hours ago | not rated yet | 0