Bias may exist in rating of medical trainees
Peter Yeates, M.B.B.S., M.Clin.Ed., of the University of Manchester, United Kingdom, and colleagues conducted a study to examine whether observations of the performance of postgraduate year 1 physicians influence raters' scores of subsequent performances.
"The usefulness of performance assessments within medical education is limited by high interrater score variability, which neither rater training nor changes in scale format have successfully ameliorated. Several factors may explain raters' score variability, including a tendency of raters to make assessments by comparing against other recently viewed learners, rather than by using an absolute standard of competence. This has the potential to result in biased judgments," according to background information in the article.
The study consisted of an internet-based randomized experiment using videos of Mini Clinical Evaluation Exercise (Mini-CEX) assessments of postgraduate year 1 trainees interviewing new internal medicine patients. Participants were 41 attending physicians from England and Wales experienced with the Mini-CEX, with 20 watching and scoring 3 good trainee performances and 21 watching and scoring 3 poor performances. All then watched and scored the same 3 borderline video performances. The study was completed between July and November 2011.
The researchers found that attending physicians exposed to videos of good medical trainee performances rated subsequent borderline performances lower than those who had been exposed to poor performances, consistent with a contrast bias. The implication is that a rater of a trainee's performance may be unconsciously influenced by the previous trainee, rather than objectively assessing the individual in isolation.
"With the movement toward competency-based models of education, assessment has largely shifted to a system that relies on judgments of performance compared with a fixed standard at which competence is achieved (criterion referencing). Although this makes conceptual sense (with its inherent ability to reassure both the profession and the public that an acceptable standard has been reached), the findings in this study, which are consistent with contrast bias, suggest that raters may not be capable of reliably judging in this way."
More information: JAMA. 2012;308:2226-2232.
Journal reference: Journal of the American Medical Association
Provided by JAMA and Archives Journals
- Trainee presence during endobronchial ultrasound increases complications Oct 22, 2012 | not rated yet | 0
- Who says girls can't compete athletically with boys? May 31, 2012 | not rated yet | 0
- Significant gap between best and worst Maths Trainee Teachers in England Mar 31, 2011 | not rated yet | 0
- New colonoscopy skills assessment tool developed for trainees Dec 15, 2010 | not rated yet | 0
- NIDA raises the curtain on addiction Apr 18, 2011 | not rated yet | 0
- Motion perception revisited: High Phi effect challenges established motion perception assumptions Apr 23, 2013 | 3 / 5 (2) | 2
- Anything you can do I can do better: Neuromolecular foundations of the superiority illusion (Update) Apr 02, 2013 | 4.5 / 5 (11) | 5
- The visual system as economist: Neural resource allocation in visual adaptation Mar 30, 2013 | 5 / 5 (2) | 9
- Separate lives: Neuronal and organismal lifespans decoupled Mar 27, 2013 | 4.9 / 5 (8) | 0
- Sizing things up: The evolutionary neurobiology of scale invariance Feb 28, 2013 | 4.8 / 5 (10) | 14
Classical and Quantum Mechanics via Lie algebras
Apr 15, 2011 I'd like to open a discussion thread for version 2 of the draft of my book ''Classical and Quantum Mechanics via Lie algebras'', available online at http://lanl.arxiv.org/abs/0810.1019 , and for the...
- More from Physics Forums - Independent Research
More news stories
(AP)—A woman who lost both hands, her left leg and right foot after contracting a flesh-eating disease has been fitted with prosthetic hands.
Other 11 hours ago | not rated yet | 0
(AP)—Medical marijuana use in Illinois is now in Gov. Pat Quinn's hands after the state Senate approved legislation.
Other 22 hours ago | 5 / 5 (1) | 0
A Nigerian court on Friday sentenced two officials from a pharmaceutical company to seven years in prison over the sale of an adulterated teething drug which killed 84 babies in 2008.
Other 22 hours ago | not rated yet | 0
(HealthDay)—Many Americans feel that keeping out-of-pocket health care costs is more important than staying with the same primary care physician.
Other May 17, 2013 | not rated yet | 0
(AP)—China is phasing out its reliance on executed prisoners for donated organs, but an architect of the country's transplant system said Friday that ingrained cultural attitudes are impeding the rise of ...
Other May 17, 2013 | not rated yet | 0
A new case of the deadly coronavirus has been detected in Saudi Arabia where 15 people have already died after contracting it, the health ministry announced on Saturday on its Internet website.
19 minutes ago | not rated yet | 0
An increasing number of U.S. children are experiencing gastrointestinal issues that require interventions to resolve, according to research presented at Digestive Disease Week (DDW).
2 hours ago | not rated yet | 0 |
A ground-breaking advance in colonoscopy technology signals the future of colorectal care, according to research presented today at Digestive Disease Week(DDW). Additional research focuses on optimizing the minimal withdrawal ...
2 hours ago | 5 / 5 (1) | 0
Big names in medicine are set to give an upbeat assessment of the war on AIDS on Tuesday, 30 years after French researchers identified the virus that causes the disease.
10 hours ago | 5 / 5 (1) | 0
For combat veterans suffering from post-traumatic stress disorder, 'fear circuitry' in the brain never rests
Chronic trauma can inflict lasting damage to brain regions associated with fear and anxiety. Previous imaging studies of people with post-traumatic stress disorder, or PTSD, have shown that these brain regions can over-or ...
11 hours ago | 5 / 5 (1) | 0 |
(Medical Xpress)—What if the quality of your work depends more on your focus on the piano keys or canvas or laptop than your musical or painting or computing skills? If target users can be convinced, they ...
23 hours ago | 3.7 / 5 (3) | 0 |