Improve peer review by making the reviewers better suited to the task

July 30, 2014

A 'kitemark' that identifies randomized-controlled trials reviewed by specially trained peer reviewers would improve public trust in the robustness of clinical trials, according to an opinion piece in the open access journal BMC Medicine. Jigisha Patel, BioMed Central's Medical Editor argues that peer review should be recognized as a professional skill in the clinical medical field. The article was openly peer reviewed and the reports published alongside, as is the case for all BMC Medicine articles.

Peer review and its effectiveness is the subject of much heated debate within medical and scientific communities at the moment. This is coupled with the ongoing public discussion about the need for greater openness and the transparency in how are conducted.

Jigisha Patel's opinion piece discusses her experiences as a junior doctor, and how she took for granted that when research was published in a medical journal that editors selected the best qualified people to review clinical trials. However, there is often disagreement over what peer review is, and there is variation in instructions for peer reviewers from journal to journal and on who is eligible to be a peer reviewer.

Jigisha Patel says: "While innovations in trial reporting and the peer review process have increased transparency, there has been little progress in defining the aims and effects or improving the quality of peer review itself. There is vast volume of health information available to the lay person with little or no guidance on its quality or trustworthiness."

This opinion piece underwent open peer review - as is the case with all BMC series clinical journals – which means the authors and reviewers identities are known to each other. In addition, the reports will be published alongside the article, which provides more transparency for the reader.

One of the peer reviewers, Doug Altman, Director of Centre for Statistics in Medicine at Oxford University, said in his report: "The issues raised [in this article] are of major importance to the integrity and value of the medical research literature. The problems identified are well known of course, and in my view not amenable to easy resolution….The main problem though is that nobody has the power to change the system and it is the system that is the problem….But we should try to make progress and this paper offers one way forward."

Jigisha Patel proposes a possible solution: "Peer review of randomized controlled trials should be recognized as a professional skill. Peer reviewers could be taught to spot fundamental flaws and be periodically evaluated to make sure they do, in the same way that any other knowledge or skill that affects patient care is. Every randomized controlled trial, and its peer review reports if made public, whether published online, on paper, open access or subscription only, with open or closed peer review, or peer reviewed before or after publication could then have a searchable 'quality assurance' symbol"

Explore further: Study examines development of peer review research in biomedicine

More information: BMC Medicine 2014, 12:128

Related Stories

Study examines development of peer review research in biomedicine

March 11, 2014
An analysis of research on peer review finds that studies aimed at improving methods of peer review and reporting of biomedical research are underrepresented and lack dedicated funding, according to a study in the March 12 ...

Online game aims to improve scientific peer review accuracy

November 9, 2011
Peer review of scientific research is an essential component of research publication, the awarding of grants, and academic promotion. Reviewers are often anonymous. However, a new study by researchers at the Johns Hopkins ...

Research paper publishing sting reveals lax standards of many open-access journals

October 4, 2013
( —John Bohannon, contributing news correspondent for Science, the highly respected peer-reviewed journal has conducted what he calls a "sting operation" that reveals problems with open-access publishing journals. ...

Recommended for you

Exploring the potential of human echolocation

June 25, 2017
People who are visually impaired will often use a cane to feel out their surroundings. With training and practice, people can learn to use the pitch, loudness and timbre of echoes from the cane or other sounds to navigate ...

Team eradicates hepatitis C in 10 patients following lifesaving transplants from infected donors

April 30, 2017
Ten patients at Penn Medicine have been cured of the Hepatitis C virus (HCV) following lifesaving kidney transplants from deceased donors who were infected with the disease. The findings point to new strategies for increasing ...

'bench to bedside to bench': Scientists call for closer basic-clinical collaborations

March 24, 2017
In the era of genome sequencing, it's time to update the old "bench-to-bedside" shorthand for how basic research discoveries inform clinical practice, researchers from The Jackson Laboratory (JAX), National Human Genome Research ...

The ethics of tracking athletes' biometric data

January 18, 2017
(Medical Xpress)—Whether it is a FitBit or a heart rate monitor, biometric technologies have become household devices. Professional sports leagues use some of the most technologically advanced biodata tracking systems to ...

Financial ties between researchers and drug industry linked to positive trial results

January 18, 2017
Financial ties between researchers and companies that make the drugs they are studying are independently associated with positive trial results, suggesting bias in the evidence base, concludes a study published by The BMJ ...

Best of Last Year – The top Medical Xpress articles of 2016

December 23, 2016
(Medical Xpress)—It was a big year for research involving overall health issues, starting with a team led by researchers at the UNC School of Medicine and the National Institutes of Health who unearthed more evidence that ...


Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.