How do studies get selected for publication?
The factors predicting the eventual impact of scientific research (i.e. high citation rates) were successfully identified in abstracts selected for presentation at the annual ESC Congress. Interestingly, predictors of publication in peer reviewed scientific journals differed markedly from those predicting later scientific impact, finds a recent study published online today in the European Heart Journal (EHJ).
The main factors predicting acceptance at the ESC Congress in line with identified predictors of scientific impact were the number of enrolled patients (>100) and prospective study design. In contrast, the factors predicting full-text publication in peer reviewed scientific journals were the institutional affiliation of the authors (i.e. university-affiliated institutions fared better than non university-affiliated institutions) and the gender of senior authors (males did better than females), finds the scientometric follow-up in the EHJ study.
The study, which provides a unique glimpse behind the "curtains" of the selection process of contemporary cardiovascular science at both congress and journal level, may indicate a hitherto unrecognised bias against non-academic institutions and female senior authors in journal study selection. "Neither gender nor institutional affiliation delineate scientific quality, which may cause some concern but requires further investigation," says the study first author Dr Stephan Winnik, a cardiologist in training at the University Hospital of Zurich, Switzerland.
The differences, he adds, may be due to the fact that abstracts submitted to the ESC Congress are subject to a double-blinded peer review process (where neither authors know reviewers nor vice versa); while the majority of scientific and medical journals (around 80%) use single-blinded peer review, where the reviewers know the identity of the authors, but the authors do not know the identity of reviewers. "Peer review has been and will be the sacred pillar of science, nonetheless our study suggests that introducing a double-blinded approach to journal review merits serious consideration," says Winnik.
The authors set out to identify factors that predicted the future success of studies as both abstracts and full-text articles, using the number of citations in the two years following publication as a surrogate for scientific quality. "The unique opportunity of this approach was the possibility to follow the same cohort of both accepted and rejected abstracts from first submission at a scientific meeting, through their full-text publication and subsequent impact after publication" says Winnik.
First, all 10,020 abstracts submitted to the 2006 World Congress of Cardiology in Barcelona (which combined the ESC and World Heart Federation congresses) were fed into a database; subsequently they were analysed according to whether they were accepted or rejected for presentation, and whether accepted studies were oral or poster presentations.
Next, a representative random selection of 10% of all submitted abstracts (n=1002) was analyzed according to a pre-specified set of variables, with the study cohort followed for five years for full-text publication and subsequent citation. Multivariate regression analyses were performed to identify predictors of scientific success at three major stages of the publication process acceptance at the ESC Congress, subsequent full-text publication and the number of citations. The pre-specified variables included whether a study was clinical or basic, the type of institution where it took place, the study design, the number of patients enrolled, the field of clinical research and the gender of the first and last authors.
The following findings of the study are of note:
- The journal publication rate of accepted congress abstracts was 38%, whereas only 24% of rejected congress abstracts were subsequently published.
- Factors predicting success at congress level were basic research (OR 2.2, 95% C.I. 1.4-3.6); patient number >100 (OR 2.1, 95% C.I. 1.5-2.8); prospective (non-randomised) study design (OR 1.70, 95% C.I. 1.2-2.3); and randomised controlled study design (OR 1.9, 95% C.I. 1.1-3.3).
- Factors that predicted full text publication in a peer reviewed journal were basic research (OR 2.1, 95% C.I. 1.3-3.3); institutional affiliation to a university (OR 1.6, 95% C.I. 1.1-2.4); and gender of senior author, with female senior authorship being negatively associated with publication (OR 0.50, 95% C.I. 0.3-0.9).
- Factors that predicted frequency of citation were randomised controlled study design (OR 6.8, 95% C.I. 2.5-21.1); and prospective (non-randomised) study design (OR 2.6, 95% C.I. 1.2-5.7).
In an accompanying commentary Joseph Ross and Brahmajee Nallamothu, from Yale University School of Medicine, write, "The ESC did appear to choose wisely. Higher average peer reviewer ratings, and thus initial acceptance by the ESC, were associated with higher rates of publication and citation."
Nonetheless Ross and Nallamothu conclude that the fact that 70% of abstracts submitted to the 2006 World Congress of Cardiology remain unpublished five years later is "an unacceptable standard for scientific discourse".
Commenting on the study Professor Thomas F. Lüscher, editor of the EHJ and one of the authors of the article, says, "This study reassures us that the peer-review process of the ESC Congress works well, and provides an important quality control."
But the results at the full-text publication level are cause for concern, he adds, highlighting the finding that the type of institution where a study was performed predicted whether or not the study was published. "Whether this indicates that academic institutions are more successful in publishing their work due to experience and expertise or whether this reflects a bias against non-university institutions requires further study," says Lüscher, from the University Hospital of Zurich.
The possibility of blinding journal reviewers to both author identity and affiliation, he adds, warrants future consideration. At present, the EHJ follows the single-blinded approach. "We have discussed the possibility of changing to a double-blinded review process, but are aware that this would involve additional work and man-power, which is currently not available within our editorial office," he said.
Moreover, Lüscher adds, in the case of technically challenging projects, valuable insight can be gained from knowing the capabilities of the institutions involved.
The female gender of authors, says Lüscher, has the possibility to affect publication success in several ways. "Female scientists are more likely to work part-time and/or have other family obligations than their male counterparts, making finishing and publishing studies more difficult."
But there might also be a bias against females. "I have never experienced any such bias working with many journals, and additionally depending on the culture and name of authors gender is often not readily obvious."
More information: S Winnik, D Raptis, J Walker, et al. From Abstract to Impact in Cardiovascular Research- Factors Predicting Publication and Citation. EHJ. doi:10.1093/eurheartj/ehs113
J Ross and B Nallamothu. Through the Looking Glass: Evaluating the Dissemination of Research in Cardiology. doi:10.1093/eurheartj/ehs160
Journal reference: European Heart Journal
Provided by European Society of Cardiology
- A re-review of peer review: Leading journal looks to end the 'review nightmare' Jan 27, 2009 | not rated yet | 0
- Plagiarism sleuths tackle full-text biomedical articles Oct 25, 2010 | not rated yet | 0
- European and Brazilian cardiologists cooperate to reduce cardiovascular deaths Sep 12, 2011 | not rated yet | 0
- Online game aims to improve scientific peer review accuracy Nov 09, 2011 | not rated yet | 0
- APS issues new policy requiring identification of sex or gender in reporting scientific research Mar 02, 2012 | not rated yet | 0
- Motion perception revisited: High Phi effect challenges established motion perception assumptions Apr 23, 2013 | 3 / 5 (2) | 2
- Anything you can do I can do better: Neuromolecular foundations of the superiority illusion (Update) Apr 02, 2013 | 4.5 / 5 (11) | 5
- The visual system as economist: Neural resource allocation in visual adaptation Mar 30, 2013 | 5 / 5 (2) | 9
- Separate lives: Neuronal and organismal lifespans decoupled Mar 27, 2013 | 4.9 / 5 (8) | 0
- Sizing things up: The evolutionary neurobiology of scale invariance Feb 28, 2013 | 4.8 / 5 (10) | 14
siphon and bernouli theorum
1 hour ago 1. I found this diagram on book but there weren't any description.can someone tell me, what its trying to tell specially by those two red lines...
Hot gas expansion rate into outer space
1 hour ago Good Morning Sirs, it seems to be surprisingly hard to get the numbers of a mystery: How fast expand hot rocket exhaust gases into empty space? ...
Magnetic field lines through copper
7 hours ago Hello. Assume an electron gun, as in CRT, made of plumbing copper instead of glass. Using magnetic scanning coils to move electron beam. Will the...
Lagrangian of object with air resistance
9 hours ago So I was going through an ODEs textbook and in a section discussing physical problems, decided that it would be interesting to come up with the...
Does electromagnetic waves are generated by dc current?
9 hours ago I am beginner in physics.I have question that when dc current flow they flow with apparent drift velocity so it appears that it should not emit em...
Please check what's in the Ulaby book regarding reflection.
14 hours ago Attached is a scanned of the page in question. This is regarding to Perpendicularly polarized plane wave. in equation (9.47a) at the lower left...
- More from Physics Forums - Classical Physics
More news stories
Heart failure accelerates the aging process and brings on early andropausal syndrome (AS), according to research presented today at the Heart Failure Congress 2013. AS, also referred to as male 'menopause', was four times ...
Cardiology 5 hours ago | not rated yet | 1
Mortality and length of stay are highest in heart failure patients admitted in January, on Friday, and overnight, according to research presented today at the Heart Failure Congress 2013. The analysis of nearly 1 million ...
Cardiology 5 hours ago | not rated yet | 0
Coenzyme Q10 decreases all cause mortality by half, according to the results of a multicentre randomised double blind trial presented today at Heart Failure 2013 congress. It is the first drug to improve heart failure mortality ...
Cardiology 5 hours ago | 5 / 5 (1) | 4
Transcatheter aortic valve implantation (TAVI) is effective and safe in Asian patients, according to early experience based on first results from a multicentre Asian registry reported at EuroPCR 2013.
Cardiology May 24, 2013 | not rated yet | 0
Routinely measuring fractional flow reserve (FFR) using pressure wire assessment during coronary angiography for diagnosis of chest pain leads to significant changes in the management of one in four patients, according to ...
Cardiology May 24, 2013 | not rated yet | 0
Women at a particular stage in their monthly menstrual cycle may be more vulnerable to some of the psychological side-effects associated with stressful experiences, according to a study from UCL.
May 24, 2013 | 3.7 / 5 (3) | 4 |
Two mutations central to the development of infantile myofibromatosis (IM)—a disorder characterized by multiple tumors involving the skin, bone, and soft tissue—may provide new therapeutic targets, according to researchers ...
21 hours ago | 3 / 5 (2) | 0 |
(AP)—Department of Justice lawyers have again asked a federal appeals court in New York to delay lifting age restrictions and prescription requirements on an emergency contraceptive popularly known as the morning-after ...
5 hours ago | not rated yet | 0
Talking on a hands-free device while behind the wheel can lead to a sharp increase in errors that could imperil other drivers on the road, according to new research from the University of Alberta.
20 hours ago | not rated yet | 0
(HealthDay)—Comorbid conditions often accompany alopecia areata, according to a study published online May 22 in JAMA Dermatology.
22 hours ago | not rated yet | 0
Kate O'Reilly's spring allergy survival kit includes the usual stuff - nasal sprays, allergy pills and a box of tissues. This season, she's added a new weapon to her line of defense: an app on her smartphone.
22 hours ago | not rated yet | 0