Science needs a second opinion: Researchers find flaws in study of patients in 'vegetative state'
A team of researchers led by Weill Cornell Medical College is calling into question the published statistics, methods and findings of a highly publicized research study that claimed bedside electroencephalography (EEG) identified evidence of awareness in three patients diagnosed to be in a vegetative state.
The new reanalysis study led by Weill Cornell neurologists Drs. Andrew Goldfine, Jonathan Victor, and Nicholas Schiff, published in the Jan. 26 issue of the journal Lancet, reports the statistical results and methodology used by a research team led by University of Western Ontario scientists and published online Nov. 9, 2011, also in the Lancet, was flawed in a number of crucial ways. Due to these errors, the reanalysis concludes it is impossible to determine whether or not these vegetative state study subjects demonstrated any degree of awareness during the testing.
The University of Western Ontario researchers in the original study set out to use bedside EEG technology to identify any changes in brain activity in vegetative patients and also healthy subjects as controls. During the study, each subject was asked to either imagine moving their hand or foot each time they heard an electronic beep. The brain activity following hand or foot commands was recorded using EEG and then compared in the study. The published study claimed that three of the 16 tested vegetative patients successfully performed the task, along with 9 of the 12 healthy controls. The reanalysis of this study is important, the Weill Cornell researchers say, because if the method was indeed valid, it would mark an important breakthrough in the field—the first evidence using a bedside testing method that patients reported to be in a vegetative state could perform high-level cognitive tasks.
"Sadly, our reanalysis of the research team's original data shows these particular methods do not work, and it is important that scientists, physicians, and most importantly, the families of severely brain injured patients understand that the conclusions reached in the original study were most likely due to chance findings," says the corresponding author of the reanalysis, Dr. Schiff, the Jerold B. Katz Professor of Neurology and Neuroscience, professor of neuroscience in the Feil Family Brain and Mind Research Institute and professor of public health at Weill Cornell.
"We see the urgency and need every single day for tests that can be used to help establish awareness and consciousness in brain injured patients. However we won't help patients or their families by using a flawed research method and data that cannot accurately provide the information we are all hoping to find," says Dr. Schiff, who is also a neurologist at NewYork-Presbyterian Hospital/Weill Cornell Medical Center.
"The reanalysis points to the importance of the peer review process, data sharing and analytic tools to confirm research findings, especially those which are biologically complex and where misinterpretation could have major implications on clinical practice," says study co-author Dr. Joseph J. Fins, the E. William Davis Jr., MD Professor of Medical Ethics and chief of the Division of Medical Ethics at Weill Cornell, and director of medical ethics at NewYork-Presbyterian/Weill Cornell. "EEG techniques are an inexpensive and portable method of assessment, and a premature endorsement and dissemination of this technique could provide families with false hope about whether patients thought to be vegetative are in fact conscious," says Dr. Fins.
"Methods Have Consequences"
This reanalysis study by Weill Cornell and its colleagues from Burke Medical Research Institute and the University of Liège was made possible by a data-sharing agreement between their research group and the authors of the original study, Dr. Damian Cruse, Dr. Adrian Owen and colleagues from the University of Western Ontario. The Weill Cornell, University of Liege and the University of Western Ontario investigators are jointly supported by a multicenter research grant from the James S. McDonnell Foundation.
"We set out to validate the original Lancet study findings about EEG, not disprove them, because it is critically important that tests purporting to assert the presence of consciousness be carefully vetted by peer-review," says senior author Dr. Victor, the Fred Plum Professor of Neurology and professor of neuroscience in the Feil Family Brain and Mind Research Institute at Weill Cornell and a neurologist at NewYork-Presbyterian/Weill Cornell.
The reanalysis study doesn't criticize the use of bedside EEG technology for detection of consciousness, but questions the appropriateness of the statistical methodology applied to the data, Dr. Victor explained. The Weill Cornell research team's main finding was that the original study failed to take into account several aspects of EEG signals present in the vegetative patients who were said to show awareness—including the contamination of the EEG signals with muscle activity and the random characteristics of the EEG over extended periods of time, he says. Also, basic task-related EEG signals observed in the healthy subjects were not identifiable in any of the vegetative patients.
"The false-positive EEG brain activity responses in vegetative patients may have been reported because of flawed statistical methods, a problem that was exacerbated because a large number of statistical features were extracted from a small amount of data," says lead author Dr. Goldfine, assistant professor of neurology at the Burke Medical Research Institute, a neurologist at New York Presbyterian /Weill Cornell and Burke Rehabilitation Hospital. "Our reanalysis showed that because of the statistical assumptions and methodology used in the original study, random phenomena could be misinterpreted as a 'response'."
In addition to identifying flaws in the statistical approach used in the original study, the Weill Cornell research team also reanalyzed the original data with methodologies that take into account the presence of contamination of EEG data by muscle activity artifact, and the kind of randomness that EEG signals manifest over time. "But critically, the data from the vegetative subjects showed no changes indicative of consciousness or command following. Our analysis only revealed random fluctuations of brain activity," says Dr. Goldfine, who is also an assistant professor of neuroscience in the Feil Family Brain and Mind Research Institute at Weill Cornell.
"This reanalysis study shows methods have consequences," says Dr. Fins. "This is really difficult science, and we must do everything in our power to work together, to share our data and methods and peer review it, so that we can reach our goal of properly defining consciousness in severely brain injured patients."
Journal reference: The Lancet
Provided by Weill Cornell Medical College
- EEG can detect awareness in people previously thought to be in permanently vegetative state Nov 09, 2011 | not rated yet | 0
- Challenges of identifying cognitive abilities in severely brain-injured patients Feb 13, 2012 | not rated yet | 0
- WU researchers breakthrough with minimally conscious state patients Mar 01, 2012 | not rated yet | 0
- A combined method for detecting consciousness Jan 09, 2012 | not rated yet | 0
- Brain imaging provides window into consciousness Feb 25, 2011 | not rated yet | 0
- Motion perception revisited: High Phi effect challenges established motion perception assumptions Apr 23, 2013 | 3 / 5 (2) | 2
- Anything you can do I can do better: Neuromolecular foundations of the superiority illusion (Update) Apr 02, 2013 | 4.5 / 5 (11) | 5
- The visual system as economist: Neural resource allocation in visual adaptation Mar 30, 2013 | 5 / 5 (2) | 9
- Separate lives: Neuronal and organismal lifespans decoupled Mar 27, 2013 | 4.9 / 5 (8) | 0
- Sizing things up: The evolutionary neurobiology of scale invariance Feb 28, 2013 | 4.8 / 5 (10) | 14
How can there be villous adenoma in colon, if there are no villi there
17 hours ago As title suggest. Thanks :smile:
How can there be a term called "intestinal metaplasia" of stomach
May 21, 2013 Hello everyone, Ok Stomach's normal epithelium is simple columnar, now in intestinal type of adenocarcinoma of stomach it undergoes "intestinal...
Pressure-volume curve: Elastic Recoil Pressure don't make sense
May 18, 2013 From pressure-volume curve of the lung and chest wall (attached photo), I don't understand why would the elastic recoil pressure of the lung is...
If you became brain-dead, would you want them to pull the plug?
May 17, 2013 I'd want the rest of me to stay alive. Sure it's a lousy way to live but it beats being all-the-way dead. Maybe if I make it 20 years they'll...
MRI bill question
May 15, 2013 Dear PFers, The hospital gave us a $12k bill for one MRI (head with contrast). The people I talked to at the hospital tell me that they do not...
Ratio of Hydrogen of Oxygen in Dessicated Animal Protein
May 13, 2013 As an experiment, for the past few months I've been consuming at least one portion of Jell-O or unflavored Knox gelatin per day. I'm 64, in very...
- More from Physics Forums - Medical Sciences
More news stories
(HealthDay)—Migraines and depression can each cause a great deal of suffering, but new research indicates the combination of the two may be linked to something else entirely—a smaller brain.
Neuroscience 8 hours ago | 4 / 5 (2) | 0 |
Moving objects attract greater attention – a fact exploited by video screens in public spaces and animated advertising banners on the Internet. For most animal species, moving objects also play a major ...
Neuroscience 11 hours ago | not rated yet | 0 |
It is known that signs of neurological disorders such as Alzheimer's and Huntington's disease can appear years before the disease becomes manifest; these signs take the form of subtle changes in the brain and behavior of ...
Neuroscience 11 hours ago | not rated yet | 0
Scientists have reversed behavioral and brain abnormalities in adult mice that resemble some features of schizophrenia by restoring normal expression to a suspect gene that is over-expressed in humans with ...
Neuroscience 12 hours ago | 5 / 5 (1) | 0 |
Researchers at Johns Hopkins have unraveled the molecular foundations of cocaine's effects on the brain, and identified a compound that blocks cravings for the drug in cocaine-addicted mice. The compound, already proven safe ...
Neuroscience 12 hours ago | not rated yet | 0 |
Existing research shows that bicyclists who wear helmets have an 88 percent lower risk of brain injury, but researchers at Boston Children's Hospital found that simply having bicycle helmet laws in place showed a 20 percent ...
56 minutes ago | not rated yet | 0
Swiss scientists reveal the mechanism responsible for aging hidden deep within mitochondria—and dramatically slow it down in worms by administering antibiotics to the young.
11 hours ago | 4.9 / 5 (7) | 0 |
Researchers from Queen Mary, University of London have led the largest sequencing study of human disease to date, investigating the genetic basis of six autoimmune diseases.
11 hours ago | 4 / 5 (1) | 0 |
Until now, little was scientifically known about the human potential to cultivate compassion—the emotional state of caring for people who are suffering in a way that motivates altruistic behavior.
8 hours ago | 5 / 5 (2) | 2 |
A new approach for immunizing against influenza elicited a more potent immune response and broader protection than the currently licensed seasonal influenza vaccines when tested in mice and ferrets. The vaccine ...
9 hours ago | not rated yet | 0 |
Calorie information in fast food restaurants used by 40 percent of 9-18 year olds when making food choices
A new study published online today (Thursday) in the Journal of Public Health has found that of young people who visited fast food or chain restaurants in the U.S. in 2010, girls and youth who were obese were more likely ...
5 hours ago | not rated yet | 0