Statisticians review landmark HIV vaccine trial

May 9, 2011

Hopes ran high in 2009 when a New England Journal of Medicine article announced success in developing a vaccine against HIV, the virus that causes AIDS.

But a new Bayesian statistical analysis initiated at Duke demonstrates that the results were far from conclusive.

“The world has been waiting for an HIV for almost 30 years,” said Victor DeGruttola, a biostatistician at the Harvard School of Public Health who participated in the new analysis. "Its efficacy is an emotionally charged issue.” The HIV vaccine study, called RV 144, had been viewed as the “first evidence that suggested we were close."

New analysis of the RV144 data shows it is more likely that the vaccine actually has no effect compared to what was presented in the initial analysis. The new analysis also highlights the need to regularly use multiple statistical methods to review new medicines, said James Berger, a statistician at Duke University who spearheaded the study along with Peter Gilbert of the University of Washington and DeGruttola.

The results appear in the April 1 issue of the Journal of Infectious Diseases. The new analysis uses Bayesian statistics, which includes information from the original data and also data from previous HIV vaccine research.

The original RV144 study reported new HIV infections in 51 of the 8,197 volunteers given the vaccine versus 74 of the 8,198 participants given the placebo. These results suggested that the vaccine, a combination of two other failed vaccines, was 31.2 percent effective, with a p-value of .04. Many researchers and journalists interpreted the statistics to mean that there was only a four percent chance that the vaccine was not effective, and alternatively a 96 percent chance that it was 31-percent effective.

“But it’s not that simple,” DeGruttola said. He was dismayed with the interpretation and criticized it in the journal Science. He said the correct way to think about the numbers is to assume the vaccine does nothing. “Assume it is water. Repeating the experiment 50 times, researchers would expect that one out of 50 times they'd find equal-to or greater-than 31.2 percent vaccine efficacy,” he said, adding that these standard statistics ultimately say nothing direct about whether the vaccine works.

Berger said Bayesian analysis improves upon the standard statistical methods because it can make statements about the chance that the vaccine had some efficacy. The P-values, which were used in the original analysis, cannot. In the new analysis, the researchers explain that the p-value of 0.04 was misinterpreted and say that, using Bayesian statistics, there is no more than a 71 percent chance that the vaccine was effective at preventing HIV.

In other words, there is a 29 percent chance that the vaccine was not effective, not a 4 percent chance, he said.

Because of what is at stake in HIV vaccine research, the conversation related to RV144 has not always been as scientific as it could have been, Gilbert said. He has reviewed and devised vaccine trials since 1996 and said the new analysis provides statisticians and non-statisticians with a “golden opportunity” to have rational, scientific, and careful discussions when determining “false positive flukes” versus real effects.

“The new evidence doesn’t give us any reason for great joy, or greater gloom,” said De Gruttola, but the researchers agree that the Bayesian analysis provides a new framework to add increased rigor into future vaccine trials.

Explore further: Adaptive trial designs could accelerate HIV vaccine development

More information: "Statistical Interpretation of the RV144 HIV Vaccine Efficacy Trial in Thailand: A Case Study for Statistical Issues in Efficacy Trials," Peter B. Gilbert, et al. Journal of Infectious Disease, Vol. 203, Issue 7. doi:10.1093/infdis/jiq152

Related Stories

Adaptive trial designs could accelerate HIV vaccine development

April 20, 2011
In the past 12 years, four large-scale efficacy trials of HIV vaccines have been conducted in various populations. Results from the most recent trial—the RV144 trial in Thailand, which found a 31 percent reduction ...

Insight into HIV immunity may lead to vaccine

May 6, 2011
(Medical Xpress) -- Latest insights into immunity to HIV could help to develop a vaccine to build antibodies’ defences against the disease, a University of Melbourne study has found.

Recommended for you

New injectable antiretroviral treatment proved to be as effective as standard oral therapy

August 3, 2017
Intramuscularly administered antiretroviral therapy (ART) may be as effective for HIV treatment as current oral therapies. This is the main conclusion of a Phase II clinical trial carried out by 50 research centers around ...

Research finds home-based kit would increase HIV testing

July 31, 2017
Research led by William Robinson, PhD, Associate Research Professor of Behavioral & Community Health Sciences at LSU Health New Orleans School of Public Health, has found that 86% of heterosexuals who are at high risk for ...

Scientists divulge latest in HIV prevention

July 25, 2017
A far cry from the 1990s "ABC" campaign promoting abstinence and monogamy as HIV protection, scientists reported on new approaches Tuesday allowing people to have all the safe sex they want.

Girl's HIV infection seems under control without AIDS drugs

July 24, 2017
A South African girl born with the AIDS virus has kept her infection suppressed for more than eight years after stopping anti-HIV medicines—more evidence that early treatment can occasionally cause a long remission that, ...

Meds by monthly injection might revolutionize HIV care (Update)

July 24, 2017
Getting a shot of medication to control HIV every month or two instead of having to take pills every day could transform the way the virus is kept at bay.

Candidate AIDS vaccine passes early test

July 24, 2017
The three-decade-old quest for an AIDS vaccine received a shot of hope Monday when developers announced that a prototype triggered the immune system in an early phase of human trials.


Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.