Yelp reviewers take a dimmer view of nursing homes than the feds

December 4, 2017, University of Southern California
Credit: Anne Lowe/public domain

The stars are not aligned when it comes to online reviews of nursing homes.

A new study by the USC Leonard Davis School of Gerontology shows that Yelp reviewers give nursing homes significantly less favorable ratings than those found on the federal website, Nursing Home Compare, run by the Centers for Medicare and Medicaid Services.

"Consumers view the quality of nursing homes as poorer than the CMS is reporting it to be," said Anna Rahman, a co-author of the report and an assistant research professor of gerontology at the USC Davis School.

Both the Nursing Home Compare website and the popular online business ratings site, Yelp, feature five-star rating systems to help consumers evaluate nursing homes

The study published in the journal BMJ Quality and Safety on Nov. 13 showed that a nursing home's Yelp rating differed from the Nursing Home Compare rating more than 75 percent of the time, and it was significantly lower in three of four categories reviewed.

Rahman said both ratings systems have weaknesses and strengths.

"Many Americans are now familiar with how Yelp works and evaluate Yelp reviews with a critical eye. They know not to believe everything they read on the site," Rahman said.

By contrast, consumers have reported difficulty with understanding Nursing Home Compare ratings, she added. This is problematic because prior research indicates that some nursing homes listed on the federal website are gaming their ratings.

"Regrettably, there is no easy or highly intuitive way to spot fake ratings on NHC," Rahman said.

"However, we cannot say that Yelp is a better resource than Nursing Home Compare," she added. "Our best recommendation is that consumers consult both resources, with the caveat that they must understand how each source generates its ratings."

Different Inputs

Nursing Home Compare rolled out its five-star rating system in 2009 using data from nursing home inspections, staffing reports and resident assessments. The overall rating combines scores from three areas: health inspections, staffing levels and quality measures, like changes in physical, functional, psychosocial and cognitive well-being. Health inspections was the only category that rated significantly higher when compared to the Yelp star ratings.

Founded in 2004, Yelp boasts 145 million first-person word-of-mouth reviews of business and service providers. These reviews generally describe a consumer's personal experience with the provider. Previous research in hospitals shows that Yelp reviewers tend to focus on subjective experiences of health care, such as a reviewer's personal assessment of staff attitudes, the physical setting or the cost of care.

"Choosing a nursing home for oneself or a loved one is a complex, challenging, often emotionally charged task," said the study's co-author, Susan Enguidanos, associate professor of gerontology at the USC Leonard Davis School. "Our study results highlight the need for further research to improve and strengthen the ratings systems used by nursing home consumers."

Gaming Concerns

Both Nursing Home Compare and Yelp have faced charges of artificially manipulated ratings. Previous research estimated that faked reviews and ratings on Yelp range from 16 percent to 40 percent. However, the USC researchers say that since gamed Yelp ratings may encompass either or both extremes of the 5-star rating scale, this bi-directional practice, coupled with increasingly savvy consumers and Yelp's efforts to weed out fake reviews, likely cancels out their ability to impact ratings.

Recent reviews of the Nursing Home Compare system concluded that the rating system provides a financial incentive for gaming, and that the practice of nursing homes reporting purposefully inflated data continues, despite modifications designed to discourage it. These findings may shed light on why the Nursing Home Compare ratings are mostly higher than the Yelp ones, according to the study authors.

"If California nursing homes gamed some of the data they reported to CMS, that could explain why Yelp ratings in our study were significantly lower than the nursing home ratings for quality measures and staffing, which are derived from data self-reported by ," said Rahman.

Future Work

The authors note that Yelp recently partnered with the New York-based news non-profit ProPublica to report government data about nursing fines, serious deficiencies and payment suspensions on its pages. Future studies will aim to analyze the content of Yelp reviews and compare the themes and topics consumers identify to those reported by CMS.

Explore further: Consumers reveal obstacles to using nursing home quality ratings

Related Stories

Consumers reveal obstacles to using nursing home quality ratings

April 4, 2016
A study of dozens of people who placed a relative or friend in a nursing home in the previous six months found that few people were aware of the Nursing Home Compare website, published online by the Centers for Medicare and ...

UCI personalized ratings app may improve patient's choice of nursing home

April 4, 2016
A new app created at the University of California, Irvine can improve a patient's choice of a nursing home. This is important, because when rating quality measures for nursing homes, patients and experts at the Centers for ...

More doctors are becoming 'nursing home specialists'

November 28, 2017
The number of doctors and advance practitioners in the United States who focus on nursing home care rose by more than a third between 2012 and 2015, according to a new study published today in JAMA from researchers at the ...

Florida to require nursing home generators after Irma deaths

September 22, 2017
Florida's top health care regulator, in the aftermath of the nursing home deaths that followed Hurricane Irma, says the state will "aggressively" enforce new rules that require nursing homes and assisted living facilities ...

Recommended for you

Removing sweets from checkouts linked to dramatic fall in unhealthy snack purchases

December 18, 2018
Policies aimed at removing sweets and crisps from checkouts could lead to a dramatic reduction to the amount of unhealthy food purchased to eat 'on the go' and a significant reduction in that purchased to take home, suggests ...

Junk food diet raises depression risk, researchers find

December 18, 2018
A diet of fast food, cakes and processed meat increases your risk of depression, according to researchers at Manchester Metropolitan University.

Children of problem drinkers more likely to marry someone with a drinking problem: study

December 18, 2018
Children of parents who have alcohol use disorder are more likely to get married under the age of 25, less likely to get married later in life, and more likely to marry a person who has alcohol use disorder themselves, according ...

Folate deficiency creates hitherto unknown problems in connection with cell division

December 17, 2018
Folate deficiency creates more problems in connection with DNA replication than researchers had hitherto assumed, researchers from the University of Copenhagen show in a new study. Once a person lacks folate, the damage caused ...

A co-worker's rudeness can affect your sleep—and your partner's, study finds

December 14, 2018
Rudeness. Sarcastic comments. Demeaning language. Interrupting or talking over someone in a meeting. Workplace incivilities such as these are becoming increasingly common, and a new study from Portland State University and ...

Study shows magnesium optimizes vitamin D status

December 14, 2018
A randomized trial by Vanderbilt-Ingram Cancer Center researchers indicates that magnesium optimizes vitamin D status, raising it in people with deficient levels and lowering it in people with high levels.

0 comments

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.