New paper stresses the importance of ecological thinking and diverse study samples to improve psychological science

November 5, 2018 by Andrea Estrada, University of California - Santa Barbara
Research Michael Gurven and colleagues have conducted with the Tsimane highlights the importance of diverse study samples and socioecological theory. Credit: Adrian Jaeggi

For decades, consensus among psychologists has held that a cluster of five personality traits—or a slight variation thereof—universally defines the structure of human personality. Previous research conducted in high-income countries and across many cultures found strong support for what experts refer to as the "Big Five"—openness, conscientiousness, agreeableness, extraversion and neuroticism. However, when UC Santa Barbara anthropologist Michael Gurven and his team studied the Tsimane, an isolated indigenous population in the Bolivian Amazon, they found not five broad dimensions of personality, but two—prosociality and industriousness. Perhaps the Big Five aren't so universal after all.

Much of Gurven and colleagues' long-term research in Bolivia—spanning nearly two decades—offers other surprising and revealing examples that question what is universal and why. Perhaps what's true for one culture cannot be extrapolated or mapped onto another.

And that's exactly Gurven's point in a new paper published in the Proceedings of the National Academy of Sciences. Sample diversity and socioecological theory, he argues are essential to improving the integrity and explanatory power of the social sciences. Among the social sciences, he adds, psychology especially suffers from a sample diversity problem.

According to Gurven, a professor of anthropology and co-director of the Tsimane Health and Life History Project, even after repeated calls to diversify samples, over 90 percent of participants in studies published in the top developmental psychology journals still hail from North America and Europe, or as has been playfully (but aptly) termed, Western, educated, industrialized, rich democracies (WEIRD). This reliance on WEIRD samples is not unique to developmental psychology, but is common to most subfields of psychology.

"And yet that's only 18 percent of the world population today—and certainly unrepresentative of how we've lived over most of our species' existence," Gurven said.

"Many areas of psychology if not directly, then implicitly, generalize study findings as human universals" he continued, "but if American students living in cities comprise our main study population, how can we generalize based on a tiny subset of humanity?"

Often those study populations are chosen out of convenience, but that choice can have a huge impact on the science they seek to inform, Gurven claims. "It's easier usually less expensive to study folks in your large undergrad classes," he said. "And people might argue that if they're studying, say, perception, then maybe it doesn't matter whether they do it here or someplace else. But it really does. There's a growing set of examples of how certain stylized 'truths' once believed to be universal, are definitely not when you look in different places. And it's not trivial."

Gurven's paper came out of a recent Sackler Colloquium of the National Academy of Sciences on "pressing questions in the study of psychological and behavioral diversity".

"One focus of the meeting was on how to diversify both who we study and who does the studying in order to improve the science. Another was on how to take culture more seriously—and to what extent we need to," Gurven explained. "Cultural differences across populations or within populations over time are usually ignored or considered somehow irrelevant in much of psychology."

For Gurven, it comes down to embracing the same socioecological theory (also referred to as behavioral ecology) that has helped weave together the life and social sciences. Rooted in evolutionary and ecological principles, it often is ignored in much of the psychological sciences. "Using that theory explicitly forces people to pay attention to how features of the physical and social environment might affect a whole litany of behaviors and psychological traits," he said. "The broad range of environments our species has experienced over its long history leads us to expect that many traits should vary as flexible responses to environmental conditions in ways that can lead to systematic differences across locales and situations and over time."

Attention to socioecological theory requires researchers to look beyond convenience samples both within the U.S. and abroad, Gurven noted, and will result in improved psychological science.

Socioecological theory can be used to help researchers understand psychological variation, and also address issues related to the ability—or not—to replicate a study and achieve similar findings. "Not paying direct attention to the context—to culture, to the nuance—is actually hurting our science," Gurven said. "One reason psychology is experiencing a 'replication crisis' right now is because context, culture, environment and other exposures shape how people think, feel and act—and so some of the failure to replicate studies might be due to expecting humans everywhere to react the same way in an experiment.

"A number of us in the meeting coming from anthropology have long had an eye toward broadening the social sciences. Recognizing and trying to explain human variation is the bread and butter of anthropology," he went on. "Whereas psychologists and other do not usually incorporate that perspective directly in their studies—instead treating all humans the same, or ignoring their background altogether."

But if we want to understand the human condition, Gurven argues, it's necessary to consider people living under a wide range of experiences, cultures and environments. If many generations of industrialization, schooling, world religions, and public health infrastructure are part of what make many of us WEIRD, we need to better understand how these exposures affect our psychology and behavior.

Though he is quick to point out such research does not necessarily require world travel. "There's plenty of diversity within the United States that's untapped, most of it outside the ivory tower of the academy," he said.

In his paper, Gurven lays out a theoretical framework for considering how and why these different aspects of so-called "modernization" might be important in shaping the development of key psychological traits. He focuses on two examples from his research with the Tsimane. The first involves the Big Five. "Part of why this became fascinating to study was because it doesn't take long to realize there really is no theory in psychology that generates the Big Five, that says personality structure has to look like this," he said. "It's instead an inductive exercise that takes self- or peer ratings of personality and runs fancy statistical analyses on them to unveil some overarching structure consisting of five principal factors."

"We looked at the degree of correlation across all five factors," Gurven explained. "The correlation should be close to zero if the Big Five are truly independent. But when you compare the U.S., Canada, Indonesia, all the places this has been done, it turns out there's a lot of variability in how correlated they are."

The extent of correlation, he added, relates to the number and diversity of social, economic and political niches, or what he refers to as 'complexity' of the environment. "And we had different ways of measuring that—degrees of urbanization, economic development, the number of diverse products a country produces. And, basically, the more complexity of this type in a country, the more ways there are of 'being'—and the lower the correlation across the Big Five."

In other words, the Big Five is most clearly represented in the most developed, urban countries, i.e. the WEIRD samples mentioned above.

The second example Gurven uses in his paper involves health locus of control—if you believe your future prospects are largely out of your hands or are otherwise uncertain, you are more likely to focus on the present and discount the future. That in turn informs many of your actions. "Your experiences and exposures throughout development in a particular environment shape what's called your time preference—the extent to which you value things now versus in the future," he said.

"It sounds simple, but it has big implications," Gurven continued. "For example, if you think your days are quickly numbered, you're not as likely to make your annual checkup a priority. Your choice not to seek routine medical care or prioritize a healthy lifestyle may be a rational response to living in a dangerous, unpredictable environment."

"Taking that perspective seriously means that many traits that psychologists and education specialists care about—perception, impulsivity, attention span, self-efficacy, temporal discounting—are not just pathological responses due to lack of knowledge or poor upbringing, but may represent adaptive responses to the surrounding environment in which you find yourself," he said.

Gurven cited a classic study which showed how over 100-fold level differences in homicide rates across neighborhoods in Chicago affect risk-taking, criminal behavior and the timing of childbearing. "How is such high-level variation not shaping the psychology of the people who live there?" he asked. "And yet most psychologists do not set up studies in these types of settings."

Again, noted, that kind of theoretical perspective forces researchers to think about who they should be sampling, and what should routinely be reported about study participants. "Sampling students who are well off and comfortable may reveal only a narrow range of behavior," Gurven said. "If I sample students with varied backgrounds but I don't know or care about the history of my participants, I'm missing out on vital opportunities to see how that variability maps onto differences in behavior or psychology."

The implications for what social scientists choose to study are enormous. "We should study places and people that have been largely ignored—in more marginalized regions that may be hard hit, not just the ones that are convenient and familiar." In other words, we need to look beyond our backyards—to rural areas, other countries and other cultures.

"We cannot afford to rely only on disciplines like anthropology or cultural for increasing the diversity of samples," said Gurven. "Scientific progress itself requires improving representation and testing ideas across a large swath of human experience. Hopefully such practices will one day be mainstream across the social sciences."

Explore further: Two indigenous populations offer a glimpse into how diet—and western eating habits—impact health and wellbeing

More information: Broadening horizons: Sample diversity and socioecological theory are essential to the future of psychological science, Proceedings of the National Academy of Sciences (2018). www.pnas.org/cgi/doi/10.1073/pnas.1720433115

Related Stories

Two indigenous populations offer a glimpse into how diet—and western eating habits—impact health and wellbeing

November 2, 2018
From the standpoint of heart health, the Tsimane are a model group. A population indigenous to the Bolivian Amazon, the Tsimane demonstrate next to no heart disease. They have minimal hypertension, low prevalence of obesity ...

'Universal' personality traits don't necessarily apply to isolated indigenous people

January 3, 2013
Five personality traits widely thought to be universal across cultures might not be, according to a study of an isolated Bolivian society.

Aging gracefully in the rainforest

May 8, 2017
The Tsimane of Bolivian Amazonia aren't so different from the people living around you. Most adults live to 70, a few even to 90. They start aging in their 30s, just like we do. And for the Tsimane, the onset of physical ...

Recommended for you

Study measures effectiveness of online communication tools in combatting depression among socially isolated seniors

November 19, 2018
Imagine your family has moved across the state or across country. You're retired, and your spouse has passed away. Lacking the social connections previous generations once found in church or fraternal organizations, it doesn't ...

Response to daily stressors could affect brain health in older adults

November 19, 2018
Taking typical daily annoyances such as a long wait at the doctor's office or a traffic jam on the freeway in stride may help preserve brain health in older adults, while emotional reactions could contribute to declines in ...

Exploring the genetic contribution to suicide risk

November 19, 2018
Researchers at University of Utah Health identified four gene changes that occur more frequently in people who died by suicide that may point to increased risk in vulnerable individuals.

MDMA makes people cooperative, but not gullible

November 19, 2018
New research from King's College London has found that MDMA, the main ingredient in ecstasy, causes people to cooperate better—but only with trustworthy people. In the first study to look in detail at how MDMA impacts cooperative ...

'Boomeranging' back to a parents' home negatively affects young adults' mental health

November 19, 2018
The number of young adults living in their own household has dropped dramatically in the last decades in the United States for a number of economic and social reasons. In a study that will soon be published in the peer-reviewed ...

In-person, but not online, social contact may protect against psychiatric disorders

November 19, 2018
In-person social contact seems to offer some protection against depression and PTSD symptoms, but the same is not true of contact on Facebook, suggests a study by Veterans Affairs Portland Health Care System and Oregon Health ...

2 comments

Adjust slider to filter visible comments by rank

Display comments: newest first

Anonym518498
not rated yet Nov 05, 2018
psychology = pseudoscience
RobertKarlStonjek
not rated yet Nov 05, 2018
The 'big five' are contextual. For instance a person who is loud, extrovert and domineering at home may be meek but conscientious at work and open and friendly but light and not at conscientious when socialising with friends, so what is this person's classification with respect to the big five??

Obviously the most studied is college students in a college environment and the office work equivalent. But what if we put subjects into the environment of these tribal people and how would tribal people behave after a year in an office or college?

What researchers call 'personality' has little to do with what the general public (who originally produced and defined the word) mean by it. instead it is the default contextual behavioural adaptation unique to each person and the context in which they interact, but with the contextual dimension removed and this is what causes all the confusion.

How relevant is 'extroversion', 'agreeableness' and 'openness' to a lone worker like me??

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.