Machine learning algorithm revolutionizes how scientists study behavior

Credit: CC0 Public Domain

To Eric Yttri, assistant professor of biological sciences and Neuroscience Institute faculty at Carnegie Mellon University, the best way to understand the brain is to watch how organisms interact with the world.

"Behavior drives everything we do," Yttri said.

As a behavioral neuroscientist, Yttri studies what happens in the brain when animals walk, eat, sniff or do any action. This kind of research could help answer questions about neurological diseases or disorders like Parkinson's disease or stroke. But identifying and predicting animal behavior is extremely difficult.

Now, a new unsupervised machine learning algorithm developed by Yttri and Alex Hsu, a biological sciences Ph.D. candidate in his lab, makes studying behavior much easier and more accurate. The researchers have published a paper on the new tool, B-SOiD (Behavioral segmentation of open field in DeepLabCut), in Nature Communications.

The B-SOiD algorithm is able to discover types of movements, as depicted in the cloud of points here, and then generalize across subjects, detecting the same movements in both individuals.

Previously, the standard method to capture animal behavior was to track very simple actions, like whether a trained mouse pressed a lever or whether an animal was eating food or not. Alternatively, the experimenter could spend hours and hours manually identifying behavior, usually frame by frame on a video, a process prone to human error and bias.

Hsu realized he could let an unsupervised learning algorithm do the time-consuming work. B-SOiD discovers behaviors by identifying patterns in the position of an animal's body. The algorithm works with computer vision software and can tell researchers what behavior is happening at every frame in a video.

"It uses an equation to consistently determine when a behavior starts," Hsu explained. "Once you reach that threshold, the behavior is identified, every time. A human experimenter might toggle between two frames or several categories, try to decide where behavior begins and become fatigued over time."

Yttri said B-SOiD provides a huge improvement and opens up several avenues for new research.

"It removes user bias, and more importantly, removes the time cost and arduous work," he said. "We can accurately process hours of data in a matter of minutes."

Additionally, B-SOiD is very user friendly and openly available to any researcher. Yttri's lab and their collaborators have used the new algorithm in research on many important areas, including research to better understand chronic pain, obsessive compulsive disorder and more.

Collaborators have even begun to use B-SOiD to study human in Parkinson's disease.

"We are beginning to see if this can be used as part of an objective test by a doctor to show how far a patient's disease has progressed. The hope is that a patient anywhere in the world would be diagnosed with one standardized metric," Yttri said.

This is a breakthrough in how scientists can study natural behavior and how it changes rather than the overly simplistic or subjective measures that predominate neuroscience and .

More information: Alexander I. Hsu et al, B-SOiD, an open-source unsupervised algorithm for identification and fast prediction of behaviors, Nature Communications (2021). DOI: 10.1038/s41467-021-25420-x

Journal information: Nature Communications
Citation: Machine learning algorithm revolutionizes how scientists study behavior (2021, August 31) retrieved 24 June 2024 from
This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no part may be reproduced without the written permission. The content is provided for information purposes only.

Explore further

Researchers isolate and decode brain signal patterns for specific behaviors


Feedback to editors