Neuroscientists discover a brain signal that indicates whether speech has been understood

February 22, 2018, Trinity College Dublin
When a listener understands speech, a strong response signal is seen over the mid back part of their scalp (top row; blue and green waveforms show response at two specific recording locations). When they can't understand (because, for example, the speech is played backwards), the signal completely disappears (bottom row; red and yellow waveforms show the lack of response at the same two specific recording locations). Credit: Professor Ed Lalor.

Neuroscientists from Trinity College Dublin and the University of Rochester have identified a specific brain signal associated with the conversion of speech into understanding. The signal is present when the listener has understood what they have heard, but it is absent when they either did not understand, or weren't paying attention.

The uniqueness of the signal means that it could have a number of potential applications, such as tracking language development in infants, assessing brain function in unresponsive patients, or determining the early onset of dementia in older persons.

During our everyday interactions, we routinely speak at rates of 120 - 200 words per minute. For listeners to understand at these rates - and to not lose track of the conversation - their brains must comprehend the meaning of each of these words very rapidly. It is an amazing feat of the human brain that we do this so easily—especially given that the meaning of words can vary greatly depending on the context. For example, the word bat means very different things in the following two sentences: "I saw a bat flying overhead last night"; "The baseball player hit a homerun with his favourite bat."

However, precisely how our brains compute the meaning of words in context has, until now, remained unclear. The new approach, published today in the international journal Current Biology, shows that our brains perform a rapid computation of the similarity in meaning that each word has to the words that have come immediately before it.

To discover this, the researchers began by exploiting state-of-the-art techniques that allow modern computers and smartphones to "understand" speech. These techniques are quite different to how humans operate. Human evolution has been such that babies come more or less hardwired to learn how to speak based on a relatively small number of speech examples. Computers on the other hand need a tremendous amount of training, but because they are fast, they can accomplish this training very quickly. Thus, one can train a computer by giving it a lot of examples (e.g., all of Wikipedia) and by asking it to recognise which pairs of words appear together a lot and which don't. By doing this, the computer begins to "understand" that words that appear together regularly, like "cake" and "pie", must mean something similar. And, in fact, the computer ends up with a set of numerical measures capturing how similar any word is to any other.

The newly discovered brain signal may be useful in determining whether a listener has truly understood spoken instructions. Credit: Ben White on Unsplash.

To test if human brains actually compute the similarity between words as we listen to speech, the researchers recorded electrical brainwave signals recorded from the human scalp - a technique known as electroencephalography or EEG - as participants listened to a number of audiobooks. Then, by analysing their brain activity, they identified a specific response that reflected how similar or different a given word was from the that preceded it in the story.

Crucially, this signal disappeared completely when the subjects either could not understand the speech (because it was too noisy), or when they were just not paying attention to it. Thus, this signal represents an extremely sensitive measure of whether or not a person is truly understanding the speech they are hearing, and, as such, it has a number of potential important applications.

Ussher Assistant Professor in Trinity College Dublin's School of Engineering, Trinity College Institute of Neuroscience, and Trinity Centre for Bioengineering, Ed Lalor, led the research.

Professor Lalor said: "Potential applications include testing in infants, or determining the level of in patients in a reduced state of consciousness. The presence or absence of the signal may also confirm if a person in a job that demands precision and speedy reactions - such as an air traffic controller, or soldier—has understood the instructions they have received, and it may perhaps even be useful for testing for the onset of dementia in older people based on their ability to follow a conversation."

"There is more work to be done before we fully understand the full range of computations that our brains perform when we understand speech. However, we have already begun searching for other ways that our brains might compute meaning, and how those computations differ from those performed by computers. We hope the new approach will make a real difference when applied in some of the ways we envision."

Explore further: Researchers pinpoint when our brains convert speech sounds into meaning

More information: Current Biology (2018). DOI: 10.1016/j.cub.2018.01.080 , http://www.cell.com/current-biology/fulltext/S0960-9822(18)30146-5

Related Stories

Researchers pinpoint when our brains convert speech sounds into meaning

September 25, 2015
Researchers from Trinity College Dublin have identified the precise moment our brains convert speech sounds into meaning. They have, for the first time, shown that fine-grained speech processing details can be extracted from ...

Study listens in on speech development in early childhood

January 15, 2018
If you've ever listened in on two toddlers at play, you might have wondered how much of their babbling might get lost in translation. A new study from the University of Toronto provides surprising insights into how much children ...

Simply listening prompts speech practice before an infant's first words

July 9, 2015
Infants take in the sounds of various languages indiscriminately until about 8 months of age, when their brains start to focus only on the predominant language they hear around them, according to researchers. But, they say, ...

What the pupils tells us about language

June 15, 2017
The meaning of a word is enough to trigger a reaction in our pupil: when we read or hear a word with a meaning associated with luminosity ("sun," "shine," etc.), our pupils contract as they would if they were actually exposed ...

In loud rooms our brains 'hear' in a different way – new findings

May 6, 2016
When we talk face to face, we exchange many more signals than just words. We communicate using our body posture, facial expressions and head and eye movements; but also through the rhythms that are produced when someone is ...

Recommended for you

Attention, please! Anticipation of touch takes focus, executive skills

December 12, 2018
Anticipation is often viewed as an emotional experience, an eager wait for something to happen.

Study highlights potential benefits of continuous EEG monitoring for infant patients

December 12, 2018
A recent retrospective study evaluating continuous electroencephalography (cEEG) of children in intensive care units (ICUs) found a higher than anticipated number of seizures. The work also identified several conditions closely ...

The importins of anxiety

December 11, 2018
According to some estimates, up to one in three people around the world may experience severe anxiety in their lifetime. In a study described today in Cell Reports, researchers at the Weizmann Institute of Science have revealed ...

How returning to a prior context briefly heightens memory recall

December 11, 2018
Whether it's the pleasant experience of returning to one's childhood home over the holidays or the unease of revisiting a site that proved unpleasant, we often find that when we return to a context where an episode first ...

Neurons in the brain work as a team to guide movement of arms, hands

December 11, 2018
The apparent simplicity of picking up a cup of coffee or turning a doorknob belies the complex sequence of calculations and processes that the brain must undergo to identify the location of an item in space, move the arm ...

Using neurofeedback to prevent PTSD in soldiers

December 11, 2018
A team of researchers from Israel, the U.S. and the U.K. has found that using neurofeedback could prevent soldiers from experiencing PTSD after engaging in emotionally difficult situations. In their paper published in the ...

0 comments

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.