Applying information theory to linguistics suggests 'functional design' in cross-language variations
The majority of languages—roughly 85 percent of them—can be sorted into two categories: those, like English, in which the basic sentence form is subject-verb-object ("the girl kicks the ball"), and those, like Japanese, in which the basic sentence form is subject-object-verb ("the girl the ball kicks").
The reason for the difference has remained somewhat mysterious, but researchers from MIT's Department of Brain and Cognitive Sciences now believe that they can account for it using concepts borrowed from information theory, the discipline, invented almost singlehandedly by longtime MIT professor Claude Shannon, that led to the digital revolution in communications. The researchers will present their hypothesis in an upcoming issue of the journal Psychological Science.
Shannon was largely concerned with faithful communication in the presence of "noise"—any external influence that can corrupt a message on its way from sender to receiver. Ted Gibson, a professor of cognitive sciences at MIT and corresponding author on the new paper, argues that human speech is an example of what Shannon called a "noisy channel."
"If I'm getting an idea across to you, there's noise in what I'm saying," Gibson says. "I may not say what I mean—I pick up the wrong word, or whatever. Even if I say something right, you may hear the wrong thing. And then there's ambient stuff in between on the signal, which can screw us up. It's a real problem." In their paper, the MIT researchers argue that languages develop the word order rules they do in order to minimize the risk of miscommunication across a noisy channel.
Gibson is joined on the paper by Rebecca Saxe, an associate professor of cognitive neuroscience; Steven Piantadosi, a postdoc at the University of Rochester who did his doctoral work with Gibson; Leon Bergen, a graduate student in Gibson's group; research affiliate Eunice Lim; and Kimberly Brink, who graduated from MIT in 2010.
The researchers' hypothesis was born of an attempt to explain the peculiar results of an experiment reported in the Proceedings of the National Academy of Sciences in 2008; Brink reproduced the experiment as a class project for a course taught by Saxe. In the experiment, native English speakers were shown crude digital animations of simple events and asked to describe them using only gestures. Oddly, when presented with events in which a human acts on an inanimate object, such as a girl kicking a ball, volunteers usually attempted to convey the object of the sentence before trying to convey the verb—even though, in English, verbs generally precede objects. With events in which a human acts on another human, such as a girl kicking a boy, however, the volunteers would generally mime the verb before the object.
"It's not subtle at all," Gibson says. "It's about 70 percent each way, so it's a shift of about 40 percent."
The tendency even of speakers of a subject-verb-object (SVO) language like English to gesture subject-object-verb (SOV), Gibson says, may be an example of an innate human preference for linguistically recapitulating old information before introducing new information. The "old before new" theory—which, according to the University of Pennsylvania linguist Ellen Price, is also known as the given-new, known-new, and presupposition-focus theory—has a rich history in the linguistic literature, dating back to at least the work of the German philosopher Hermann Paul, in 1880.
Imagine, for instance, the circumstances in which someone would actually say, in ordinary conversation, "the girl kicked the ball." Chances are, the speaker would already have introduced both the girl and the ball—say, in telling a story about a soccer game. The sole new piece of information would be the fact of the kick.
Assuming a natural preference for the SOV word order, then—at least in cases where the verb is the new piece of information—why would the volunteers in the PNAS experiments mime SVO when both the subject and the object were people? The MIT researchers' explanation is that the SVO ordering has a better chance of preserving information if the communications channel is noisy.
Suppose that the sentence is "the girl kicked the boy," and that one of the nouns in the sentence—either the subject or the object—will be lost in transmission. If the word order is SOV, then the listener will receive one of two messages: either "the girl kicked" or "the boy kicked." If the word order is SVO, however, the two possible messages on the receiving end are "the girl kicked" and "kicked the boy": More information will have made it through the noisy channel.
Down to cases
That is the MIT researchers' explanation for the experimental findings reported in the 2008 PNAS paper. But how about the differences in word order across languages? A preliminary investigation, Gibson says, suggests that there is a very strong correlation between word order and the strength of a language's "case markings." Case marking means that words change depending on their syntactic function: In English, for instance, the pronoun "she" changes to "her" if the kicker becomes the kicked. But case marking is rare in English, and English is an SVO language. Japanese, a strongly case-marked language, is SOV. That is, in Japanese, there are other cues as to which noun is subject and which is object, so Japanese speakers can default to their natural preference for old before new.
Gibson adds that, in fact, some languages have case markings only for animate objects—an observation that accords particularly well with the MIT researchers' theory.
"It's an extremely valuable study," says Steven Pinker, the Johnstone Family Professor in the Department of Psychology at Harvard University. "The design of any language reflects a compromise between properties that make it more useful—clarity, expressiveness, ease of articulation—and properties that are standardized across a community of speakers so that everyone is using the same code. Most grammatical theorists have focused on the arbitrary nature of the community-wide grammar. Gibson has now shed light on how each of these grammars has evolved, in a few predictable ways, to maximize clarity in communicating who did what to whom. That is, much more can be said than just 'That's the way English is; that's the way Turkish is,' and so on. Gibson's study shows that there is a great deal of functional design in seemingly arbitrary patterns of variation across languages."
In order to make their information-theoretical model of word order more rigorous, Gibson says, he and his colleagues need to better characterize the "noise characteristics" of spoken conversation—what types of errors typically arise, and how frequent they are. That's the topic of ongoing experiments, in which the researchers gauge people's interpretations of sentences in which words have been deleted or inserted.
Provided by Massachusetts Institute of Technology
This story is republished courtesy of MIT News (web.mit.edu/newsoffice/), a popular site that covers news about MIT research, innovation and teaching.
- Historical context guides language development Apr 14, 2011 | not rated yet | 0
- Noted physicist teams with anthropologist to create ancient linguistic tree Oct 12, 2011 | not rated yet | 0
- Study: Word sounds contain clues for language learners Sep 13, 2011 | not rated yet | 0
- Unique languages, universal patterns: Linguist reveals how modern English resembles Old Japanese Feb 23, 2012 | not rated yet | 0
- Three of a kind: Revealing language’s universal essence Nov 20, 2009 | not rated yet | 0
- Motion perception revisited: High Phi effect challenges established motion perception assumptions Apr 23, 2013 | 3 / 5 (2) | 2
- Anything you can do I can do better: Neuromolecular foundations of the superiority illusion (Update) Apr 02, 2013 | 4.5 / 5 (11) | 5
- The visual system as economist: Neural resource allocation in visual adaptation Mar 30, 2013 | 5 / 5 (2) | 9
- Separate lives: Neuronal and organismal lifespans decoupled Mar 27, 2013 | 4.9 / 5 (8) | 0
- Sizing things up: The evolutionary neurobiology of scale invariance Feb 28, 2013 | 4.8 / 5 (10) | 14
How can there be villous adenoma in colon, if there are no villi there
8 hours ago As title suggest. Thanks :smile:
How can there be a term called "intestinal metaplasia" of stomach
May 21, 2013 Hello everyone, Ok Stomach's normal epithelium is simple columnar, now in intestinal type of adenocarcinoma of stomach it undergoes "intestinal...
Pressure-volume curve: Elastic Recoil Pressure don't make sense
May 18, 2013 From pressure-volume curve of the lung and chest wall (attached photo), I don't understand why would the elastic recoil pressure of the lung is...
If you became brain-dead, would you want them to pull the plug?
May 17, 2013 I'd want the rest of me to stay alive. Sure it's a lousy way to live but it beats being all-the-way dead. Maybe if I make it 20 years they'll...
MRI bill question
May 15, 2013 Dear PFers, The hospital gave us a $12k bill for one MRI (head with contrast). The people I talked to at the hospital tell me that they do not...
Ratio of Hydrogen of Oxygen in Dessicated Animal Protein
May 13, 2013 As an experiment, for the past few months I've been consuming at least one portion of Jell-O or unflavored Knox gelatin per day. I'm 64, in very...
- More from Physics Forums - Medical Sciences
More news stories
Until now, little was scientifically known about the human potential to cultivate compassion—the emotional state of caring for people who are suffering in a way that motivates altruistic behavior.
Psychology & Psychiatry 9 minutes ago | not rated yet | 0 |
What effect does a father's depression have on his young son or daughter? When fathers report a high level of emotional intimacy in their marriage, their children benefit, said a University of Illinois study.
Psychology & Psychiatry 35 minutes ago | not rated yet | 0
(Medical Xpress)—Preschoolers universally recognize that one's choices are not always free – that our decisions may be constrained by social obligations to be nice to others or follow rules set by parents ...
Psychology & Psychiatry 7 hours ago | not rated yet | 0
(Medical Xpress)—Do ethicists engage in better moral behavior than other professors? The answer is no. Nor are they more likely than nonethicists to act according to values they espouse, according to researchers from the ...
Psychology & Psychiatry 8 hours ago | 5 / 5 (1) | 0
Is it permissible to harm one to save many? Those who tend to say "yes" when faced with this classic dilemma are likely to be deficient in a specific kind of empathy, according to a report published in the scientific journal ...
Psychology & Psychiatry 11 hours ago | not rated yet | 1 |
A new approach for immunizing against influenza elicited a more potent immune response and broader protection than the currently licensed seasonal influenza vaccines when tested in mice and ferrets. The vaccine ...
30 minutes ago | not rated yet | 0 |
A man who had contracted the coronavirus has died in Saudi Arabia, raising the death toll in the kingdom from the SARS-like virus to 17, the health ministry announced on its website on Wednesday.
4 minutes ago | not rated yet | 0
GlaxoSmithKline PLC says it's starting an unusual collaboration with the U.S. government to develop several antibiotics for both bioterrorism threats and bacterial infections resistant to current medicines.
2 minutes ago | not rated yet | 0
Johns Hopkins researchers report that hospitals may be reaping enormous income for patients whose hospital stays are complicated by preventable bloodstream infections contracted in their intensive care units.
32 minutes ago | not rated yet | 0
The World Health Organization says the Horn of Africa is experiencing an outbreak of polio with cases confirmed in Kenya and Somalia.
2 minutes ago | not rated yet | 0
A University of Illinois researcher says that the cornerstone of our efforts to alleviate food insecurity should be to encourage more people to participate in the Supplemental Nutrition Assistance Program (SNAP) "because ...
34 minutes ago | not rated yet | 0