Mapping the brain
A pair of algorithms detect the cell boundaries in a 2D image (left) and color-code each neuron in a “stained glass” display (right). Taking advantage of a neuron’s continuity through space, the algorithm resolves ambiguities by comparing adjacent images from the same 3D stack. A neuron boundary that shows up in only one image, for example, is likely just an artifact. Image courtesy of Amelio Vasquez-Reina, a Ph.D. student in the Pfister Group at SEAS.
The brain of a mouse measures only 1 cubic centimeter in volume. But when neuroscientists at Harvards Center for Brain Science slice it thinly and take high-resolution micrographs of each slice, that tiny brain turns into an exabyte of image data. Thats 1018 bytes, equivalent to more than a billion CDs.
What can you do with such a gigantic, unwieldy data set? Thats the latest challenge for Hanspeter Pfister, the Gordon McKay Professor of the Practice of Computer Science at Harvards School of Engineering and Applied Sciences (SEAS).
Pfister, an expert in high-performance computing and visualization, is part of an interdisciplinary team collaborating on the Connectome Project at the Center for Brain Science. The ambitious Connectome Projectaims to create a wiring diagram of all the neurons in the brain, and neuroscientists have developed innovative techniques for automatically imaging slices of mouse brain, yielding terabytes of data so far.
Pfisters system for displaying and processing these images would be familiar to anyone who has used the Google MapsTM service. Because only a subsection of a very large image can be displayed on a screen, only that viewable subsection is loaded. Drag the image around, zoom in or out, and more of the image is displayed on the fly. (Watch a video demo below.)
This video is not supported by your browser at this time.This demand-driven distributed computation is the central idea behind Pfisters work, which recently won him a Google Faculty Research Award.
With new techniques producing ever-larger data sets in science, the problem is hardly unique to the Connectome Project. Pfister is certain that the tools his research group develops can be used by scientists working with large image data sets in any fieldfor example, astronomers processing radio telescope images or earth scientists analyzing atmospheric data.
Even for the Connectome, the ultimate tool will be much more than Google Maps for the brain. The project has two crucial new features, says Pfister. First, the mouse brain must be reconstructed in three dimensions, so one can quickly flip through the stack of images in addition to zooming and panning across it. The images, each representing a 30-nanometer-thick brain slice, can also be stacked together and viewed from the side, along the same axis they were sliced.
Additionally, the system developed by Pfisters research team extends the demand-driven principle to image analysis and processing. If a neuroscientist wants to automatically align images, adjust the brightness of an image, or run an automatic cell boundary detector over a portion of the images, for example, these operations are also computed on the fly, so there is no need to wait for the entire stack of images to be processed before the relevant subsection is viewable. Pfister compares it to a very specialized version of Adobe® Photoshop® software.
Indeed, the existing tools are capable of far more advanced image processing. Since the collaboration began in 2007, computer scientists in Pfisters group have created algorithms to automatically detect cell boundaries, a process known as segmentation, and to connect related cells in three dimensions, a process known as reconstruction. Previously, neuroscientists did this by hand.
With thousands of neurons in even a cubic millimeter of brain tissue, it would be impossible to scale the project up without automated segmentation, says Jeff Lichtman, the Jeremy R. Knowles Professor of Molecular and Cellular Biology at Harvard and leader of the Connectome Project.
Automated segmentation is done by a machine learning algorithm, which a neurobiologist trains by marking the cell boundaries in as few as five images. The algorithm then learns the featuresedges, corners, textures, etc.associated with cell boundaries. Occasional errors can be corrected on the go, and the algorithm learns from these errors. With all the cell boundaries in a stack of images identified, a second machine learning method combines information from the images to reconstruct the shape of a neuron in three-dimensional space.
Researchers in Pfisters group are currently working on ways to automatically detect synapses, the sites where two neurons are connected.
We spent four years developing algorithms to find cell boundaries and synapses as well as building up the infrastructure for viewing and displaying large image data sets, says Pfister. The individual tools are in place, but now were putting the two pieces together, he adds, looking ahead to the next few years of research.
The Connectome Project is certainly an ambitious one. The sheer quantity of electron microscopy slices that need to be acquired and analyzed is a daunting but necessary challenge, says Lichtman: We have made no progress on simple questions like how many neurons converge on a single neuron. A lot of brain functions are at that level.
Lichtman believes that the Connectome will be able to answer those simple questions but also complex ones. The patterns that emerge about how different types of neurons connect to each other can give physical clues to how memories and personality traits are encoded. That is all far off, but it would certainly be impossible without the analysis tools developed by computer scientists.
The Connectome Project also draws together collaborators in neurobiology, molecular and cellular biology, medicine, and chemistry and chemical biology.
This is a great example of a cross-disciplinary project, adds Pfister, At SEAS we are a bridge between different schools, which makes it easy for me to work with my collaborators. Its very gratifying to see our tools used in real applications.
More information: cbs.fas.harvard.ed… tome-project
Provided by Harvard School of Engineering and Applied Sciences
- Large scale qubit generation for quantum computing Jul 27, 2011 | not rated yet | 0
- Neuroscientists making computers smart enough to see connections between brain's neurons Jan 28, 2010 | not rated yet | 0
- 2-D photos spring to 3-D life Jun 16, 2011 | not rated yet | 0
- Kidney close-up: Scientists' prize-winning images rich with detail, data Mar 28, 2011 | not rated yet | 0
- What makes an image memorable? We tend to remember pictures of people much better than wide open spaces May 24, 2011 | not rated yet | 0
- Motion perception revisited: High Phi effect challenges established motion perception assumptions Apr 23, 2013 | 3 / 5 (2) | 2
- Anything you can do I can do better: Neuromolecular foundations of the superiority illusion (Update) Apr 02, 2013 | 4.5 / 5 (11) | 5
- The visual system as economist: Neural resource allocation in visual adaptation Mar 30, 2013 | 5 / 5 (2) | 9
- Separate lives: Neuronal and organismal lifespans decoupled Mar 27, 2013 | 4.9 / 5 (8) | 0
- Sizing things up: The evolutionary neurobiology of scale invariance Feb 28, 2013 | 4.8 / 5 (10) | 14
How can there be a term called "intestinal metaplasia" of stomach
1 hour ago Hello everyone, Ok Stomach's normal epithelium is simple columnar, now in intestinal type of adenocarcinoma of stomach it undergoes "intestinal...
Pressure-volume curve: Elastic Recoil Pressure don't make sense
May 18, 2013 From pressure-volume curve of the lung and chest wall (attached photo), I don't understand why would the elastic recoil pressure of the lung is...
If you became brain-dead, would you want them to pull the plug?
May 17, 2013 I'd want the rest of me to stay alive. Sure it's a lousy way to live but it beats being all-the-way dead. Maybe if I make it 20 years they'll...
MRI bill question
May 15, 2013 Dear PFers, The hospital gave us a $12k bill for one MRI (head with contrast). The people I talked to at the hospital tell me that they do not...
Ratio of Hydrogen of Oxygen in Dessicated Animal Protein
May 13, 2013 As an experiment, for the past few months I've been consuming at least one portion of Jell-O or unflavored Knox gelatin per day. I'm 64, in very...
Alcohol and acetaminophen
May 13, 2013 Edit: sorry for the typo in the title , can't edit I looked around on google quite a bit and it's very hard to find precise information on the...
- More from Physics Forums - Medical Sciences
More news stories
Many brain researchers cannot see the forest for the trees. When they use electrodes to record the activity patterns of individual neurons, the patterns often appear chaotic and difficult to interpret.
Neuroscience 2 minutes ago | not rated yet | 0
(Medical Xpress)—We spend about a third of our life asleep, but why we need to do so remains a mystery. In a recent publication, researchers at University of Surrey and University College London suggest a new hypothesis, ...
Neuroscience 1 hour ago | not rated yet | 0
(Medical Xpress)—A three-year multinational study has tracked and detailed the progression of Huntington's disease (HD), predicting clinical decline in people carrying the HD gene more than 10 years before ...
Neuroscience 2 hours ago | not rated yet | 0
While Huntington's disease (HD) is currently incurable, the HD research community anticipates that new disease-modifying therapies in development may slow or minimize disease progression. The success of HD research depends ...
Neuroscience 14 hours ago | 5 / 5 (1) | 0
Study shows premature birth interrupts vital brain development processes leading to reduced cognitive abilities
Researchers from King's College London have for the first time used a novel form of MRI to identify crucial developmental processes in the brain that are vulnerable to the effects of premature birth. This new study, published ...
Neuroscience 16 hours ago | 5 / 5 (1) | 0 |
(HealthDay)—Injections of a sugar solution appear to help relieve knee pain and stiffness related to osteoarthritis, a new study suggests.
25 minutes ago | not rated yet | 0 |
(Medical Xpress)—Scientists at the School of Medicine have shown that their previously identified therapeutic approach to fight cancer via immune cells called macrophages also prompts the disease-fighting killer T cells ...
33 minutes ago | not rated yet | 0 |
Over the past few decades, scientists have developed many devices that can reopen clogged arteries, including angioplasty balloons and metallic stents. While generally effective, each of these treatments ...
28 minutes ago | not rated yet | 0 |
(HealthDay)—Obese and overweight men and women who suffer from heartburn often report relief when they lose weight, a new study shows.
15 minutes ago | not rated yet | 0 |
(HealthDay)—When it comes to the care of your children's teeth, dentists aren't the only experts who can help.
35 minutes ago | not rated yet | 0
(HealthDay)—For patients with acute respiratory distress syndrome (ARDS), prolonged prone positioning during mechanical ventilation is associated with significantly reduced mortality at 28 and 90 days, ...
55 minutes ago | not rated yet | 0