Dharmendra S. Modha

Elizabeth Torres: Three building blocks of the mind to autonomously control the body

July 25, 2007 By dmodha

We had a wonderful talk today from Dr. Elizabeth Torres who is currently at CalTech.

Abstract:

We propose three necessary components for autonomous behavior that any biological organism with sensors, a nervous system subject to the inevitable sensory-processing internal delays and equipped with memories should have. The first component deals with spatio-temporal disparities between the internal and the external mediums of the organism to facilitate comparisons of signals that may be misaligned in space and time. The second component evaluates the similarities between current and old (memories) information to select a course of action (storing a new memory from scratch, using an old memory as it is, or updating an old memory to turn it into a new one as part of a family). The third component regulates the level of relevance for storage, retrieval and update of memories according to the consequences that a given situation my have for the survival and reproduction of the organism.

We provide an example of how these three blocks manifest in primates within the domain of voluntary arm movements. As other systems in the brain, the sub-systems involved in these autonomous behaviors have to deal with sensory-motor maps and transformations involving disparate spatio-temporal representations, internal sensory-processing delays and memories (in the motor domain). Thus these subsystems need to store, retrieve and update memories, which (in primates) we define as associations between the allocentric representation of internal delays (anchored to an early sensory receptor like those in the retina) and a given set of external contextual cues according to their relevance (consequence). We show empirical data from humans and monkeys that strongly suggest that in primates, given a situation such binding computation can be allocentric encoded retinotopically independent of body motions. This evidence changes the way in which we currently think of episodic memory and provides a fresh look at how our conscious notion of the passage of time may have come about.

PC Magazine’s Covery Story: “The Man-made Brain”

June 27, 2007 By dmodha

PC Magazine‘s July 17, 2007 issue features a Cover Story on “Five Ideas That Will Reinvent Modern Computing”. One of the five technologoies is on IBM Research’s work on Cognitive Computing. The following is an excerpt from the story.

It could be the most ambitious computer science project of all time. At IBM’s Almaden Research Center, just south of South Francisco, Dharmendra Modha and his team are chasing the holy grail of artificial intelligence. They aren’t looking for ways of mimicking the human brain, they’re looking to build one-neuron by neuron, synapse by synapse.

“We’re trying to take the entire range of qualitative neuroscientific data and integrate it into a single unified computing platform,” says Modha. “The idea is to re-create the ‘wetware’ brain using hardware and software.”

The project is particularly daunting when you consider that modern neurology has yet to explain how the brain actually works. Yes, we know the fundamentals. But we can’t be sure of every biological transaction, all the way down to the cellular level. Three years into this Cognitive Computing project, Modha’s team isn’t just building a brain from an existing blueprint. They’re helping to create the blueprint as they build. It’s reverse engineering of the highest order.

Their first goal is to build a “massively parallel cortical simulator” that re-creates the brain of a mouse, an organ 3,500 times less complex than a human brain (if you count each individual neuron and synapse). But even this is an undertaking of epic proportions. A mouse brain houses over 16 million neurons, with more than 128 billion synapses running between them. Even a partial simulation stretches the boundaries of modern hardware. No, we don’t mean desktop hardware. We’re talkin’ supercomputers.

So far, the team has been able to fashion a kind of digital mouse brain that needs about 6 seconds to simulate 1 second of real thinking time. That’s still a long way from a true mouse-size simulation, and it runs on a Blue Gene/L supercomputer with 8,192 processors, four terabytes of memory, and 1 Gbps of bandwidth running to and from each chip. “Even a mouse-scale cortical simulation places an extremely heavy load on a supercomputer,” Modha explains. “We’re leveraging IBM’s technological resources to the limit.”

Written with ordinary C code, this initial simulation is a remarkable proof of concept. As neuroscience and computing power continue to advance, Modha and his team are confident they can build cortical simulators of even greater complexity. And as they do, they hope to advance neuroscience even further, learning more and more about the inner workings of the brain and getting closer and closer to their ultimate goal.

Once they’ve simulated a mouse brain in real time, the team plans on tackling a rat cortex, which is about three and a half times larger. And then a cat brain, which is ten times larger than that. And so on, until they’ve built a cortical simulator on a human scale.

What’s that good for? Anything and everything. “What we’re seeking with cognitive computing is a universal cognitive mechanism, something that can give rise to the entire range of mental phenomena exhibited by humans,” says Modha. “That is the ultimate goal.”

IBM triples performance of World’s Fastest Computer and breaks the “Quadrillion” Barrier

June 26, 2007 By dmodha

"IBM’s new Blue Gene/P is the second generation of the world’s most powerful supercomputer. It triples the performance of its predecessor, Blue Gene/L while remaining the most energy-efficient and space-saving computing package ever built. Blue Gene/P scales to operate continuously at speeds exceeding one petaflop (one-quadrillion operations per second) and can be configured to reach speeds in excess of three petaflops. The system is 100,000 times more powerful than a home PC and can process more operations in one second than a stack of laptop computers 1.5 miles high (don’t try this at home folks). "

"The U.S. Dept. of Energy’s Argonne National Laboratory, Argonne, Ill., will deploy the first Blue Gene/P supercomputer in the U.S. beginning later this year. In Germany, the Max Planck Society and Forschungszentrum Julich also plan to begin installing Blue Gene/P systems in late 2007. Additional Blue Gene/P system rollouts are being planned by Stony Brook University and Brookhaven National Laboratory in Upton, N.Y., and the Science and Technology Facilities Council, Daresbury Laboratory in Cheshire, England."

Link to the original article.