• Skip to main content
  • Skip to primary sidebar

Dharmendra S. Modha

My Work and Thoughts.

  • Brain-inspired Computing
    • Collaborations
    • Videos
  • Life & Universe
    • Creativity
    • Leadership
    • Interesting People
  • Accomplishments
    • Prizes
    • Papers
    • Positions
    • Presentations
    • Press
    • Profiles
  • About Me

Efficient Physical Embedding of Topologically Complex Information Processing Networks in Brains and Computer Circuits

April 30, 2010 By dmodha

Danielle S. Bassett, Daniel L. Greenfield, Andreas Meyer-Lindenberg, Daniel R. Weinberger, Simon W. Moore, Edward T. Bullmore published an article last week in PLoS Computational Biology:

ABSTRACT: Nervous systems are information processing networks that evolved by natural selection, whereas very large scale integrated (VLSI) computer circuits have evolved by commercially driven technology development. Here we follow historic intuition that all physical information processing systems will share key organizational properties, such as modularity, that generally confer adaptivity of function. It has long been observed that modular VLSI circuits demonstrate an isometric scaling relationship between the number of processing elements and the number of connections, known as Rent’s rule, which is related to the dimensionality of the circuit’s interconnect topology and its logical capacity. We show that human brain structural networks, and the nervous system of the nematode C. elegans, also obey Rent’s rule, and exhibit some degree of hierarchical modularity. We further show that the estimated Rent exponent of human brain networks, derived from MRI data, can explain the allometric scaling relations between gray and white matter volumes across a wide range of mammalian species, again suggesting that these principles of nervous system design are highly conserved. For each of these fractal modular networks, the dimensionality of the interconnect topology was greater than the 2 or 3 Euclidean dimensions of the space in which it was embedded. This relatively high complexity entailed extra cost in physical wiring: although all networks were economically or cost-efficiently wired they did not strictly minimize wiring costs. Artificial and biological information processing systems both may evolve to optimize a trade-off between physical cost and topological complexity, resulting in the emergence of homologous principles of economical, fractal and modular design across many different kinds of nervous and computational networks.

Filed Under: Brain-inspired Computing

The Brain’s Router: A Cortical Network Model of Serial Processing in the Primate Brain

April 30, 2010 By dmodha

Ariel Zylberberg, Diego Fernández Slezak, Pieter R. Roelfsema, Stanislas Dehaene, Mariano Sigman published a wonderful article in PLoS Computational Biology yesterday.

ABSTRACT: The human brain efficiently solves certain operations such as object recognition and categorization through a massively parallel network of dedicated processors. However, human cognition also relies on the ability to perform an arbitrarily large set of tasks by flexibly recombining different processors into a novel chain. This flexibility comes at the cost of a severe slowing down and a seriality of operations (100–500 ms per step). A limit on parallel processing is demonstrated in experimental setups such as the psychological refractory period (PRP) and the attentional blink (AB) in which the processing of an element either significantly delays (PRP) or impedes conscious access (AB) of a second, rapidly presented element. Here we present a spiking-neuron implementation of a cognitive architecture where a large number of local parallel processors assemble together to produce goal-driven behavior. The precise mapping of incoming sensory stimuli onto motor representations relies on a “router” network capable of flexibly interconnecting processors and rapidly changing its configuration from one task to another. Simulations show that, when presented with dual-task stimuli, the network exhibits parallel processing at peripheral sensory levels, a memory buffer capable of keeping the result of sensory processing on hold, and a slow serial performance at the router stage, resulting in a performance bottleneck. The network captures the detailed dynamics of human behavior during dual-task-performance, including both mean RTs and RT distributions, and establishes concrete predictions on neuronal dynamics during dual-task experiments in humans and non-human primates.

Filed Under: Brain-inspired Computing

Plenary Talk at “Toward a Science of Consciousness”

April 14, 2010 By dmodha

Just delivered a Plenary Talk at "Toward a Science of Consciousness" conference at Tucson, AZ.

Filed Under: Accomplishments, Brain-inspired Computing, Presentations

Jim Olds

March 20, 2010 By dmodha

I had enormous good fortune to spend time with Jim Olds.

Dr. James Olds is the Director of the Krasnow Institute for Advanced Study, an independent research institution located on the campus of George Mason University in Fairfax Virginia. Concurrently he is the Shelley Krasnow University Professor of Neuroscience at George Mason University and Chair of the Department of Molecular Neuroscience. He has an additional academic faculty appointment at the Department of Anatomy and Cell Biology at the Uniformed Services University of the Health Sciences in Bethesda, Maryland.  Olds received his bachelors of arts degree in Chemistry from Amherst College in 1978. After graduating, Olds interned on Capitol Hill for the United States House of Representatives researching chemical aspects of mid-future electrical energy alternatives for the New England Congressional delegation. Olds entered the Neuroscience Ph.D. program at the University of Michigan in 1983, and received his Ph.D. (1987) in neurosciences from that institution. Following the award of his doctorate, Dr. Olds continued his training as a post-doctoral fellow in the Laboratory of Molecular and Cellular Neurobiology (LMCN), NINDS at the National Institutes of Health. Commencing in 1989, Olds published a series of papers which, for the first time, imaged learning-specific changes in the distribution of the activated form of the enzyme protein kinase C in the brains of both invertebrates and mammals. For this work and follow-up studies, Dr. Olds received the NIH award of merit in 1993. In 1994 Dr. Olds was appointed as a senior staff fellow in the newly formed Laboratory of Adaptive Systems (LAS), NINDS. During this period of time Dr. Olds founded the internet news group “bionet.neurosciences”. Thousands of articles have been posted to this internet news group from all over the world. Dr. Olds shares authorship of two U.S. Patents for novel CCD-based imaging devices which image radioligand distributions directly from biological tissue.  During his government service, Dr. Olds also served as U.S. project officer on two successive government R&D contracts to develop novel biologically-based computer algorithms which emulate human associative learning and image comprehension. In 1995 Dr. Olds moved to the private sector to become the Executive Director of the American Association of Anatomists, a professional scientific society representing some 2,500 biomedical scientists. In August 2004, he was named editor-in-chief of the journal Biological Bulletin.  In a volunteer role, Olds served as a political appointee on the Commonwealth Alzheimer’s and Related Diseases Commission from 1998-2004 under both Republican and Democratic governors. Dr. Olds has served on grant review panels for the National Institutes of Health, the National Science Foundation and the Office of Naval Research. He served on the American Association of Anatomist’s Public Affairs Committee from 1995-2002. Dr. Olds also serves on the editorial board of the Journal of Cognitive Dynamics. As a scientist and public policy expert Dr. Olds has been an invited speaker to many domestic and international meetings to speak on topics ranging from brain imaging to global warming. He currently serves on the Board of Trustees of the George Mason University Foundation.

Filed Under: Brain-inspired Computing, Interesting People

Nobelist Albert Fert

March 11, 2010 By dmodha

My distinguished colleague, Dr. Stuart Parkin, invited Dr. Albert Fert to IBM Research – Almaden today, and also arranged for me to meet with Dr. Fert.

Bio: Albert Fert (born 7 March 1938 in Carcassonne, Aude) is a French physicist and one of the discoverers of giant magnetoresistance which brought about a breakthrough in gigabyte hard disks. He is currently professor at Universit Paris-Sud in Orsay and scientific director of a joint laboratory (‘Unit mixte de recherche’) between the Centre national de la recherche scientifique (National Scientific Research Centre) and Thales Group. Also, he is an Adjunct professor of physics at Michigan State University. He was awarded the 2007 Nobel Prize in Physics together with Peter Grnberg.

Filed Under: Brain-inspired Computing, Interesting People

  • « Go to Previous Page
  • Page 1
  • Interim pages omitted …
  • Page 23
  • Page 24
  • Page 25
  • Page 26
  • Page 27
  • Interim pages omitted …
  • Page 49
  • Go to Next Page »

Primary Sidebar

Recent Posts

  • Computer History Museum Interview
  • EE Times Interview by Sunny Bains
  • SiLQ: Simple Large Language Model Quantization-Aware Training
  • Breakthrough low-latency, high-energy-efficiency LLM inference performance using NorthPole
  • Breakthrough edge AI inference performance using NorthPole in 3U VPX form factor

Archives by Month

  • 2025: Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
  • 2024: Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
  • 2023: Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
  • 2022: Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
  • 2020: Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
  • 2019: Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
  • 2018: Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
  • 2017: Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
  • 2016: Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
  • 2015: Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
  • 2014: Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
  • 2013: Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
  • 2012: Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
  • 2011: Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
  • 2010: Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
  • 2009: Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
  • 2008: Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
  • 2007: Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
  • 2006: Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec

Copyright © 2025