• Skip to main content
  • Skip to primary sidebar

Dharmendra S. Modha

My Work and Thoughts.

  • Brain-inspired Computing
    • Collaborations
    • Videos
  • Life & Universe
    • Creativity
    • Leadership
    • Interesting People
  • Accomplishments
    • Prizes
    • Papers
    • Positions
    • Presentations
    • Press
    • Profiles
  • About Me

Jeff Hawkins: “An Enterprising Approach to Brain Science”

October 9, 2006 By dmodha

This week’s Science issue (6 October 2006: Vol. 314. no. 5796, pp. 76 – 77) provides a wonderful account of Jeff Hawkins: "Mobile computing pioneer Jeff Hawkins has had a lifelong fascination with brains. Now he’s trying to model the human cerebral cortex—and he’s created a software company based on his ideas".

You can read about Jeff Hawkins’ start-up Numenta here.  

Filed Under: Brain-inspired Computing, Interesting People

Robot whiskers sense shapes and textures

October 5, 2006 By dmodha

Joseph H. Solomon and Mitra J. Hartmann reported in Nature (vol. 443, p. 525, October 2006) development of robotic whiskers:

"Several species of terrestrial and marine mammals with whiskers (vibrissae) use them to sense and navigate in their environment — for example, rats use their whiskers to discern the features of objects, and seals rely on theirs to track the hydrodynamic trails of their prey. Here we show that the bending moment — sometimes referred to as torque — at the whisker base can be used to generate three-dimensional spatial representations of the environment, and we use this principle to construct robotic whisker arrays that extract precise information about object shape and fluid flow."

Filed Under: Brain-inspired Computing

The Swartz Foundation for Computational Neuroscience

October 2, 2006 By dmodha

From my perspective, cognitive computing is "neuroscientifically-inspired computing". The flip side of which is "computationallly-enabled (inspired) neuroscience".

Today, a major force shaping the field of computational neuroscience is Dr. Jerome (Jerry) Swartz.  Dr. Swartz is an incredible human being: a scientist (an inventor of over 200 patents), a technological innovator (winner of National Medal of Technology), a successful entrepreneur (founder of Symbol Technologies — recently acquired by Motorola), and a philanthropist.

In 1994, Dr. Swartz established the Swartz Foundation. The Foundation has established 3 centers at Cold Spring Harbor Laboratory, Columbia University and UC San Diego, and has partnered with the Sloan Foundation to establish five centers at Salk Institute, Cal Tech, NYU/Courant, Brandeis, and UC San Francisco. In effect, the Foundation has created a "Virtual Neuroscience Institute" that brings together the very best minds in the field together.

Recently, I had an opportunity to visit the Swartz Center for Computational Neuroscience at UC San Diego, and to spend time with its director, Dr. Scott Makeig. The center is equipped with state-of-the-art EEG labs and a high-performance compute cluster. Dr. Makeig’s personal interest is in applying Independent Component Analysis (a la Bell and Sejnowski) to EEG data. EEG data analysis allows us to understand how multiple brain areas interact dynamically in exhibiting a number of cognitive phenomena. He has led the development of the widely used EEGLAB software which "is an interactive Matlab toolbox for processing continuous and event-related EEG, MEG and other electrophysiological data using independent component analysis (ICA), time/frequency analysis, artifact rejection, and several modes of data visualization". Dr. Makeig has formed an impressive array of partnerships and projects, and has attracted top-notch collaborators. Very recently, EEGLAB was used by Professor Robert Knight and colleagues at UC Berkeley and UC San Francisco in their paper "High Gamma Power Is Phase-Locked to Theta Oscillations in Human Neocortex" that appeared in Science, 15 September 2006, 313: 1626-1628. Due to its noninvasive nature, EEG is likely to have a number of mainstream applications in brain-machine interfaces.

Filed Under: Brain-inspired Computing, Interesting People

“A new look at the visual system” by Robert Galambos

September 21, 2006 By dmodha

Professor Robert Galambos is an iconic figure in Neurosciences. Along with six other faculty, he was instrumental in establishing the first academic neurosciences department in the world at UCSD. He was elected to the National Academy of Sciences in 1960. He is most widely known for his co-discovery of the phenomenon of echolocation in bats.

I had the incredible good fortune of listening to his talk at UCSD. At an age that is nearing 91, he is still amazingly sharp and full of energy. He described joint work with G. Juhasz’s group. A key idea is that eye fixates on different aspects of the visual scene at rate of 3 fixations/second. Each fixation causes retina to transmit an optic nerve signal that lasts 300ms. The amazing fact is that 300ms seems to be a constant. Different stimuli, different mental states of animal, different duration of stimuli, or different magnitude of stimuli do not seem to affect this number! This was established via experiments in rats.

In humans, he described the following experiment. A red LED is flashed followed by inter stimulus interval (ISI) followed by a green LED. Four cases are observed:

  1. When ISI is less than 60 ms, the subject sees a single flash of orange color.
  2. When ISI is in range 61-90ms, the subject sees a smaller flash followed by another larger flash — both are orange in color.
  3. When ISI is in range 91-290ms, the subject sees a smaller red flash followed by a larger green flash.
  4. When ISI is 300ms or more, the subject sees a red flash followed by a green flash of equal durations.

He argued how these observations can be used to demystify a whole range of psychological phenomena. For example, each saccade (the blur between two fixations) is 40 ms. Above data may explain why we never see it (so called saccadic suppression).

He proposed that the principle of retina is "create the briefest possible optic nerve volley that includes all information in a scene, and send it off to cortex at the highest possible rate."

At the very end, he raised several intriguing questions: (a) If optic nerve volley is 300ms, how do we perceive motion when pictures are flashed at the rate of 24 Hz? (b) Observe that when ISI is less than 90 ms, the subject perceives orange. Why? 

Filed Under: Brain-inspired Computing

Nathaniel Rochester III (1919-2001)

September 18, 2006 By dmodha

Nathaniel Rochester

On August 31, 1955, J. McCarthy, Dartmouth College,  M. L. Minsky, Harvard University,  N. Rochester, I.B.M. Corporation, and C.E. Shannon, Bell Telephone Laboratories submitted “A PROPOSAL FOR THE DARTMOUTH SUMMER RESEARCH PROJECT ON ARTIFICIAL INTELLIGENCE” to the Rockfeller Foundation for support. This proposal is widely credited for coining the term “artificial intelligence”.

I was quite pleasantly surprised to find that an IBMer played a significant role in drafting a historically important scientific document. I was curious about him and his achievements.

In 1956, he published a classic article in which he and collegues simulated a network of neurons on IBM 701 and 704 calculators (yes, that is what computers were known as then!) to test Hebb’s theories. When he co-wrote the proposal, he was Manager of Information Research at IBM in Poughkeepsie, New York. His photograph was published in Time Magazine,  May 11, 1981. Here is his biography that was published by IBM Journal of Research and Development: 25th Anniversary Issue, 1981. (see pg. 842).

Mr. Rochester, an IBM Fellow, is currently working on the development of a portable personal computer. After working on radar in the Massachusetts Institute of Technology Radiation Laboratory and at GTLE, he joined IBM in 1948 in Poughkeepsie, New York. He was the architect of the test assembly and headed the architecture efforts for the tape processing machine and the IBM 701. He wrote the first symbolic assembly program, a predecessor of SAP. He managed the IBM 700 series engineering during the design of the IBM 703,704, 705, and the start of the 709. He joined IBM Research when it began in 1955 and directed work in computer theory and experimental computer design. In 1961, he joined the Data Systems Division to start a group that, among other things, designed IBM’s first two timesharing systems, QWIKTRAN and CPS, and accomplished the initial design of the PL/I language. His patents on the arithmetic unit of the 701 and on the variable-word-size architecture of the tape processing machine earned him an Outstanding Invention Award from IBM. He has served on government panels on air defense, antisubmarine warfare, cryptanalysis, and air traffic control. At M.I.T., Mr. Rochester received a B.S. in electrical engineering in 1941 and was elected a member of Tau Beta Pi and Sigma XI; in 1958 he was a Visiting Professor; and currently he is a Visiting Scientist there. Mr. Rochester is a Fellow of the Institute of Electrical and Electronics Engineers.

At the end, the 1955 proposal listed several people who would be interested in attending the event. Amongst these were six IBMers: John Backus, Alex Bernstein, W. L. Duda, Herbert Gelernter, Nathaniel Rochester, and David Sayre. WOW!

References:

  1. http://www-formal.stanford.edu/jmc/history/dartmouth.html
  2. Rochester, Nathaniel and H. L. Gelernter, “Intelligent Behavior in Problem-Solving Machines” IBM Journal of Research and Development 2:4 (October 1958): 336-345.
  3. Rochester, N., Holland, J.H., Haibt L.H. and Duda, W.L. (1956). Tests on a Cell Assembly Theory of the Action of the Brain Using a Large Digital Computer, IRE Transaction of Information Theory IT-2:80-93
  4. http://www.library.rochester.edu/index.cfm?page=3228

Filed Under: Brain-inspired Computing, Interesting People

  • « Go to Previous Page
  • Go to page 1
  • Interim pages omitted …
  • Go to page 44
  • Go to page 45
  • Go to page 46
  • Go to page 47
  • Go to page 48
  • Go to Next Page »

Primary Sidebar

Recent Tweets

  • Fundamental Principle: Nature Abhors Gradients. https://t.co/KI2CRhWJdRover a year ago
  • The TrueNorth Journey https://t.co/XnpDScCAUV @IBMResearchover a year ago
  • Inspiration: "No great thing is created suddenly" - Epictetusover a year ago
  • IEEE Computer Cover Feature — TrueNorth: Accelerating From Zero to 64 Million Neurons in 10 Years @IBMResearch… https://t.co/4fvYk2JCPTover a year ago
  • "In 2012, computer scientist Dharmendra Modha used a powerful supercomputer to simulate the activity of more than 5… https://t.co/Sz17XsG5h5over a year ago
  • Management Tip: Team success is AND, not OR.over a year ago
  • The creation of the electronic brain https://t.co/wBKjGtqkvi via @issuu See page 39 onwards ... @IBMResearchover a year ago
  • Creativity Tip: Beeline to problem, spiral to solution.over a year ago
  • PREPRINT: Low Precision Policy Distillation with Application to Low-Power, Real-time Sensation-Cognition-Action Loo… https://t.co/WZHmGS5AxJover a year ago
  • "The power and performance of neuromorphic computing is far superior to any incremental solution we can expect on a… https://t.co/B2k9ZznHIJover a year ago

Recent Posts

  • Jobs in Brain-inspired Computing
  • Neuromorphic scaling advantages for energy-efficient random walk computations
  • Discovering Low-Precision Networks Close to Full-Precision Networks for Efficient Inference
  • Exciting Opportunities in Brain-inspired Computing at IBM Research
  • The TrueNorth Journey: 2008 – 2018 (video)

Archives by Month

  • 2022: Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
  • 2020: Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
  • 2019: Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
  • 2018: Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
  • 2017: Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
  • 2016: Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
  • 2015: Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
  • 2014: Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
  • 2013: Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
  • 2012: Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
  • 2011: Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
  • 2010: Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
  • 2009: Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
  • 2008: Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
  • 2007: Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
  • 2006: Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec

Evolution: Brain-inspired Computing

Copyright © 2023