• Skip to main content
  • Skip to primary sidebar

Dharmendra S. Modha

My Work and Thoughts.

  • Brain-inspired Computing
    • Collaborations
    • Videos
  • Life & Universe
    • Creativity
    • Leadership
    • Interesting People
  • Accomplishments
    • Prizes
    • Papers
    • Positions
    • Presentations
    • Press
    • Profiles
  • About Me

Archives for 2017

Spiking Optical Flow for Event-based Sensors Using IBM’s TrueNorth Neurosynaptic System

October 28, 2017 By dmodha

A new paper posted to arXiv: Spiking Optical Flow for Event-based Sensors Using IBM’s TrueNorth Neurosynaptic System.

Abstract:

This paper describes a fully spike-based neural network for optical flow estimation from Dynamic Vision Sensor data. A low power embedded implementation of the method which combines the Asynchronous Time-based Image Sensor with IBM’s TrueNorth Neurosynaptic System is presented. The sensor generates spikes with sub-millisecond resolution in response to scene illumination changes. These spike are processed by a spiking neural network running on TrueNorth with a 1 millisecond resolution to accurately determine the order and time difference of spikes from neighboring pixels, and therefore infer the velocity. The spiking neural network is a variant of the Barlow Levick method for optical flow estimation. The system is evaluated on two recordings for which ground truth motion is available, and achieves an Average Endpoint Error of 11% at an estimated power budget of under 80mW for the sensor and computation.

Filed Under: Brain-inspired Computing, Collaborations

Video of Keynote (Commencement Speech) at 2017 UCSD School of Engineering Ring Ceremony

October 26, 2017 By dmodha

Filed Under: Accomplishments, Creativity, Leadership, Life & Universe, Presentations

Brain-inspired Computing Video Gallery

October 20, 2017 By dmodha

«
Prev
1
/
3
Next
»
loading
play
Cognitive Computing: The SyNAPSE Project
play
Neural Networks: TrueNorth - IBM's Fast, Tiny, and Ultra Power-Efficient Neural Network ASIC!
play
IBM Seeks to Build the Computer of the Future Based on Insights from the Brain
play
A new software ecosystem for cognitive systems
play
IBM SyNAPSE Deep Dive Part 1
play
IBM's new Synapse chip | Engadget
play
IBM's "Brain" Guy: Dharmendra Modha
play
Dharmendra Modha of IBM on Whole Brain Emulation
play
This IBM Chip Computes Like The Human Brain with Very Little Power
play
Meet the Researcher: My Vision for IBM's AI Supercomputing System
play
IBM SyNAPSE Deep Dive Part 2
play
LLNL partners with IBM on brain-like computing chip
play
Brain-inspired Computing: A Decade-Long Journey
play
IBM SyNAPSE Deep Dive Part 3
play
IBM SyNAPSE Deep Dive Part 4
«
Prev
1
/
3
Next
»
loading

Filed Under: Brain-inspired Computing, Videos

IBM demos event-based gesture recognition using a brain-inspired chip at CVPR 2017

October 19, 2017 By dmodha

Please see a blog post by Brian Taba on our CVPR 2017 paper “A Low Power, Fully Event-Based Gesture Recognition System“.  Here is PDF of the paper “A Low Power, Fully Event-Based Gesture Recognition System“.  Video of the system in action follows:

Filed Under: Accomplishments, Brain-inspired Computing, Papers

Keynote Speech at the Ring Ceremony at UCSD’s Jacobs School of Engineering

June 26, 2017 By dmodha

Dharmendra S Modha Giving the Talk

Photo Credit: Hita Bambhania-Modha

On June 17, 2017, Dean Al Pisano invited me to present the Keynote Speech at the Ring Ceremony at UCSD’s Jacobs School of Engineering. Enclosed is a transcript of my remarks.

Congratulations class of 2017!

I am honored to share this pivotal day in your life
with you, your families, and your friends.
And I want to thank Dean Pisano for inviting me here,
as well as the distinguished faculty and my UCSD mentors
who have all helped shape who I am today.

As you graduate from the Engineering school,
there is a blank canvas in front of you.
The space of that canvas is the Earth and its vicinity,
and the time of the canvas is your individual life span.
On this blank canvas,
we engineer, not only, devices, materials, systems, structures, and processes,
but we also engineer
our own careers and lives,
so as to manifest strength, utility, and beauty.

The recipe for success, I believe, is three-fold:

  • first, identify external gradients towards your inner purpose;
  • second, capitalize on inherent opportunities presented by these gradients
    using your most authentic self;
  • and, lastly, engineer the means for exploiting these gradients
    while fighting
    the chief villain in our lives,
    namely, the 2nd Law of thermodynamics.

First, let us talk about gradients.

A gradient or an imbalance
is simply a difference across a distance.
For example, think of differences in
temperature, pressure, chemical concentration, voltage, incomes, etc.
The gradients are the sources of opportunity.
When yoda from starwars said, “Feel the force”,
He meant, “Feel the gradients.”
A water wheel
converts the energy gradient
of water flowing from high to low
into useful work.
Similarly, our intent is to harness the external gradients
that exist in the society and the universe—
social, economic, political, technological, physical gradients—
to create beneficial structures
and to manifest constructive complexity.
Unlocking and harnessing these gradients
requires us to apply
the infinite and inexhaustible tools of
creativity, awareness, and imagination
while leading us to discovering and extending
the frontiers of mathematics, science, and technology in the process.
In my case,
the gradient that led to the notion of brain-inspired computers
was the observation
that there was a billion-fold disparity between the function, the size, the energy, and the speed of the brain as compared to today’s computers.

Second, let us talk about purpose.

Discovery of external frontiers,
first and foremost,
starts with the internal discovery
of our own authentic self.
From this place of inner integrity,
we pick problems of universal importance
and establish audacious goals to solve them
while matching these goals to our specific individual gifts.
We then work backwards from the end goals
and chart a course to achieve these goals.
As facts change,
we never compromise on the destination
but continually revise the path.
In any situation,
we do not react
but rather we consciously act
because there is always room for creative response.
In every moment,
in every interaction,
in every relationship,
we bring all the positivity of our entire existence to bear —
and then we do it again
and again
and again.
To truly win,
we put not just our skin in the game—
rather, we put our soul in the game.
While it’s important to strive to succeed at work,
it’s equally important to maintain work-life balance
and choose an inner state of happiness
despite life’s paradoxes and challenges.
And, regardless of success or failure,
we win, personally, by finishing what we start.
By graduating,
all of you have demonstrated
that you are winners!

Lastly,
let us talk about the villain.

The 2nd Law of thermodynamics essentially says that if a hot room is connected to a cold room then over time the temperature difference will disappear.
So, the 2nd Law of thermodynamics
serves to efface all gradients over time
leaving increased entropy,
random motion,
chaos,
and disorder
behind.
Left to its own un-engineered devices,
the 2nd Law will produce only heat and waste.
It is not possible,
regrettably,
to fight or defy the second law
at a global, macroscopic level,
but within the confines of local space and time
it is indeed possible
to engineer means
by which gradients produce useful work.
Some engineer
had to purposefully do the hard work
of inventing and perfecting
the waterwheel
to exploit the potential energy of water
that otherwise would have remained stagnant.
The 2nd Law will have its way eventually.
The waterwheel, for example, requires maintenance
to keep running
and ultimately will decay and descend into ruin.
But while it lasts,
it will enhance human life
and perhaps
serve as a step stone
to greater progress.
This is the eternal essence of engineering.
This is why
fighting the 2nd law is
so worthwhile.
The ring,
in my mind,
symbolizes our resolve
to courageously stand up
to the 2nd Law in all its manifestations.

So, in conclusion,
next time
that we meet the 2nd Law of thermodynamics,
let us rub our magic rings,
and let us look at the 2nd Law in the eye,
and say,
not today,
my friend,
you are dealing
with a graduate
of the UCSD’s Jacobs School of Engineering!

Congratulations again, my friends,
and I wish you the very best of luck!
Thank you!

Filed Under: Accomplishments, Creativity, Leadership, Life & Universe, Presentations

  • Page 1
  • Page 2
  • Go to Next Page »

Primary Sidebar

Recent Posts

  • Breakthrough low-latency, high-energy-efficiency LLM inference performance using NorthPole
  • Breakthrough edge AI inference performance using NorthPole in 3U VPX form factor
  • NorthPole in The Economist
  • NorthPole in Computer History Museum
  • NorthPole: Neural Inference at the Frontier of Energy, Space, and Time

Archives by Month

  • 2024: Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
  • 2023: Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
  • 2022: Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
  • 2020: Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
  • 2019: Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
  • 2018: Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
  • 2017: Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
  • 2016: Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
  • 2015: Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
  • 2014: Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
  • 2013: Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
  • 2012: Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
  • 2011: Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
  • 2010: Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
  • 2009: Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
  • 2008: Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
  • 2007: Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
  • 2006: Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec

Copyright © 2025