• Skip to main content
  • Skip to primary sidebar

Dharmendra S. Modha

My Work and Thoughts.

  • Brain-inspired Computing
    • Collaborations
    • Videos
  • Life & Universe
    • Creativity
    • Leadership
    • Interesting People
  • Accomplishments
    • Prizes
    • Papers
    • Positions
    • Presentations
    • Press
    • Profiles
  • About Me

Archives for October 2017

Spiking Optical Flow for Event-based Sensors Using IBM’s TrueNorth Neurosynaptic System

October 28, 2017 By dmodha

A new paper posted to arXiv: Spiking Optical Flow for Event-based Sensors Using IBM’s TrueNorth Neurosynaptic System.

Abstract:

This paper describes a fully spike-based neural network for optical flow estimation from Dynamic Vision Sensor data. A low power embedded implementation of the method which combines the Asynchronous Time-based Image Sensor with IBM’s TrueNorth Neurosynaptic System is presented. The sensor generates spikes with sub-millisecond resolution in response to scene illumination changes. These spike are processed by a spiking neural network running on TrueNorth with a 1 millisecond resolution to accurately determine the order and time difference of spikes from neighboring pixels, and therefore infer the velocity. The spiking neural network is a variant of the Barlow Levick method for optical flow estimation. The system is evaluated on two recordings for which ground truth motion is available, and achieves an Average Endpoint Error of 11% at an estimated power budget of under 80mW for the sensor and computation.

Filed Under: Brain-inspired Computing, Collaborations

Video of Keynote (Commencement Speech) at 2017 UCSD School of Engineering Ring Ceremony

October 26, 2017 By dmodha

Filed Under: Accomplishments, Creativity, Leadership, Life & Universe, Presentations

Brain-inspired Computing Video Gallery

October 20, 2017 By dmodha

«
Prev
1
/
3
Next
»
loading
play
Cognitive Computing: The SyNAPSE Project
play
Neural Networks: TrueNorth - IBM's Fast, Tiny, and Ultra Power-Efficient Neural Network ASIC!
play
IBM Seeks to Build the Computer of the Future Based on Insights from the Brain
play
A new software ecosystem for cognitive systems
play
IBM SyNAPSE Deep Dive Part 1
play
IBM's new Synapse chip | Engadget
play
IBM's "Brain" Guy: Dharmendra Modha
play
Dharmendra Modha of IBM on Whole Brain Emulation
play
This IBM Chip Computes Like The Human Brain with Very Little Power
play
Meet the Researcher: My Vision for IBM's AI Supercomputing System
play
IBM SyNAPSE Deep Dive Part 2
play
LLNL partners with IBM on brain-like computing chip
play
Brain-inspired Computing: A Decade-Long Journey
play
IBM SyNAPSE Deep Dive Part 3
play
IBM SyNAPSE Deep Dive Part 4
«
Prev
1
/
3
Next
»
loading

Filed Under: Brain-inspired Computing, Videos

IBM demos event-based gesture recognition using a brain-inspired chip at CVPR 2017

October 19, 2017 By dmodha

Please see a blog post by Brian Taba on our CVPR 2017 paper “A Low Power, Fully Event-Based Gesture Recognition System“.  Here is PDF of the paper “A Low Power, Fully Event-Based Gesture Recognition System“.  Video of the system in action follows:

Filed Under: Accomplishments, Brain-inspired Computing, Papers

Primary Sidebar

Recent Posts

  • Breakthrough low-latency, high-energy-efficiency LLM inference performance using NorthPole
  • Breakthrough edge AI inference performance using NorthPole in 3U VPX form factor
  • NorthPole in The Economist
  • NorthPole in Computer History Museum
  • NorthPole: Neural Inference at the Frontier of Energy, Space, and Time

Archives by Month

  • 2024: Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
  • 2023: Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
  • 2022: Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
  • 2020: Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
  • 2019: Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
  • 2018: Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
  • 2017: Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
  • 2016: Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
  • 2015: Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
  • 2014: Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
  • 2013: Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
  • 2012: Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
  • 2011: Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
  • 2010: Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
  • 2009: Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
  • 2008: Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
  • 2007: Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
  • 2006: Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec

Copyright © 2025