Ultra-Low Power Probabilistic IMT Neurons for Stochastic Sampling Machines

  • Authors:
    Matthew J. Jerry (Univ. of Notre Dame), Abhinav Parihar (Georgia Tech), Benjamin Grisafe (Univ. of Notre Dame), Arijit Raychowdhury (Georgia Tech), Suman Datta (Univ. of Notre Dame)
    Publication ID:
    P090177
    Publication Type:
    Paper
    Received Date:
    1-Feb-2017
    Last Edit Date:
    3-Feb-2017
    Research:
    2698.001 (University of Notre Dame)

Abstract

Stochastic sampling machines (SSM) utilize neural sampling from probabilistic spiking neurons to escape local minima and prevent overfitting of training datasets. This enables improved error rates compared to deterministic implementations, and, in turn, enables lower bit precision, decreased chip area, and reduced energy consumption. In this work, we experimentally demonstrate: (i) Insulator-to-Metal Phase Transition (IMT) neurons with record low peak operating power of 11.9μW at VDD=0.7V; (ii) the IMT in vanadium dioxide (VO2) provides a natural probabilistic hardware substrate for realizing a compact stochastic IMT neuron for SSMs; (iii) implementation of SSM for pattern recognition on MNIST database using experimentally calibrated device modeling. These results are compared to a 22nm CMOS ASIC which shows stochastic IMT neuron based SSMs result in a 4.5x reduction in system power consumption.

4819 Emperor Blvd, Suite 300 Durham, NC 27703 Voice: (919) 941-9400 Fax: (919) 941-9450