ADDC 2019 - Dan Abdinoor: The NPU Revolution

ADDC 2019 - Dan Abdinoor: The NPU Revolution

Behind the use of artificial intelligence capabilities is a new and foundational piece of technology: the Neural Processing Unit. These AI-only processors are changing the rules for machine learning power and affordability, creating new and ideal conditions for intelligent devices. In this talk, we will explore the history, recent breakthroughs, and future impact, covering everything you need to know about the Age of the NPU.

Recordings & more: https://addconf.com/

Transcript

  1. 2.
  2. 3.

    Newly possible with intelligence • Vision • Voice • Autonomy

    Two Types of AI Solutions Improved with intelligence • Translation • User Input • Storage & Retrieval
  3. 4.
  4. 12.

    Silicon Transistors Vacuum Tubes M icro- processors 16-Bit 32-Bit D

    ual-cores 4-16 Cores 1950 1960 1970 1980 1990 2000 2010 CPU GPU NPU Video signal output Perfectly parallel operations M atrix and vector operations Floating point operations Tensor cores H igh-volum e Low -precision Chronology of Processing Units
  5. 16.
  6. 20.
  7. 28.
  8. 30.

    iPhone Machine Learning Timeline Performance 2015 2016 2017 2018 A9

    iPhone 6S PowerVR GPU +”Hey Siri” + People in Photos A10 Fusion iPhone 7 Apple GPU 6 core 50% faster + Portrait Mode A11 Bionic iPhone 8 + X Apple Neural Engine 2 core 0.6 teraflops + Face ID + Raise to wake A12 Bionic iPhone XS Apple Neural Engine 8 core 5 teraflops + Computational Photography + Developer Access to ANE
  9. 31.
  10. 38.
  11. 46.

    Parkinson's Law Project workloads expand to fill the time allotted

    Abdinoor’s Law Software workloads expand to fill the computing resources available
  12. 47.

    The NPU Revolution? 1. AI solutions 2. Here today 3.

    More designs on the way 4. Transformational