AI on the Edge

017286889e25c87cb44b20ceca2d1d79?s=47 Daron Yondem
September 05, 2019

AI on the Edge

I presented this deck at Global AI Nights Istanbul. The deck is about running containerized AI logic on edge devices through Azure IoT Hub and IoT Edge Runtime.

017286889e25c87cb44b20ceca2d1d79?s=128

Daron Yondem

September 05, 2019
Tweet

Transcript

  1. Daron Yöndem http://daron.me @daronyondem

  2. An edge that’s intelligent and cloud-enabled. That’s the future as

    we see it.
  3. Cloud : Globally available, unlimited compute resources IoT : Harnessing

    signals from sensors and devices, managed centrally by the cloud Edge : Intelligence offloaded from the cloud to IoT devices AI : Breakthrough intelligence capabilities
  4. Azure IoT Hub Azure IoT Suite Microsoft IoT Central Windows

    10 IoT Core Supports the languages and frameworks you already know Management NUI Edge compute Fully managed and hosted by Microsoft Coming soon Remote monitoring Predictive maintenance Connected factory Secure, scalable PaaS For connecting any device running any OS
  5. Cold Path: Azure Machine Learning • Build powerful, cloud-based machine

    learning applications • Quickly create and deploy analytics models with ready-to-use algorithms libraries • Includes hundreds of R and Python build-in packages in addition to supporting custom code. Hot Path: Azure Stream Analytics • Analyze real-time and on demand data to power intelligent actions • Easy to set up with SQL-like language • Connects directly to Azure IoT Hub for stream ingestion and hot path analysis Warm Path: Azure Time Series Insights • Visualize IoT time series data in near real time • Easy to get started with no up-front data modeling required • Customize your own solution via REST query APIs
  6. Straightforward Business Logic Smart Building Protocol Translation Industrial IoT Adapters

    Autonomous Driving Straightforward Filtering Batch Data Processing Home Automation Hubs Smart Meeting Solutions w/ People Recognition Custom Code Requirements Reliability Requirements Low Medium High Low Portable Modules / Functions Medium E.g.: Custom Code in Containers High E.g.: ML/DNNs in Containers
  7. IoT Hub Device Twin Device Twin Device Twin Device Twin

    Device Twin Device Twin Device Twin Device Twin Device Twin Device Twin Device Twin Device Twin Device Twin Device Twin Device Twin Device Twin Device Twin Device Twin Device Twin Device Twin Jobs Schedule and Broadcast Device Twin Changes Set Desired Properties, Tags, Call Methods Queries Query Across Device Twin State For Business Logic, Reporting and Compliance
  8. • Container based modules • Azure Functions • Azure Stream

    Analytics • Azure Machine Learning • Cognitive Services • Offline / Synchronized Device Twins • Local Storage • Cloud Management & Deployment
  9. Azure IoT Edge IoT Hub Devices Local Storage Azure Machine

    Learning (Container) Functions Runtime Container Management Device Twin Device Twin Azure Stream Analytics (Container) Azure Functions (Container) Cognitive Services (Container) Custom Code (Container) Module Twin Module Twin Module Twin Module Twin Module Twin Module Twin Module Twin Module Twin Module Twin Module Twin
  10. Running ML on Azure Functions on the Edge

  11. None
  12. None
  13. None
  14. None
  15. None
  16. None
  17. None
  18. None
  19. IoT Edge Runtime https://drn.fyi/2k1otsV Azure IoT Tools to VS Code

    https://drn.fyi/2kw6Mlj Azure Functions IoT Edge Deployment https://drn.fyi/2m0Eksm
  20. http://daron.me | @daronyondem Download slides here; http://decks.daron.me