Hardware-Acceleration of Automated Vehicle Telematics

Please join us for our next meetup taking place on April 24th at Plug and Play.

OmniSci is the pioneer in GPU-accelerated analytics, redefining speed and scale in big data querying and visualization. The platform is used to find insights in data beyond the limits of mainstream analytics tools.

The OmniSci Community team hacked a Modern F1 video game for a company Grand Prix, collecting the same basic telemetry data that real cars do and pulling that dataset into an immersive demo. With the video game, they were able to collect data from tracks, weather, cars, and drivers from the immersive driving rig that was set up in office, with a wheel and pedal. Meetup attendees will get a walk-through of how we did it and then get to experience the racing rig firsthand and shown how the telemetry data they've created is streamed into our OmniSci platform.

Transcript

1. Hardware-Acceleration of Automated Vehicle Telematics Silicon Valley Automotive Open Source | Sunnyvale | April 24, 2019
2. © OmniSci 2018 @_arw_ aaron@omnisci.com /in/aaronwilliams/ /williamsaaron slides: https://speakerdeck.com/omnisci Aaron Williams VP, Global Community
3. © OmniSci 2018 © OmniSci 2018
4. © OmniSci 2018 Telematics Challenges said the biggest challenge is data utilization 48% * “2016 Telematics Patterns, Trends and Challenges” http://fleetanswers.com/sites/default/files/2016%20Telematics%20Survey%20Report_0.pdf
5. © OmniSci 2018 Telematics Challenges Majority of respondents only occasionally use telematics data for decision making * “2016 Telematics Patterns, Trends and Challenges” http://fleetanswers.com/sites/default/files/2016%20Telematics%20Survey%20Report_0.pdf
6. V. A. S. T. VOLUME | AGILITY | SPATIO-TEMPORAL
7. The Fastest Software Designed for the Fastest Hardware HARNESS GPUs
8. © OmniSci 2018 8 * open source for single node github.com/omnisci/mapd-core
9. © OmniSci 2018 US Ships 11B Ship Telemetry Points public demo: https://www.omnisci.com/demos/ships/
10. © OmniSci 2018 NYC Taxis 1B Taxi Rides + 1M Buildings public demo: https://omnisci.com/demos/taxis/
11. © OmniSci 2018 11 GPU Parallelism Drives Fast Analytics at Scale High Memory Bandwidth Native Rendering Pipeline Supercomputer Processing
12. © OmniSci 2018 12 Fast Hardware ( ) + Fast Software 3-Tier Memory Caching Query Compilation In-Situ Rendering
13. © OmniSci 2018 13 SSD or NVRAM STORAGE (L3) 250GB to 20TB 1-2 GB/sec CPU RAM (L2) 32GB to 3TB 70-120 GB/sec GPU RAM (L1) 24GB to 256GB 1000-6000 GB/sec Hot Data Speedup = 1500x to 5000x Over Cold Data Warm Data Speedup = 35x to 120x Over Cold Data Cold Data COMPUTE LAYER STORAGE LAYER Data Lake/Data Warehouse/System Of Record Advanced Memory Management
14. © OmniSci 2018 Vehicle Telematics Analysis for Carmakers Analytics Challenges Scale and speed of telematics data overwhelms mainstream platforms Data-driven collaboration across the supply chain is difficult “The Last Yard” of tech adoption blocks desired business insights OmniSci Solutions Spatiotemporal analysis at a scale to capture insights from millions of cars OmniSci’s open source core eases data integration Ease of adoption speeds broad uptake, for rapid ROI 14
15. © OmniSci 2018 “We use OmniSci on-the-fly to investigate all the features and how they affect the output. We’re doing that with over 500 million points.” DR. ZACH IZHAM, PROJECT MANAGER, VW DATA:LAB
16. © OmniSci 2018 F1 Racing Demo Real-time Vehicle Telematics blog post: https://www.omnisci.com/blog/collecting-telematics-data-from-the-omniSci-grand-prix
17. © OmniSci 2018 F1 Racing Demo Real-time Vehicle Telematics Using Open Source Tools public repo: https://github.com/omnisci/vehicle-telematics-analytics-demo
18. © OmniSci 2018
19. © OmniSci 2018 Step 1: Data Engineering and ETL 3 pipelines • UDP to Kafka • Parse to JSON • Data Refinement (and insertion into OmniSci using JDBC)
20. © OmniSci 2018 Step 2: Querying and Visualization Plotly Dash using pymapd • Queries every 5-15 seconds • No indexing means the data is instantly available
21. © OmniSci 2018 Step 3: Create Your Own s3://mapd-cloud/DataSets/vehicle_telematics_dataset_f12018/ We’ve made the data available for the community Please copy the data rather than direct linking
22. © OmniSci 2018 © OmniSci 2018 • omnisci.com/demos Play with our live demos for yourself! • omnisci.cloud Get an OmniSci instance in 60 seconds • omnisci.com/platform/downloads/ Download a 30-day trial of OmniSci • community.omnisci.com Ask questions and share your experiences OmniSci Self Discovery
23. © OmniSci 2018 @_arw_ aaron@omnisci.com /in/aaronwilliams/ /williamsaaron slides: https://speakerdeck.com/omnisci Aaron Williams VP, Global Community Thank you!