GPU-ACCELERATED VISUALIZATION: INTERACTIVE EXPLORATORY DATA ANALYSIS AT SCALE

MapD's open source GPU database and Immerse visualization platform leverages the massive parallelism and memory bandwidth of multiple GPUs to execute SQL queries and render complex visualizations with billions of rows in milliseconds. Participants will get to experience firsthand the power of GPUs with instantaneous interaction.

Transcript

1. © MapD 2018 GPU-ACCELERATED VISUALIZATION Interactive Exploratory Data Analysis at Scale General Assembly, Santa Monica Veda Shankar, MapD | Sept 17, 2018
2. © MapD 2018 Veda Shankar Sr Developer Advocate , MapD Community veda.shankar@mapd.com slides: https://speakerdeck.com/mapd
3. © MapD 2018 Data Analytics Integral to Business
4. © MapD 2018 Why the Gap Between Expectations and Results?
5. © MapD 2018 Workarounds Can’t Keep Up with Data Growth
6. © MapD 2018 Core Density Makes a Huge Difference
7. © MapD 2018 Advanced Memory Management Three-tier caching to GPU RAM for speed and to SSDs for persistent storage 7 SSD or NVRAM STORAGE (L3) 250GB to 20TB 1-2 GB/sec CPU RAM (L2) 32GB to 3TB 70-120 GB/sec GPU RAM (L1) 24GB to 256GB 1000-6000 GB/sec Hot Data Speedup = 1500x to 5000x Over Cold Data Warm Data Speedup = 35x to 120x Over Cold Data Cold Data COMPUTE LAYER STORAGE LAYER Data Lake/Data Warehouse/System Of Record
8. © MapD 2018 The Analytics Platform Designed for GPU Computing
9. © MapD 2018 MapD System Architecture
10. © MapD 2018 MapD Core: Query Compilation with LLVM
11. © MapD 2018 MapD Immerse: Hybrid Rendering
12. © MapD 2018 © MapD 2018 1 2 DEMO: Discover Insights With MapD Immerse
13. © MapD 2018 MapD 4.0 : Geospatial Highlights
14. © MapD 2018 Geospatial Objects POINT A point described by two coordinates POLYGON A set of one or more rings (closed linestrings), with the first representing the shape (external ring) and the rest representing holes in that shape (internal rings) LINESTRING A sequence of 2 or more points and the lines that connect them MULTIPOLYGON A set of one or more polygons
15. © MapD 2018 Supported Geo File Formats Type Description GeoJSON Uses the JavaScript Object Notation (JSON) open data standard for storing geographical features as key-value pairs. ESRI Shapefile Consists of a group of files (.shp, .shx, .dbf etc) that need to be stored in the same directory or part of a zip file. The .shp file contains the feature geometry itself. KML Keyhole Markup Language is based on XML, using tag-based structure with nested elements and attributes to store geographic data. CSV/TSV with WKT Well Known Text (WKT) is a text markup language for representing vector geometry objects on a map.
16. © MapD 2018 Geospatial Functions Spatial Relationship and Measurement Functions ST_Distance ST_Contains Returns shortest planar distance between geometries. Returns shortest geodesic distance between geographies (in meters, limited support) . Returns true if first geometry contains the second one.
17. © MapD 2018 © MapD 2018 1 7 DEMO: Geospatial Features
18. © MapD 2018 The GPU Open Analytics Initiative (GOAI) Seamless data interchange framework in GPU memory 1 8
19. © MapD 2018 The GPU Open Analytics Initiative (GOAI) Creating common data frameworks to accelerate data science on GPUs 1 9 /mapd/pymapd /gpuopenanalytics/pygdf
20. © MapD 2018 • We’ve published a few notebooks showing how to connect to a MapD database and use an ML algorithm to make predictions 20 Github ML Examples https://github.com/mapd/mapd-ml-demo
21. © MapD 2018 Categories of common MapD use cases 2 1 Operational Analytics • Thwart Banking Fraud • Scan for Cyber Threats • Fine-tune Advertising • Maintain the Utility Grid Geospatial Analytics • Monitor Networks • Ready Logistics • Forecast Micro-weather Data Science • Model Financial Markets • Predict Maintenance • Predict Staffing Levels
22. © MapD 2018 © MapD 2018 • community.mapd.com Ask questions and share your experiences • mapd.com/cloud Try 14-day free trial, no credit card needed • mapd.com/demos Play with our demos • mapd.com/platform/download-community/ Get our free Community Edition and start playing 22 Next Steps
23. © MapD 2018 THANK YOU Any questions?