MongoNYC 2012: Now, How Do I Report and Analyze Against MongoDB?

MongoNYC 2012: Now, How Do I Report and Analyze Against MongoDB? James Dixon, Pentaho. MongoDB presents many benefits and holds great promise but it’s ultimate success will be based on mass adoption. This requires a whole product approach where data management and business analytic professionals that are used to working with relational sources can just as easily work with MongoDB. In this talk, I'll will present examples illustrating how one graphical design tool can be used for both environments with no coding involved:
Moving data into and out of MongoDB Instant Analytics and Reporting on top of MongoDB Job Orchestration – workflow, scheduling and error detection for MongoDB processes
All this will be done using a graphical design tool, without writing a single line of code. No prior knowledge or experience of MongoDB is required to follow this session. Everything show will be open source or 'free to use' software.

Transcript

1. © 2012, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-7555 Now, How Do I Report and Visualize Against MongoDB? May 23rd, 2012 James Dixon Lord of the 1’s and 0’s, Pentaho
2. © 2012, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-7555 2 Challenge #1: Bigness
3. © 2012, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-7555 Big Data Can Be Very Big 3
4. © 2012, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-7555 4 Challenge #2: Us
5. © 2012, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-7555 5 © 2012, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-7555 The Human Brain Is Very Small
6. © 2012, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-7555 6 © 2012, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-7555 How do we fit this into this?
7. © 2012, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-7555 7 © 2012, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-7555 We can’t (and survive)
8. © 2012, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-7555 Challenge #3: Importance 8
9. © 2012, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-7555 9 © 2012, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-7555 Every transaction is important
10. © 2012, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-7555 10 © 2012, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-7555 Every log entry/machine data blip is not
11. © 2012, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-7555 3 problems 1 solution 11
12. © 2012, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-7555 We Need Aggregation 12
13. © 2012, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-7555 Challenge #4: Future 13
14. © 2012, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-7555 14 We’ve been aggregating for years Tape/Trash Data Source Data Mart
15. © 2012, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-7555 15 Tape/Trash Data Source ? ? ? ? ? ? ? Data Mart We’ve been aggregating for years
16. © 2012, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-7555 We Need Ad-hoc Aggregation 16
17. © 2012, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-7555 17 Challenge #5: Us Again
18. © 2012, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-7555 18 We have short attention spans
19. © 2012, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-7555 19 5 Second Rule
20. © 2012, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-7555 20 We Need Fast Ad-Hoc Aggregation
21. © 2012, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-7555 21 Challenge #6: Tools
22. © 2012, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-7555 22 Query
23. © 2012, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-7555 23 Language Query
24. © 2012, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-7555 24 Structured Language Query
25. © 2012, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-7555 25 SQL Was Never The Problem No-SQL No-Baggage
26. © 2012, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-7555 26 We Need Fast Ad-Hoc Aggregation Using SQL
27. © 2012, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-7555 27 Challenge #7: Us Again, Again
28. © 2012, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-7555 28 © 2012, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-7555 We need help and guidance
29. © 2012, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-7555 29 We Need Fast Ad-Hoc Aggregation Using SQL With Metadata-based Assistance
30. © 2012, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-7555 30 Challenge #8: Moola
31. © 2012, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-7555 31 We Need Fast Ad-Hoc Aggregation Using SQL With Metadata-based Assistance For Less Than $Gazillion
32. © 2012, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-7555 32 Challenge #9: Reality
33. © 2012, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-7555 33 © 2012, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-7555 Your Paddle
34. © 2012, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-7555 34 Solution #1: Time Machine
35. © 2012, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-7555 35 Patience, Young Jedi
36. © 2012, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-7555 36 Great Things Are Afoot
37. © 2012, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-7555 37 Solution #2: Pragmatism
38. © 2012, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-7555 38 Do What’s Doable • Parameterized Reporting • Batch aggregation • ETL • Hybrid Architectures
39. © 2012, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-7555 39 Op#mize Visualize Load Applica'ons  &  Systems App Tier RDBMS Big Data Repor'ng  /  Dashboards  /  Analysis MongoDB DM  &  DW
40. © 2012, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-7555 40 What’s Doable Today? Reading data from MongoDB •Preview •Enrich •Write to files/databases
41. © 2012, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-7555 41 Demo 1
42. © 2012, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-7555 42 Demo 1 FAQ What is this stuff? •Pentaho Data Integration (kettle) It looks expensive. Is it? •Open source •Cross-platform Where can I get it? •Let me Google that for you
43. © 2012, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-7555 43 Using an ETL tool and a Report Designer: •Simple Reporting •Parameterized Reporting What’s Doable Today?
44. © 2012, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-7555 44 Demo 2
45. © 2012, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-7555 45 Demo 2 FAQ What is this stuff? •Pentaho Report Designer It looks even more expensive. Is it? •Still open source •Cross-platform Where can I get it? •Let me Google that for you
46. © 2012, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-7555 46 •Merge with other data sources •Web-based visualization What’s Doable Today?
47. © 2012, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-7555 47 Demo 3
48. © 2012, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-7555 48 Demo 3 FAQ What is this stuff? •Pentaho Data Integration (kettle) •Pentaho Enterprise Edition It looks really expensive. Is it? •Free on desktop. •Server is subscription
49. © 2012, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-7555 Challenges of Reporting and Visualizing Big Data May 23rd, 2012 James Dixon Lord of the 1’s and 0’s, Pentaho