Big Data Introduction - Café Numérique Bruxelles

General introduction to Big Data terms and technologies: Velocity, Volume, Variety (3V) and Veracity (4V), NoSQL, Data Science, main data stores (key-value, column, document, graph), Elasticsearch, ...
Presentation of data.be products leveraging Big Data & Elasticsearch

Transcript

1. Big Data Introduction
2. About Me Eric Rodriguez Founder of data.be ! • Web entrepreneur • Data addict • Multi-Language: PHP, Java/ Groovy/Grails, .Net, … be.linkedin.com/in/erodriguez ! github.com/wavyx ! @wavyx
3. Big? Data!
4. Big Data is like teenage sex Everyone talks about it Nobody really knows how to do it Everyone thinks everyone else is doing it So everyone claims they are doing it… Quote: Dan Ariely
5. 3V - Volume, Variety, Velocity
6. Source: http://pennystocks.la/internet-in-real-time/
8. Variety of Data
9. • Health & Body sensors • Smart Home • Smart City • Industry applications • Environment
10. Health & Body Sensors Source: http://postscapes.com/internet-of-things-examples/
11. Smart Home Source: http://postscapes.com/internet-of-things-examples/
12. Smart Cities Source: http://postscapes.com/internet-of-things-examples/
13. Industry Source: http://postscapes.com/internet-of-things-examples/
14. Environment Source: http://postscapes.com/internet-of-things-examples/
15. The rise of Data Science
17. NoSQL
18. Big Data Landscape 2.0
19. Keep Calm and Big Data
20. Big Data Tools
21. Technologies Source:
22. Not Only SQL Key-Value Column Document Graph
23. real time, search and analytics engine open-source Lucene JSON schema free document
 store RESTful API documentation scalability high availability distributed multi tenancy per-operation
 persistence
24. Elasticsearch core • Apache Lucene is a high-performance, full-featured text search engine library written entirely in Java • Elasticsearch added value: “Simple is best” • Simple API (with documentation) • JSON & RESTful • Sharding & Replication • Extensibility: plugins and scripts • Interoperability: clients and integrations
25. Use Cases • Full-Text Search • Data Store • Analytics • Alerts • Ads • …
26. 4V - Veracity !
27. 4V - Veracity !
28. From Big Data to Value Wisdom! Knowledge! Information! Data!
29. HOW TO FIND RELEVANT COMPANY INFORMATION ?
30. BEFORE...
31. WHY IS IT SO HARD TO FIND COMPREHENSIVE INFORMATION ?
32. AFTER !
33. COMPANY PAGE
34. • VAT Validity • Company Information • Geographic Search • European VAT Check API.DATA.BE
35. PUBLICATION SEARCH
36. Thank you! eric@data.be be.linkedin.com/in/erodriguez @wavyx