Project Claw

School pet project on real-time data analysis. Handouts: http://urbangaming.cz/share/claw.pdf

Transcript

1. project Claw PV243 Advanced Java technologies Michal Karm Babacek Faculty of Informatics, Masaryk University 2014-06-18 ver.: git commit b5909b5, 2014-06-18, by Karm, karm@email.cz
2. project Claw Michal Karm Babacek What is it good for? Technologies Success vs. Failure Outlook References Outline 1 What is it good for? 2 Technologies 3 Success vs. Failure 4 Outlook 5 References 2 / 13
3. project Claw Michal Karm Babacek What is it good for? Technologies Success vs. Failure Outlook References Mission • Intelligence gathering • Real-time data mining • Supervised machine learning • Possibly inspired by Palantir n • ...on a microscopic scale 3 / 13
4. project Claw Michal Karm Babacek What is it good for? Technologies Success vs. Failure Outlook References Mission • Intelligence gathering • Real-time data mining • Supervised machine learning • Possibly inspired by Palantir n • ...on a microscopic scale 3 / 13
5. project Claw Michal Karm Babacek What is it good for? Technologies Success vs. Failure Outlook References Mission • Intelligence gathering • Real-time data mining • Supervised machine learning • Possibly inspired by Palantir n • ...on a microscopic scale 3 / 13
6. project Claw Michal Karm Babacek What is it good for? Technologies Success vs. Failure Outlook References Mission • Intelligence gathering • Real-time data mining • Supervised machine learning • Possibly inspired by Palantir n • ...on a microscopic scale 3 / 13
7. project Claw Michal Karm Babacek What is it good for? Technologies Success vs. Failure Outlook References Mission • Intelligence gathering • Real-time data mining • Supervised machine learning • Possibly inspired by Palantir n • ...on a microscopic scale 3 / 13
8. project Claw Michal Karm Babacek What is it good for? Technologies Success vs. Failure Outlook References Tech — overview, P2P 4 / 13
9. project Claw Michal Karm Babacek What is it good for? Technologies Success vs. Failure Outlook References Tech — data collection 5 / 13
10. project Claw Michal Karm Babacek What is it good for? Technologies Success vs. Failure Outlook References Tech — in memory cache 6 / 13
11. project Claw Michal Karm Babacek What is it good for? Technologies Success vs. Failure Outlook References Tech — cache store 7 / 13
12. project Claw Michal Karm Babacek What is it good for? Technologies Success vs. Failure Outlook References Tech — hibernate seach 8 / 13
13. project Claw Michal Karm Babacek What is it good for? Technologies Success vs. Failure Outlook References Tech — ML Weka 9 / 13
14. project Claw Michal Karm Babacek What is it good for? Technologies Success vs. Failure Outlook References Tech — real-time visuals 10 / 13
15. project Claw Michal Karm Babacek What is it good for? Technologies Success vs. Failure Outlook References Implemented — small pilot 11 / 13
16. project Claw Michal Karm Babacek What is it good for? Technologies Success vs. Failure Outlook References Outlook • Play with Weka and integrate it • Add more data sources • Visualize with Processing • OpenShift • Docker? 12 / 13
17. project Claw Michal Karm Babacek What is it good for? Technologies Success vs. Failure Outlook References References Infinispan infinispan.org WildFly wildfly.org Hibernate — search hibernate.org/search Weka cs.waikato.ac.nz/ml/weka Palantir palantir.com Processing processing.org Mongo DB mongodb.org Postgre SQL postgresql.org Twitter API dev.twitter.com 13 / 13