The Most Intriguing Data Scientist in the Universe.

The most intriguing data scientist in the universe just endorsed this kickstarter project which is a complete, practical, hands-on course which comprises of step-by-step video tutorials, a book, practice exercises and downloadable code samples covering everything you need to know about aggregating, processing, searching and visualizing log data generated at high volume and high velocity using only open source software.

Course Contents

# Installing Java and Configuring Environment Variables
# Introduction to Apache Flume Architecture and Inner Workings
# Introduction to Logstash Architecture and Inner Workings
# Downloading, Installing and Configuring Apache Flume
# Downloading, Installing and Configuring Logstash
# Overview of Different Forms of Capturing Application Log Data
# Parsing Raw Data to Extract Metadata and Useful Information
# Strategies and Techniques for Buffering Log Events before Storage
# Using Elasticsearch and HDFS as Centralized Datastores
# Installing and Configuring ElasticSearch
# Setting up Hadoop and Configuring HDFS
# Installing Kibana as a User Interface to the ElasticSearch Indicies
# Moving Log Data into ElasticSearch and HDFS
# Introduction to Hadoop, HDFS and MapReduce
# Using Hadoop to Process the Log data in HDFS with MapReduce jobs
# Introduction to Lucene Query Syntax
# Quering ElasticSearch to Retrieve Information
# Using D3.js to Visualize ElasticSearch Query Results
# Using D3.js to Visualize Results from MapReduce jobs
# Setting up Dashboards in Kibana to Visualize Log Events in Realtime.
# Brining It All Together with Sample Projects
# Design Patterns, Best Practices, Tips and Strategies for Scaling Log data Aggregation, Processing, Searching and Visualization

http://www.kickstarter.com/projects/1368497725/massive-log-data-aggregation-processing-and-visual

Transcript

1. Introducing  …   THE  MOST  INTRIGUING     DATA  SCIENTIST     IN  THE  UNIVERSE  
2. He  is  the  first  man  ever  to  sort   1024  Yo:abytes  of  data  in  just   under  60  seconds.  
3. He  is  known  to  successfully   process  Exabytes  of  data  by   just  recalling  the  MAC   addresses  of  any  device  that   has  ever  come  in  contact  with   the  data.  
4. He  is  so  intriguing  and   capJvaJng,  even  technical   recruiters  plead  with  him  to   recruit  them.  
5. His  breath  smells  like   lavender  with  a  hypnoJzing   hint  of  citrus  
6. When  he  sneezes,  cell  towers   appear,  dead  zones  disappear   and  network  signals  strength   improves  by  at  least  128%   within  a  64-­‐mile  radius  of  his   presence.  
7. His  body  is  full  of  electricity!    
8. He  is  so  electrifying;  if  he  were   to  press  the  power  bu:on  on   any  device,  it  will  come  on   with  or  without  any  visible   source  of  electricity.  
9. His  skin  texture  is  so   intriguing  even  massage   therapists  aspire  to  massage   him  just  to  relieve  their  own   stress.  
10. His  goatee  has  encountered   more  data  molecules  and   caffeine  from  energy  drinks   than  any  other  data  scienJst   would  experience  in  their   enJre  career.  
11. When  he  gives  you   instrucJons  on  how  to   implement  an  algorithm  …  
12. You  never  get  confused  and  in   fact,  you  will  proceed  to  create   soTware  that  is  bug  free  and   even  deliver  at  least  4  days   ahead  of  schedule.    
13. Bugs  are  so  inJmidated  by   his  presence;  when  he   reviews  your  code  they   disappear.  
14. He  does  not  need  any  input   device  such  as  a  keyboard  or   mouse  to  use  his  compuJng   devices.    
15. He  sends  raw  data  directly   from  his  mind  to  the  CPU   and  the  computer   understands  him.  
16. His  personal  trainers  and   doctors  tell  him  that  his   body  weight  and  heart  rate     increase  or  decrease  only  by   powers  of  10    
17. He  eats  extra  spicy  Pad  Thai   for  breakfast  and  usually   drinks  Tabasco  sauce  with   Wasabi  to  cleanse  his   pale:es.  
18. We  rarely  drives  himself,  but   when  he  does,  he  only   drives  on  roads  where  the   speed  limits  are  prime   numbers.  
19. When  he  travels,  he  only   uses  ATMs  that  dispenses   dollar  bills  in  mulJples  of   Infinity.  
20. Please  allow  me  to  introduce…  
21.   THE  MOST  INTRIGUING     DATA  SCIENTIST   IN  THE  UNIVERSE  
22.   ARE  YOU  READY  FOR  THE   COUNTDOWN?  
28. My  friends,  there  are   elements  of  truth  in   everything  you  have  just   read  about  me.    
29. I  can  prove  it  to  you   mathemaJcally.  
30. However,  if  I  were  to  do  so  …  
31. The  amount  of  data  generated   during  the  proof  will  make  the   total  combined  disc  space  at  all  the   data  centers  used  by  Facebook,   Twi:er,  Amazon  and  Google  look   like  mere  floppy  diske:es.  
32. I  have  not  backed  or   recommended  any  Kickstarter   project  to  anyone  unJl  now…  
33. However,  in  my  quest  to   analyze  a  subset  of  acJve   crowd-­‐funded  projects  in  the   universe  …  
34. I  came  across  a  Kickstarter   project  equally  as  intriguing  as   myself.  
35. So,  I  invite  you  to  join  me  in   backing  the  most  intriguing   Kickstarter  project  in  the   universe.      
36. Massive  Log  Data  AggregaJon,   Processing  and  VisualizaJon    
37. Visit     MassiveLogData.com     Show  your  support.   Become  a  sponsor.  
38. Just  in  case  you  are  wondering   who  the  most  intriguing  data   scien5st  in  the  universe  is.  
39. I  promise  to  reveal  myself  soon.  
40.   Check  back  on  07/31/13  07:31:13  UTC   @   MassiveLogData.com  
41.   UnJl  then  …  
42.   More  data,  my  friends  …  J  
43. BACKGROUND  MUSIC     "As  I  Figure"  by  Kevin  MacLeod     (h:p://incompetech.com)  
44. A  Documentary  by  Israel  Ekpo     About     The  Most  Intriguing     Data  ScienJst  in  the  Universe