Save 37% off PRO during our Black Friday Sale! »

LinkedIn's data infrastructure: an overview

LinkedIn's data infrastructure: an overview

Talk given at the Budapest Big Data meetup, 18 November 2014. http://www.meetup.com/Big-Data-Meetup-Budapest/events/208253412/

Abstract:

LinkedIn, with over 300 million members, has surmounted some interesting scalability challenges. Many core components of LinkedIn's data infrastructure are open source, so you can benefit from them too. This talk will give an overview of the approaches and tools that have proved successful at massive scale.

0d4ef9af8e4f0cf5c162b48ba24faea6?s=128

Martin Kleppmann

November 18, 2014
Tweet

Transcript

  1. None
  2. None
  3. None
  4. None
  5. None
  6. SIGMOD  2013.  h.p://www.slideshare.net/s_shah/the-­‐big-­‐data-­‐ecosystem-­‐at-­‐linkedin-­‐23512853  

  7. None
  8. SIGMOD  2013.  h.p://www.slideshare.net/amywtang/espresso-­‐20952131  

  9. None
  10. None
  11. SOSP  2007.  h.p://www.allthingsdistributed.com/files/amazon-­‐dynamo-­‐sosp2007.pdf  

  12. None
  13. h.p://engineering.linkedin.com/analyNcs/real-­‐Nme-­‐analyNcs-­‐massive-­‐scale-­‐pinot  

  14. None
  15. None
  16. h.p://engineering.linkedin.com/search/did-­‐you-­‐mean-­‐galene  

  17. None
  18. None
  19. None
  20. None
  21. None
  22. IEEE  Data  Engineering  BulleNn,  2012.  h.p://sites.computer.org/debull/A12june/A12JUN-­‐CD.pdf  

  23. None
  24. None
  25. None
  26. None
  27. h.p://engineering.linkedin.com/stream-­‐processing/   moving-­‐faster-­‐data-­‐streams-­‐rise-­‐samza-­‐linkedin  

  28. None
  29. None
  30. None
  31. SoCC  2012.  h.p://www.socc2012.org/s18-­‐das.pdf  

  32. None
  33. None
  34. None
  35. None
  36. None
  37. None
  38. None
  39. None
  40. None
  41. None
  42. h.p://shop.oreilly.com/product/   0636920034339.do  

  43. None
  44. None