The Architecture of StackOverflow - Developer Conference 2013

Slides of the "Architecture of StackOverflow" talk given at Developer Conference 2013

Transcript

1. The  Architecture  Of  
   Marco Cecconi
   @sklivvz
   sklivvz@stackoverflow.com
   

   View Slide

2. View Slide

3. View Slide

4. #54  network  for  traffic*  
   …and  #7  in  Germany,  thank  you!  
   *source: Quantcast, Alexa
   

   View Slide

5. 560,072,448  pageviews  in  the  last  30  days*  
    
    
   (~100%  growth  year  over  year)  
   *source: Quantcast
   

   View Slide

6. View Slide

7. web servers
   load balancers
   redis
   search
   database
   http(s)
   http
   rest
   http
   protobuf
   sql
   sql
   protobuf
   tag engine
   

   View Slide

8. View Slide

9. View Slide

10. We  are  sOll  scaling  up…  
     
    

    View Slide

11. Few projects :-)
    

    View Slide

12. Few projects :-) Few lines of code :-)
    

    View Slide

13. Few projects :-) Few lines of code :-)
    Eeek! very few tests :-S
    

    View Slide

14. Few projects :-) Few lines of code :-)
    Awesome community to help :-D
    Eeek! very few tests :-S
    

    View Slide

15. YAGNI*  
    It  works.  
    * You Ain’t Gonna Need It!
    

    View Slide

16. BATCAVE
    

    View Slide

17. BATCAVE
    DEV.SO
    

    View Slide

18. BATCAVE
    META.SO
    DEV.SO
    

    View Slide

19. BATCAVE
    META.SO
    DEV.SO
    

    View Slide

20. BATCAVE
    META.SO
    NETWORK
    DEV.SO
    

    View Slide

21. Move  fast  and  break  things    
    

    View Slide

22. Move  fast  and  break  things*  
    * Not the home page or question page :-)
    

    View Slide

23. Move  fast  and  break  things*  
    * Not the home page or question page :-)
    

    View Slide

24. Network Level Caches (Browser, CDN, etc.)
    Server Level Cache (HttpRuntime.Cache)
    Site Level Cache (Redis)
    SQL Server Database Cache (384 gigs of RAM!)
    Solid State Disk
    

    View Slide

25. View Slide

26. View Slide

27. View Slide

28. View Slide

29. View Slide

30. * Source http://bit.ly/1eSLr8Z
    

    View Slide

31. View Slide

32. View Slide

33. View Slide

34. Reinvent  a  beWer  wheel!  
    Open  source  all  the  wheels!  
    

    View Slide

35. View Slide

36. WE <3 GEEKS
    

    View Slide

37. DOWN
    TO THE
    METAL \m/
    

    View Slide

38. HIRE THE BEST TALENT FROM ANYWHERE
    

    View Slide

39. BAT CAVE
    

    View Slide

40. Ir=kag=omz=pqoapq=ftue,=ymknq=iq=omz=fmxw=vane1Zewxuhhl&efmowahqdrxai.oay
    $_='@mk=uf=radimdp1Z--&ewxuhhl';tr/=1m-za-l@&Z/ !a-zP@\n/&print;
    Marco Cecconi
    @sklivvz
    sklivvz@stackoverflow.com
    

    View Slide