$30 off During Our Annual Pro Sale. View Details »

The Architecture of StackOverflow - Developer Conference 2013

The Architecture of StackOverflow - Developer Conference 2013

Slides of the "Architecture of StackOverflow" talk given at Developer Conference 2013

Marco Cecconi

November 07, 2013
Tweet

More Decks by Marco Cecconi

Other Decks in Programming

Transcript

  1. The  Architecture  Of  
    Marco Cecconi
    @sklivvz
    [email protected]

    View Slide

  2. View Slide

  3. View Slide

  4. #54  network  for  traffic*  
    …and  #7  in  Germany,  thank  you!  
    *source: Quantcast, Alexa

    View Slide

  5. 560,072,448  pageviews  in  the  last  30  days*  
     
     
    (~100%  growth  year  over  year)  
    *source: Quantcast

    View Slide

  6. View Slide

  7. web servers
    load balancers
    redis
    search
    database
    http(s)
    http
    rest
    http
    protobuf
    sql
    sql
    protobuf
    tag engine

    View Slide

  8. View Slide

  9. View Slide

  10. We  are  sOll  scaling  up…  
     

    View Slide

  11. Few projects :-)

    View Slide

  12. Few projects :-) Few lines of code :-)

    View Slide

  13. Few projects :-) Few lines of code :-)
    Eeek! very few tests :-S

    View Slide

  14. Few projects :-) Few lines of code :-)
    Awesome community to help :-D
    Eeek! very few tests :-S

    View Slide

  15. YAGNI*  
    It  works.  
    * You Ain’t Gonna Need It!

    View Slide

  16. BATCAVE

    View Slide

  17. BATCAVE
    DEV.SO

    View Slide

  18. BATCAVE
    META.SO
    DEV.SO

    View Slide

  19. BATCAVE
    META.SO
    DEV.SO

    View Slide

  20. BATCAVE
    META.SO
    NETWORK
    DEV.SO

    View Slide

  21. Move  fast  and  break  things    

    View Slide

  22. Move  fast  and  break  things*  
    * Not the home page or question page :-)

    View Slide

  23. Move  fast  and  break  things*  
    * Not the home page or question page :-)

    View Slide

  24. Network Level Caches (Browser, CDN, etc.)
    Server Level Cache (HttpRuntime.Cache)
    Site Level Cache (Redis)
    SQL Server Database Cache (384 gigs of RAM!)
    Solid State Disk

    View Slide

  25. View Slide

  26. View Slide

  27. View Slide

  28. View Slide

  29. View Slide

  30. * Source http://bit.ly/1eSLr8Z

    View Slide

  31. View Slide

  32. View Slide

  33. View Slide

  34. Reinvent  a  beWer  wheel!  
    Open  source  all  the  wheels!  

    View Slide

  35. View Slide

  36. WE <3 GEEKS

    View Slide

  37. DOWN
    TO THE
    METAL \m/

    View Slide

  38. HIRE THE BEST TALENT FROM ANYWHERE

    View Slide

  39. BAT CAVE

    View Slide

  40. Ir=kag=omz=pqoapq=ftue,=ymknq=iq=omz=fmxw=vane1Zewxuhhl&efmowahqdrxai.oay
    $_='@mk=uf=radimdp1Z--&ewxuhhl';tr/=1m-za-l@&Z/ !a-zP@\n/&print;
    Marco Cecconi
    @sklivvz
    [email protected]

    View Slide