The Infrastructure of pixiv - from the past to the future

自作サーバー同窓会 2014-03-05
於フリークアウト

Transcript

1. The Infrastructure of pixiv from the past to the future ࣗ࡞αʔόಉ૭ձ 2014-03-05
2. Harukasan a.k.a MICHII Shunsuke ಓҪ
   ढ़հ ! 2009 େֶੜΛ΍ͬͯͨ
 2012 pixiv Inc. ΠϯϑϥνʔϜ Nginx / Apache / MySQL / MongoDB Kyototycoon / Solr / Traffic Server / Fluentd Kibana / Capistrano / Ruby on Rails / Macbook
3. ʮ௒େྔֆഅʯͷཪଆ (1) http://inside.pixiv.net/blog/2014/02/28/inside-of-massive-ema-collection-1/
4. The Infrastructure of pixiv from the past to the future
6. ࣗ࡞αʔόΧϯϑΝϨϯε
7. from the past to the future @kamipo - ϐΫγϒͷࣗ࡞Πϯϑϥࣄ৘ http://www.slideshare.net/kamipo/ss-2594002
8. @kamipo - ϐΫγϒͷࣗ࡞Πϯϑϥࣄ৘ http://www.slideshare.net/kamipo/ss-2594002
9. @kamipo - ϐΫγϒͷࣗ࡞Πϯϑϥࣄ৘ http://www.slideshare.net/kamipo/ss-2594002
10. @kamipo - ϐΫγϒͷࣗ࡞Πϯϑϥࣄ৘ http://www.slideshare.net/kamipo/ss-2594002
11. @kamipo - ϐΫγϒͷࣗ࡞Πϯϑϥࣄ৘ http://www.slideshare.net/kamipo/ss-2594002
12. @kamipo - ϐΫγϒͷࣗ࡞Πϯϑϥࣄ৘ http://www.slideshare.net/kamipo/ss-2594002 B-28 4 core edition
13. @kamipo - ϐΫγϒͷࣗ࡞Πϯϑϥࣄ৘ http://www.slideshare.net/kamipo/ss-2594002 ϕχϠػ 4ίΞϞσϧ
14. 2009೥ ͨΘ·ͳ͍ϕχϠ൘ʹϚ΢ϯτ ϝΠϯετϦʔϜ͸4ίΞػʢઌ୅͸2ίΞʣ αʔόͷ୆਺͸170୆͘Β͍
16. ϐΫγϒגࣜձ༷ࣾ ৄࡉ | IDCϑϩϯςΟΞ | σʔληϯλʔ http://www.idcf.jp/case/pixiv/
17. ϕχϠ൘ͱDCͷϋΠϒϦουʂ pixivΠϯϑϥͷࠓ ʵ ˏIT http://www.atmarkit.co.jp/news/201007/21/pixiv.html
18. ϕχϠ൘ͱDCͷϋΠϒϦουʂ pixivΠϯϑϥͷࠓ ʵ ˏIT http://www.atmarkit.co.jp/news/201007/21/pixiv.html %$Ͱͷӡ༻Λ։࢝
19. 2010೥ ճઢ͕Ҿ͚ͳ͘ͳͬͨͷͰσʔληϯλʔΛआΓͨ ౰࣌͸ը૾഑৴ઐ༻ͩͬͨ DCͷαʔό͸ϝʔΧʔ੡αʔόʹͨ͠
21. 2011೥ 3݄ 11೔ ౦๺ؔ౦େ਒ࡂʹݟ෣ΘΕΔ ࣗࣾαʔόʔϧʔϜʹඃ֐͸ͳ͔ͬͨ ࣗ෼͸͜ͷ೔ͪΐ͏Ͳpixivʹ༡ͼʹདྷ͍ͯͨ ͜ͷ೔Λڥʹσʔληϯλʔ΁ͷҠߦ͕Ճ଎͢Δ
22. ྠ൪ఀిʹඋ͑ͯൃిػΛ༻ҙ
24. from the past to the future pixivͷΠϯϑϥʹͳͬͯ2ϲ݄͕ͨͬͨ http://www.slideshare.net/harukayon/pixiv2-nseg-feat
25. from the past to the future pixivͷΠϯϑϥʹͳͬͯ2ϲ݄͕ͨͬͨ http://www.slideshare.net/harukayon/pixiv2-nseg-feat
26. 2012೥ ࣗ෼͕ೖࣾͨ͠೥ DC΁ͷଟίΞɺଟϝϞϦػͷಋೖ͕Ճ଎ ࣗࣾαʔόʔϧʔϜͷϚγϯ͸ܕམͪʹͳ͍ͬͯ͘
28. ͞Β͹ࣗࣾαʔόʔϧʔϜʂpixivɺനՏσʔληϯλʔʹҠΔ http://ascii.jp/elem/000/000/844/844678/index-2.html
29. നՏ%$ಋೖ
30. ※ࣗࣾαʔόʔϧʔϜΛഇࢭͨ͠Θ͚Ͱ͸ͳ͍
31. from the past to the future pixivͷΠϯϑϥΛࢧ͑Δٕज़2013 https://speakerdeck.com/harukasan/the-technology-behind-pixiv-infrastructure
32. 2013೥ ຊ൪؀ڥ͸σʔληϯλʔʹҠΔ നՏDC΁ը૾഑৴ΫϥελΛҠస͠͸͡ΊΔ 10GbpsճઢΛຊ֨తʹಋೖ
33. 2009 2014
34. 2009 2014 ݄ؒPV 9.5ԯ 37ԯ ձһ਺ 140ສ 1000ສ
35. 0 100 200 300 400 2009 2010 2011 2012 2013 αʔόʔͷ୆਺ͱΠϯϑϥνʔϜͷਓ਺ ࣗࣾ
 αʔόʔϧʔϜ ৽॓DC നՏDC 3ਓ 5ਓ
37. QJYJW͸σʔληϯλʔʹҠͬͯ
 ࣗ࡞αʔόͷ৺Λ๨Εͯ͠·ͬͨͷ͔
38. ͦΜͳ͜ͱ͸ͳ͍
39. ࣗ࡞αʔόͰഓͬͨίετҙࣝ͸
 ϕϯμʔ੡αʔόʹͳͬͯ΋มΘΒͳ͍
40. ϝʔΧʔɺػछ͸ݻఆ͠ͳ͍
41. ύʔπ͸
 Ձ֨DPNɺ"NB[POͰௐୡ
42. σʔληϯλʔ΁͸ࣗసंͰߦ͘
43. ࣗ࡞αʔόͷϊ΢ϋ΢͸
    ϐΫγϒʹੜ͖ଓ͚͍ͯΔ
44. QJYJWͷαʔό͸༻్ʹΑͬͯεϖοΫ͕༷ʑ
    
    $16
    ίΞ
    
    ίΞ
    ɹϝϞϦ
    (#
    
    (#
    ϝϞϦ͕଍Γͳ͘ͳͬͨΒͦͷͱ͖ʹ૿΍͢
    ৽॓ͳΒࣗసंͰ૿΍͠ʹ͍͚Δ
    ຽੜ඼Ͱ΋ϕϯμʔ඼Ͱ΋ނো཰͸มΘΒͳ͍
46. the New B-28 The fastest CPU included
48. 2ഒαΠζͷMDF൘Λ࠾༻ʢͭ·Γ2Uʣ Supermicro X9DRi-LN4F+ Xeon E5-2640 v2 BOX x 2 960GB SSD x 4 56GB MEM B-28RE (Ծশ) ¥60,000 ¥95,000 x 2 ¥50,000 x 2
49. 2014೥ ࣗࣾαʔόʔϧʔϜΛ։ൃɾղੳͷڌ఺ʹ ࣗࣾαʔόʔϧʔϜʹ΋24UϥοΫΛઃஔ Ծ૝؀ڥΛ੔උ͍ͯ͘͠༧ఆ !
50. past future
51. pixivͷΤϯδχΞ͕ࣗ࡞Λ΍ΊΔ͜ͱ͸ͳ͍ ϕχϠ൘΋ϕϯμʔ੡ʹͯ͠΋ελϯε͸มΘΒͳ͍ పఈͨ͠ίετҙࣝΛ΋ͬͯ΍͍ͬͯ͘ ! ! !