Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
The Infrastructure of pixiv - from the past to the future
Search
Harukasan
PRO
March 12, 2014
Technology
3
7.9k
The Infrastructure of pixiv - from the past to the future
自作サーバー同窓会 2014-03-05
於フリークアウト
Harukasan
PRO
March 12, 2014
Tweet
Share
More Decks by Harukasan
See All by Harukasan
20240401 新卒研修 - ピクシブにおける技術領域
harukasan
PRO
1
530
ピクシブのコンテンツ配信基盤技術 / pixiv TECH SALON
harukasan
PRO
5
5.1k
Goにおける画像ファイル処理 / golang.tokyo #19
harukasan
PRO
7
6.2k
WebRTC動画をトランスコードする / Transcoding video streams from WebRTC
harukasan
PRO
5
1.4k
ImageFluxを支えるリモート開発 / 20171202
harukasan
PRO
2
1.7k
YAPC::Fukuoka 前夜祭LT / Yet Another Pawoo Commit logs
harukasan
PRO
0
2.8k
YAPC::Fukuoka lunch session
harukasan
PRO
1
2.8k
マストドン会議: Pawoo / Mastodon Kaigi2
harukasan
PRO
2
410
大規模Mastodonインスタンスを運用するコツ / Inside Pawoo Mastodon infrastructure
harukasan
PRO
0
2.9k
Other Decks in Technology
See All in Technology
長期間TiDBを使ってきた話 @ 私たちはなぜNewSQLを使うのかTiDB選定5社が語る選定理由と活用LT / Experiences with TiDB Over Time
chibiegg
2
900
Google Cloud Next '24でブログを10本書いた方法と勉強会を沸かせた方法
yasumuusan
0
300
生産性向上チームの紹介
cybozuinsideout
PRO
1
870
複雑な構成要素を持つUIとの向き合い方 〜新・支出グラフでの実例〜 / B43 TECH TALK
nakamuuu
0
140
障害対応をちょっとずつよくしていくための 演習の作りかた
heleeen
0
230
レガシーをぶっ壊せ。AEONで始めるDevRelの話 / Qiita Night 2024-2-22
aeonpeople
3
1.3k
Kernel MemoryでAzure OpenAI Serviceとお手軽データソース連携
mitsuzono
1
260
GrafanaMeetup_AmazonManagedGrafanaのアクセス制御機能とマルチテナント環境下でのアクセス制御について
daitak
0
250
LayerXにおけるLLMプロダクト開発の今までとこれから
layerx
PRO
1
380
20240418_Google ColabにLLMが搭載されたようなのでPython x データ分析の勉強方法を考えてみる
doradora09
0
140
元インフラエンジニアに成る / Human Resources to Human Relations
bobtani
4
930
Building Dashboards as a Hobby
egmc
0
230
Featured
See All Featured
Teambox: Starting and Learning
jrom
128
8.4k
Being A Developer After 40
akosma
57
580k
What’s in a name? Adding method to the madness
productmarketing
PRO
16
2.6k
Pencils Down: Stop Designing & Start Developing
hursman
117
11k
Into the Great Unknown - MozCon
thekraken
10
990
Embracing the Ebb and Flow
colly
80
4.1k
Bash Introduction
62gerente
604
210k
Documentation Writing (for coders)
carmenintech
60
3.9k
Fashionably flexible responsive web design (full day workshop)
malarkey
398
65k
In The Pink: A Labor of Love
frogandcode
138
21k
BBQ
matthewcrist
80
8.8k
Fight the Zombie Pattern Library - RWD Summit 2016
marcelosomers
227
16k
Transcript
The Infrastructure of pixiv from the past to the future
ࣗ࡞αʔόಉ૭ձ 2014-03-05
Harukasan a.k.a MICHII Shunsuke ಓҪढ़հ ! 2009 େֶੜΛͬͯͨ 2012 pixiv
Inc. ΠϯϑϥνʔϜ Nginx / Apache / MySQL / MongoDB Kyototycoon / Solr / Traffic Server / Fluentd Kibana / Capistrano / Ruby on Rails / Macbook
ʮେྔֆഅʯͷཪଆ (1) http://inside.pixiv.net/blog/2014/02/28/inside-of-massive-ema-collection-1/
The Infrastructure of pixiv from the past to the future
2009
ࣗ࡞αʔόΧϯϑΝϨϯε
from the past to the future @kamipo - ϐΫγϒͷࣗ࡞Πϯϑϥࣄ http://www.slideshare.net/kamipo/ss-2594002
@kamipo - ϐΫγϒͷࣗ࡞Πϯϑϥࣄ http://www.slideshare.net/kamipo/ss-2594002
@kamipo - ϐΫγϒͷࣗ࡞Πϯϑϥࣄ http://www.slideshare.net/kamipo/ss-2594002
@kamipo - ϐΫγϒͷࣗ࡞Πϯϑϥࣄ http://www.slideshare.net/kamipo/ss-2594002
@kamipo - ϐΫγϒͷࣗ࡞Πϯϑϥࣄ http://www.slideshare.net/kamipo/ss-2594002
@kamipo - ϐΫγϒͷࣗ࡞Πϯϑϥࣄ http://www.slideshare.net/kamipo/ss-2594002 B-28 4 core edition
@kamipo - ϐΫγϒͷࣗ࡞Πϯϑϥࣄ http://www.slideshare.net/kamipo/ss-2594002 ϕχϠػ 4ίΞϞσϧ
2009 ͨΘ·ͳ͍ϕχϠ൘ʹϚϯτ ϝΠϯετϦʔϜ4ίΞػʢઌ2ίΞʣ αʔόͷ170͘Β͍
2010
ϐΫγϒגࣜձ༷ࣾ ৄࡉ | IDCϑϩϯςΟΞ | σʔληϯλʔ http://www.idcf.jp/case/pixiv/
ϕχϠ൘ͱDCͷϋΠϒϦουʂ pixivΠϯϑϥͷࠓ ʵ ˏIT http://www.atmarkit.co.jp/news/201007/21/pixiv.html
ϕχϠ൘ͱDCͷϋΠϒϦουʂ pixivΠϯϑϥͷࠓ ʵ ˏIT http://www.atmarkit.co.jp/news/201007/21/pixiv.html %$Ͱͷӡ༻Λ։࢝
2010 ճઢ͕Ҿ͚ͳ͘ͳͬͨͷͰσʔληϯλʔΛआΓͨ ࣌ը૾৴ઐ༻ͩͬͨ DCͷαʔόϝʔΧʔαʔόʹͨ͠
2011
2011 3݄ 11 ౦ؔ౦େࡂʹݟΘΕΔ ࣗࣾαʔόʔϧʔϜʹඃͳ͔ͬͨ ࣗ͜ͷͪΐ͏Ͳpixivʹ༡ͼʹདྷ͍ͯͨ ͜ͷΛڥʹσʔληϯλʔͷҠߦ͕Ճ͢Δ
ྠ൪ఀిʹඋ͑ͯൃిػΛ༻ҙ
2012
from the past to the future pixivͷΠϯϑϥʹͳͬͯ2ϲ݄͕ͨͬͨ http://www.slideshare.net/harukayon/pixiv2-nseg-feat
from the past to the future pixivͷΠϯϑϥʹͳͬͯ2ϲ݄͕ͨͬͨ http://www.slideshare.net/harukayon/pixiv2-nseg-feat
2012 ͕ࣗೖࣾͨ͠ DCͷଟίΞɺଟϝϞϦػͷಋೖ͕Ճ ࣗࣾαʔόʔϧʔϜͷϚγϯܕམͪʹͳ͍ͬͯ͘
2013
͞ΒࣗࣾαʔόʔϧʔϜʂpixivɺനՏσʔληϯλʔʹҠΔ http://ascii.jp/elem/000/000/844/844678/index-2.html
നՏ%$ಋೖ
※ࣗࣾαʔόʔϧʔϜΛഇࢭͨ͠Θ͚Ͱͳ͍
from the past to the future pixivͷΠϯϑϥΛࢧ͑Δٕज़2013 https://speakerdeck.com/harukasan/the-technology-behind-pixiv-infrastructure
2013 ຊ൪ڥσʔληϯλʔʹҠΔ നՏDCը૾৴ΫϥελΛҠస͠͡ΊΔ 10GbpsճઢΛຊ֨తʹಋೖ
2009 2014
2009 2014 ݄ؒPV 9.5ԯ 37ԯ ձһ 140ສ 1000ສ
0 100 200 300 400 2009 2010 2011 2012 2013
αʔόʔͷͱΠϯϑϥνʔϜͷਓ ࣗࣾ αʔόʔϧʔϜ ৽॓DC നՏDC 3ਓ 5ਓ
None
QJYJWσʔληϯλʔʹҠͬͯ ࣗ࡞αʔόͷ৺ΛΕͯ͠·ͬͨͷ͔
ͦΜͳ͜ͱͳ͍
ࣗ࡞αʔόͰഓͬͨίετҙࣝ ϕϯμʔαʔόʹͳͬͯมΘΒͳ͍
ϝʔΧʔɺػछݻఆ͠ͳ͍
ύʔπ Ձ֨DPNɺ"NB[POͰௐୡ
σʔληϯλʔࣗసंͰߦ͘
ࣗ࡞αʔόͷϊϋ ϐΫγϒʹੜ͖ଓ͚͍ͯΔ
QJYJWͷαʔό༻్ʹΑͬͯεϖοΫ͕༷ʑ $16ίΞίΞ ɹϝϞϦ(#(# ϝϞϦ͕Γͳ͘ͳͬͨΒͦͷͱ͖ʹ૿͢ ৽॓ͳΒࣗసंͰ૿͠ʹ͍͚Δ ຽੜͰϕϯμʔͰނোมΘΒͳ͍
2014
the New B-28 The fastest CPU included
None
2ഒαΠζͷMDF൘Λ࠾༻ʢͭ·Γ2Uʣ Supermicro X9DRi-LN4F+ Xeon E5-2640 v2 BOX x 2 960GB
SSD x 4 56GB MEM B-28RE (Ծশ) ¥60,000 ¥95,000 x 2 ¥50,000 x 2
2014 ࣗࣾαʔόʔϧʔϜΛ։ൃɾղੳͷڌʹ ࣗࣾαʔόʔϧʔϜʹ24UϥοΫΛઃஔ ԾڥΛඋ͍ͯ͘͠༧ఆ !
past future
pixivͷΤϯδχΞ͕ࣗ࡞ΛΊΔ͜ͱͳ͍ ϕχϠ൘ϕϯμʔʹͯ͠ελϯεมΘΒͳ͍ పఈͨ͠ίετҙࣝΛ͍ͬͯͬͯ͘ ! ! !