Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
The Infrastructure of pixiv - from the past to ...
Search
Harukasan
PRO
March 12, 2014
Technology
3
8k
The Infrastructure of pixiv - from the past to the future
自作サーバー同窓会 2014-03-05
於フリークアウト
Harukasan
PRO
March 12, 2014
Tweet
Share
More Decks by Harukasan
See All by Harukasan
pixivを支える技術 / 技育CAMPアカデミア
harukasan
PRO
3
420
20240401 新卒研修 - ピクシブにおける技術領域
harukasan
PRO
1
740
ピクシブのコンテンツ配信基盤技術 / pixiv TECH SALON
harukasan
PRO
5
5.5k
Goにおける画像ファイル処理 / golang.tokyo #19
harukasan
PRO
7
6.6k
WebRTC動画をトランスコードする / Transcoding video streams from WebRTC
harukasan
PRO
5
1.5k
ImageFluxを支えるリモート開発 / 20171202
harukasan
PRO
2
1.8k
YAPC::Fukuoka 前夜祭LT / Yet Another Pawoo Commit logs
harukasan
PRO
0
2.9k
YAPC::Fukuoka lunch session
harukasan
PRO
1
3k
マストドン会議: Pawoo / Mastodon Kaigi2
harukasan
PRO
2
460
Other Decks in Technology
See All in Technology
ホワイトボードチャレンジ 説明&実行資料
ichimichi
0
120
RECRUIT TECH CONFERENCE 2025 プレイベント【高橋】
recruitengineers
PRO
0
120
レビューを増やしつつ 高評価維持するテクニック
tsuzuki817
1
480
プロセス改善による品質向上事例
tomasagi
2
2.2k
SA Night #2 FinatextのSA思想/SA Night #2 Finatext session
satoshiimai
1
130
管理者しか知らないOutlookの裏側のAIを覗く#AzureTravelers
hirotomotaguchi
2
320
アジャイル開発とスクラム
araihara
0
170
Building Products in the LLM Era
ymatsuwitter
10
5k
AndroidデバイスにFTPサーバを建立する
e10dokup
0
240
第13回 Data-Centric AI勉強会, 画像認識におけるData-centric AI
ksaito_osx
0
370
トラシューアニマルになろう ~開発者だからこそできる、安定したサービス作りの秘訣~
jacopen
2
1.8k
Cloud Spanner 導入で実現した快適な開発と運用について
colopl
1
320
Featured
See All Featured
The Psychology of Web Performance [Beyond Tellerrand 2023]
tammyeverts
45
2.3k
Embracing the Ebb and Flow
colly
84
4.6k
GitHub's CSS Performance
jonrohan
1030
460k
Helping Users Find Their Own Way: Creating Modern Search Experiences
danielanewman
29
2.4k
Visualizing Your Data: Incorporating Mongo into Loggly Infrastructure
mongodb
44
9.4k
Bash Introduction
62gerente
610
210k
Large-scale JavaScript Application Architecture
addyosmani
510
110k
Scaling GitHub
holman
459
140k
[RailsConf 2023 Opening Keynote] The Magic of Rails
eileencodes
28
9.3k
The Pragmatic Product Professional
lauravandoore
32
6.4k
Building Your Own Lightsaber
phodgson
104
6.2k
Cheating the UX When There Is Nothing More to Optimize - PixelPioneers
stephaniewalter
280
13k
Transcript
The Infrastructure of pixiv from the past to the future
ࣗ࡞αʔόಉ૭ձ 2014-03-05
Harukasan a.k.a MICHII Shunsuke ಓҪढ़հ ! 2009 େֶੜΛͬͯͨ 2012 pixiv
Inc. ΠϯϑϥνʔϜ Nginx / Apache / MySQL / MongoDB Kyototycoon / Solr / Traffic Server / Fluentd Kibana / Capistrano / Ruby on Rails / Macbook
ʮେྔֆഅʯͷཪଆ (1) http://inside.pixiv.net/blog/2014/02/28/inside-of-massive-ema-collection-1/
The Infrastructure of pixiv from the past to the future
2009
ࣗ࡞αʔόΧϯϑΝϨϯε
from the past to the future @kamipo - ϐΫγϒͷࣗ࡞Πϯϑϥࣄ http://www.slideshare.net/kamipo/ss-2594002
@kamipo - ϐΫγϒͷࣗ࡞Πϯϑϥࣄ http://www.slideshare.net/kamipo/ss-2594002
@kamipo - ϐΫγϒͷࣗ࡞Πϯϑϥࣄ http://www.slideshare.net/kamipo/ss-2594002
@kamipo - ϐΫγϒͷࣗ࡞Πϯϑϥࣄ http://www.slideshare.net/kamipo/ss-2594002
@kamipo - ϐΫγϒͷࣗ࡞Πϯϑϥࣄ http://www.slideshare.net/kamipo/ss-2594002
@kamipo - ϐΫγϒͷࣗ࡞Πϯϑϥࣄ http://www.slideshare.net/kamipo/ss-2594002 B-28 4 core edition
@kamipo - ϐΫγϒͷࣗ࡞Πϯϑϥࣄ http://www.slideshare.net/kamipo/ss-2594002 ϕχϠػ 4ίΞϞσϧ
2009 ͨΘ·ͳ͍ϕχϠ൘ʹϚϯτ ϝΠϯετϦʔϜ4ίΞػʢઌ2ίΞʣ αʔόͷ170͘Β͍
2010
ϐΫγϒגࣜձ༷ࣾ ৄࡉ | IDCϑϩϯςΟΞ | σʔληϯλʔ http://www.idcf.jp/case/pixiv/
ϕχϠ൘ͱDCͷϋΠϒϦουʂ pixivΠϯϑϥͷࠓ ʵ ˏIT http://www.atmarkit.co.jp/news/201007/21/pixiv.html
ϕχϠ൘ͱDCͷϋΠϒϦουʂ pixivΠϯϑϥͷࠓ ʵ ˏIT http://www.atmarkit.co.jp/news/201007/21/pixiv.html %$Ͱͷӡ༻Λ։࢝
2010 ճઢ͕Ҿ͚ͳ͘ͳͬͨͷͰσʔληϯλʔΛआΓͨ ࣌ը૾৴ઐ༻ͩͬͨ DCͷαʔόϝʔΧʔαʔόʹͨ͠
2011
2011 3݄ 11 ౦ؔ౦େࡂʹݟΘΕΔ ࣗࣾαʔόʔϧʔϜʹඃͳ͔ͬͨ ࣗ͜ͷͪΐ͏Ͳpixivʹ༡ͼʹདྷ͍ͯͨ ͜ͷΛڥʹσʔληϯλʔͷҠߦ͕Ճ͢Δ
ྠ൪ఀిʹඋ͑ͯൃిػΛ༻ҙ
2012
from the past to the future pixivͷΠϯϑϥʹͳͬͯ2ϲ݄͕ͨͬͨ http://www.slideshare.net/harukayon/pixiv2-nseg-feat
from the past to the future pixivͷΠϯϑϥʹͳͬͯ2ϲ݄͕ͨͬͨ http://www.slideshare.net/harukayon/pixiv2-nseg-feat
2012 ͕ࣗೖࣾͨ͠ DCͷଟίΞɺଟϝϞϦػͷಋೖ͕Ճ ࣗࣾαʔόʔϧʔϜͷϚγϯܕམͪʹͳ͍ͬͯ͘
2013
͞ΒࣗࣾαʔόʔϧʔϜʂpixivɺനՏσʔληϯλʔʹҠΔ http://ascii.jp/elem/000/000/844/844678/index-2.html
നՏ%$ಋೖ
※ࣗࣾαʔόʔϧʔϜΛഇࢭͨ͠Θ͚Ͱͳ͍
from the past to the future pixivͷΠϯϑϥΛࢧ͑Δٕज़2013 https://speakerdeck.com/harukasan/the-technology-behind-pixiv-infrastructure
2013 ຊ൪ڥσʔληϯλʔʹҠΔ നՏDCը૾৴ΫϥελΛҠస͠͡ΊΔ 10GbpsճઢΛຊ֨తʹಋೖ
2009 2014
2009 2014 ݄ؒPV 9.5ԯ 37ԯ ձһ 140ສ 1000ສ
0 100 200 300 400 2009 2010 2011 2012 2013
αʔόʔͷͱΠϯϑϥνʔϜͷਓ ࣗࣾ αʔόʔϧʔϜ ৽॓DC നՏDC 3ਓ 5ਓ
None
QJYJWσʔληϯλʔʹҠͬͯ ࣗ࡞αʔόͷ৺ΛΕͯ͠·ͬͨͷ͔
ͦΜͳ͜ͱͳ͍
ࣗ࡞αʔόͰഓͬͨίετҙࣝ ϕϯμʔαʔόʹͳͬͯมΘΒͳ͍
ϝʔΧʔɺػछݻఆ͠ͳ͍
ύʔπ Ձ֨DPNɺ"NB[POͰௐୡ
σʔληϯλʔࣗసंͰߦ͘
ࣗ࡞αʔόͷϊϋ ϐΫγϒʹੜ͖ଓ͚͍ͯΔ
QJYJWͷαʔό༻్ʹΑͬͯεϖοΫ͕༷ʑ $16ίΞίΞ ɹϝϞϦ(#(# ϝϞϦ͕Γͳ͘ͳͬͨΒͦͷͱ͖ʹ૿͢ ৽॓ͳΒࣗసंͰ૿͠ʹ͍͚Δ ຽੜͰϕϯμʔͰނোมΘΒͳ͍
2014
the New B-28 The fastest CPU included
None
2ഒαΠζͷMDF൘Λ࠾༻ʢͭ·Γ2Uʣ Supermicro X9DRi-LN4F+ Xeon E5-2640 v2 BOX x 2 960GB
SSD x 4 56GB MEM B-28RE (Ծশ) ¥60,000 ¥95,000 x 2 ¥50,000 x 2
2014 ࣗࣾαʔόʔϧʔϜΛ։ൃɾղੳͷڌʹ ࣗࣾαʔόʔϧʔϜʹ24UϥοΫΛઃஔ ԾڥΛඋ͍ͯ͘͠༧ఆ !
past future
pixivͷΤϯδχΞ͕ࣗ࡞ΛΊΔ͜ͱͳ͍ ϕχϠ൘ϕϯμʔʹͯ͠ελϯεมΘΒͳ͍ పఈͨ͠ίετҙࣝΛ͍ͬͯͬͯ͘ ! ! !