Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
The Infrastructure of pixiv - from the past to ...
Search
Harukasan
PRO
March 12, 2014
Technology
3
8k
The Infrastructure of pixiv - from the past to the future
自作サーバー同窓会 2014-03-05
於フリークアウト
Harukasan
PRO
March 12, 2014
Tweet
Share
More Decks by Harukasan
See All by Harukasan
pixivを支える技術 / 技育CAMPアカデミア
harukasan
PRO
3
430
20240401 新卒研修 - ピクシブにおける技術領域
harukasan
PRO
1
740
ピクシブのコンテンツ配信基盤技術 / pixiv TECH SALON
harukasan
PRO
5
5.5k
Goにおける画像ファイル処理 / golang.tokyo #19
harukasan
PRO
7
6.6k
WebRTC動画をトランスコードする / Transcoding video streams from WebRTC
harukasan
PRO
5
1.5k
ImageFluxを支えるリモート開発 / 20171202
harukasan
PRO
2
1.8k
YAPC::Fukuoka 前夜祭LT / Yet Another Pawoo Commit logs
harukasan
PRO
0
2.9k
YAPC::Fukuoka lunch session
harukasan
PRO
1
3k
マストドン会議: Pawoo / Mastodon Kaigi2
harukasan
PRO
2
460
Other Decks in Technology
See All in Technology
人はなぜISUCONに夢中になるのか
kakehashi
PRO
6
1.7k
Apache Iceberg Case Study in LY Corporation
lycorptech_jp
PRO
0
140
わたしのOSS活動
kazupon
2
300
【Developers Summit 2025】プロダクトエンジニアから学ぶ、 ユーザーにより高い価値を届ける技術
niwatakeru
2
1.6k
2025-02-21 ゆるSRE勉強会 Enhancing SRE Using AI
yoshiiryo1
1
420
ソフトウェアエンジニアと仕事するときに知っておいたほうが良いこと / Key points for working with software engineers
pinkumohikan
1
130
株式会社EventHub・エンジニア採用資料
eventhub
0
4.3k
OpenID BizDay#17 みんなの銀行による身元確認結果の活用 / 20250219-BizDay17-KYC-minna-no-ginko
oidfj
0
130
開発組織のための セキュアコーディング研修の始め方
flatt_security
3
2.7k
OpenID Connect for Identity Assurance の概要と翻訳版のご紹介 / 20250219-BizDay17-OIDC4IDA-Intro
oidfj
0
400
Active Directory攻防
cryptopeg
PRO
7
4.5k
2024.02.19 W&B AIエージェントLT会 / AIエージェントが業務を代行するための計画と実行 / Algomatic 宮脇
smiyawaki0820
15
4.1k
Featured
See All Featured
Creating an realtime collaboration tool: Agile Flush - .NET Oxford
marcduiker
27
1.9k
A Philosophy of Restraint
colly
203
16k
Making Projects Easy
brettharned
116
6k
Fireside Chat
paigeccino
34
3.2k
CoffeeScript is Beautiful & I Never Want to Write Plain JavaScript Again
sstephenson
160
15k
How to Create Impact in a Changing Tech Landscape [PerfNow 2023]
tammyeverts
49
2.3k
Producing Creativity
orderedlist
PRO
344
39k
Imperfection Machines: The Place of Print at Facebook
scottboms
267
13k
How STYLIGHT went responsive
nonsquared
98
5.4k
KATA
mclloyd
29
14k
Six Lessons from altMBA
skipperchong
27
3.6k
[RailsConf 2023] Rails as a piece of cake
palkan
53
5.3k
Transcript
The Infrastructure of pixiv from the past to the future
ࣗ࡞αʔόಉ૭ձ 2014-03-05
Harukasan a.k.a MICHII Shunsuke ಓҪढ़հ ! 2009 େֶੜΛͬͯͨ 2012 pixiv
Inc. ΠϯϑϥνʔϜ Nginx / Apache / MySQL / MongoDB Kyototycoon / Solr / Traffic Server / Fluentd Kibana / Capistrano / Ruby on Rails / Macbook
ʮେྔֆഅʯͷཪଆ (1) http://inside.pixiv.net/blog/2014/02/28/inside-of-massive-ema-collection-1/
The Infrastructure of pixiv from the past to the future
2009
ࣗ࡞αʔόΧϯϑΝϨϯε
from the past to the future @kamipo - ϐΫγϒͷࣗ࡞Πϯϑϥࣄ http://www.slideshare.net/kamipo/ss-2594002
@kamipo - ϐΫγϒͷࣗ࡞Πϯϑϥࣄ http://www.slideshare.net/kamipo/ss-2594002
@kamipo - ϐΫγϒͷࣗ࡞Πϯϑϥࣄ http://www.slideshare.net/kamipo/ss-2594002
@kamipo - ϐΫγϒͷࣗ࡞Πϯϑϥࣄ http://www.slideshare.net/kamipo/ss-2594002
@kamipo - ϐΫγϒͷࣗ࡞Πϯϑϥࣄ http://www.slideshare.net/kamipo/ss-2594002
@kamipo - ϐΫγϒͷࣗ࡞Πϯϑϥࣄ http://www.slideshare.net/kamipo/ss-2594002 B-28 4 core edition
@kamipo - ϐΫγϒͷࣗ࡞Πϯϑϥࣄ http://www.slideshare.net/kamipo/ss-2594002 ϕχϠػ 4ίΞϞσϧ
2009 ͨΘ·ͳ͍ϕχϠ൘ʹϚϯτ ϝΠϯετϦʔϜ4ίΞػʢઌ2ίΞʣ αʔόͷ170͘Β͍
2010
ϐΫγϒגࣜձ༷ࣾ ৄࡉ | IDCϑϩϯςΟΞ | σʔληϯλʔ http://www.idcf.jp/case/pixiv/
ϕχϠ൘ͱDCͷϋΠϒϦουʂ pixivΠϯϑϥͷࠓ ʵ ˏIT http://www.atmarkit.co.jp/news/201007/21/pixiv.html
ϕχϠ൘ͱDCͷϋΠϒϦουʂ pixivΠϯϑϥͷࠓ ʵ ˏIT http://www.atmarkit.co.jp/news/201007/21/pixiv.html %$Ͱͷӡ༻Λ։࢝
2010 ճઢ͕Ҿ͚ͳ͘ͳͬͨͷͰσʔληϯλʔΛआΓͨ ࣌ը૾৴ઐ༻ͩͬͨ DCͷαʔόϝʔΧʔαʔόʹͨ͠
2011
2011 3݄ 11 ౦ؔ౦େࡂʹݟΘΕΔ ࣗࣾαʔόʔϧʔϜʹඃͳ͔ͬͨ ࣗ͜ͷͪΐ͏Ͳpixivʹ༡ͼʹདྷ͍ͯͨ ͜ͷΛڥʹσʔληϯλʔͷҠߦ͕Ճ͢Δ
ྠ൪ఀిʹඋ͑ͯൃిػΛ༻ҙ
2012
from the past to the future pixivͷΠϯϑϥʹͳͬͯ2ϲ݄͕ͨͬͨ http://www.slideshare.net/harukayon/pixiv2-nseg-feat
from the past to the future pixivͷΠϯϑϥʹͳͬͯ2ϲ݄͕ͨͬͨ http://www.slideshare.net/harukayon/pixiv2-nseg-feat
2012 ͕ࣗೖࣾͨ͠ DCͷଟίΞɺଟϝϞϦػͷಋೖ͕Ճ ࣗࣾαʔόʔϧʔϜͷϚγϯܕམͪʹͳ͍ͬͯ͘
2013
͞ΒࣗࣾαʔόʔϧʔϜʂpixivɺനՏσʔληϯλʔʹҠΔ http://ascii.jp/elem/000/000/844/844678/index-2.html
നՏ%$ಋೖ
※ࣗࣾαʔόʔϧʔϜΛഇࢭͨ͠Θ͚Ͱͳ͍
from the past to the future pixivͷΠϯϑϥΛࢧ͑Δٕज़2013 https://speakerdeck.com/harukasan/the-technology-behind-pixiv-infrastructure
2013 ຊ൪ڥσʔληϯλʔʹҠΔ നՏDCը૾৴ΫϥελΛҠస͠͡ΊΔ 10GbpsճઢΛຊ֨తʹಋೖ
2009 2014
2009 2014 ݄ؒPV 9.5ԯ 37ԯ ձһ 140ສ 1000ສ
0 100 200 300 400 2009 2010 2011 2012 2013
αʔόʔͷͱΠϯϑϥνʔϜͷਓ ࣗࣾ αʔόʔϧʔϜ ৽॓DC നՏDC 3ਓ 5ਓ
None
QJYJWσʔληϯλʔʹҠͬͯ ࣗ࡞αʔόͷ৺ΛΕͯ͠·ͬͨͷ͔
ͦΜͳ͜ͱͳ͍
ࣗ࡞αʔόͰഓͬͨίετҙࣝ ϕϯμʔαʔόʹͳͬͯมΘΒͳ͍
ϝʔΧʔɺػछݻఆ͠ͳ͍
ύʔπ Ձ֨DPNɺ"NB[POͰௐୡ
σʔληϯλʔࣗసंͰߦ͘
ࣗ࡞αʔόͷϊϋ ϐΫγϒʹੜ͖ଓ͚͍ͯΔ
QJYJWͷαʔό༻్ʹΑͬͯεϖοΫ͕༷ʑ $16ίΞίΞ ɹϝϞϦ(#(# ϝϞϦ͕Γͳ͘ͳͬͨΒͦͷͱ͖ʹ૿͢ ৽॓ͳΒࣗసंͰ૿͠ʹ͍͚Δ ຽੜͰϕϯμʔͰނোมΘΒͳ͍
2014
the New B-28 The fastest CPU included
None
2ഒαΠζͷMDF൘Λ࠾༻ʢͭ·Γ2Uʣ Supermicro X9DRi-LN4F+ Xeon E5-2640 v2 BOX x 2 960GB
SSD x 4 56GB MEM B-28RE (Ծশ) ¥60,000 ¥95,000 x 2 ¥50,000 x 2
2014 ࣗࣾαʔόʔϧʔϜΛ։ൃɾղੳͷڌʹ ࣗࣾαʔόʔϧʔϜʹ24UϥοΫΛઃஔ ԾڥΛඋ͍ͯ͘͠༧ఆ !
past future
pixivͷΤϯδχΞ͕ࣗ࡞ΛΊΔ͜ͱͳ͍ ϕχϠ൘ϕϯμʔʹͯ͠ελϯεมΘΒͳ͍ పఈͨ͠ίετҙࣝΛ͍ͬͯͬͯ͘ ! ! !