ペパボ・はてな技術大会@福岡の発表資料です。
ԾԽج൫ͷϦιʔε࠷దԽid:taketo957 ͯͳɾϖύϘٕज़େձ@Ԭ
View Slide
ࣗݾհ• id:taketo957• ͯͳͰΠϯϑϥ• 20164݄ೖࣾ• ࢼ༻ظ͕ؒऴΘͬͨ• ࠂपΓ• ֶੜ࣌• ਪનͱ͔• ISUCON
ରௌऺ• ओʹֶੜ• ΠϯϑϥΤϯδχΞͬͯͲΜͳ͜ͱͯ͠Δͷʁ• େֶͰษڧͯ͠Δ͜ͱ͕ͲΜͳ෦Ͱཱͭͷʁ• ͦͷଞ• ෳͷେنͳαʔϏεӡ༻ͷཪଆ
࣍• ͯͳʹ͓͚ΔԾԽج൫• ԾԽج൫ͷӡ༻্ͷ՝• ԾԽج൫্ͰͷϦιʔεஔͷ࠷దԽ• ·ͱΊ
ͯͳʹ͓͚ΔԾԽج൫
WebγεςϜͷయܕߏ-#1SPYZ"QQMJDBUJPO%BUBCBTF
WebγεςϜͷయܕߏ-#1SPYZ"QQMJDBUJPO%BUBCBTF$16 .FN %JTL /FU$16 .FN %JTL /FU$16 .FN %JTL /FU$16 .FN %JTL /FU
ͯͳʹ͓͚ΔWebαʔϏε
αʔϏεͱϩʔϧ͕ ͱʹ͔͘ଟ͍
ͯͳʹ͓͚ΔԾԽ• ཧαʔόΛԾԽͯ͠Δ• ཧϗετɿxxx• ԾԽϗετɿxxx• αʔϏεɿxxxݸ• ϩʔϧɿxxxݸ• ԾԽج൫ʹXenΛͬͯΔ
Xenͱ• ԾϚγϯϞχλ• ෳͷOSΛฒྻʹಈ࡞ͤ͞Δ͜ͱ͕Ͱ͖Δ• Dom0ͱDomU• Dom0͕XenͷཧϋʔυΣΞΞΫηεΛ୲͏• DomUϋʔυΣΞʹΞΫηε͠ͳ͍• AWSͷཪଆXen
XenͷΠϝʔδ• ϋΠύʔόΠβ͕ϋʔυΣΞ্Ͱ࣮ߦ• Xenىಈ࣌ʹDom0͕ىಈ• γεςϜىಈޙɼDomUͳͲ͕ىಈϋʔυΣΞ9FOϋΠύʔόΠβ%PN %PN6 %PN6ήετ্ͷϓϩηε ήετ্ͷϓϩηε ήετ্ͷϓϩηε
ԾԽαʔόͷߏங@ͯͳ• ϋʔυΣΞϦιʔεͷར༻ͷ্• ϩʔϧ͝ͱʹඞཁͳϦιʔε ͍͍ܾͩͨ·ͬͯΔ• ྫ͑ɼ• CPU͕ۭ͍͍ͯΔˠWebαʔό• IO͕ۭ͍͍ͯΔˠDBαʔό• ಉډΛආ͚ΔΈ߹Θͤ• ෛՙͷߴ͍ͷಉ࢜ආ͚Δ• ಉ͡༻్ͷͷආ͚Δ• ॏཁͳϗετ͚͞Δ%PNϋʔυΣΞ%PN6 8FCαʔό%PN6 %#αʔό%PN6 Ωϟογϡαʔό
ԾԽج൫ͷӡ༻্ͷ՝
ԾԽपΓͷΦϖϨʔγϣϯ• ԾԽपΓͷΦϖϨʔγϣϯ• ৽ن࡞• ෛՙରࡦ• Ҿͬӽ͠• ϋʔυΣΞނো• আ• αʔϏεఫୀ• ৽ن࡞ɺҾͬӽ͠ͷࡍʹ• DomU࡞ઌͷDom0Λબఆ͠ͳ͍ͱ͍͚ͳ͍
ήετ࡞࣌ʹؾʹ͔͚Δ͜ͱʢϦιʔεฤʣ• CPU༻ɺDiskIOɺফඅిྗΛؾʹ͔͚Δ• ϩʔϧԿͳͷ͔• ͦͷϩʔϧͲͷ͘Β͍ͷϦιʔεΛফඅ͢Δͷ͔• ϥοΫͷফඅిྗେৎ͔ʁ• ੑΛ࣋ͨͤΔ• ిݯ͕མͪͨ߹• Dom0͝ͱࢮΜͩ߹• εΠον͕ࢮΜͩ߹• ͷϝϞϦͱσΟεΫ༰ྔʹ༨༟͋Δ͔
ήετ࡞࣌ʹؾʹ͔͚Δ͜ͱʢࣾࣄฤʣ• ݹ͍ڥආ͚Δ• ੲ͔Β͋Δࣺ͍ͯͨڥʹ࡞Βͳ͍• ࣺͯΔ༧ఆͷͷʹ࡞Βͳ͍• ϥοΫαϒωοτͷੑ࣭• ஔ͖ॴ͕ܾ·͍ͬͯΔϩʔϧ• ωοτϫʔΫػث• ॏཁͳϗετͱͷಉډආ͚Δ• etc…
Dom0৬ਓͷੜ
ཧπʔϧ͕͋Δͱ͍͑ େͳϗετ͔ΒબͿͷݫ͍͠
͕૿Ճ͍ͯ͘͠ͱ ਓؒͷצͰରԠͰ͖ͳ͍
࠷దͳஔΛ͠ͳ͍ͱͲ͏ͳΔ͔• ಉډϗετʹҾ͖ͣΒΕͯ͝ͱࢮ͵• ϒϨʔΧʔ͕མͪͨΒಉ͡ిݯܥ౷ͷͷ͕શ໓• ωοτϫʔΫଳҬ͕٧·ͬͨΓ
Dom0બͼ αʔϏεΛ҆ఆՔಇͤ͞ΔͨΊʹ ۃΊͯॏཁͳ࡞ۀ
ߟྀ͢Δ߲͕ଟ͍͔Β બఆʹ͔͔Δίετߴ͍
ίετ͕ߴ͍બఆ࡞ۀΛ ࣗಈԽ͍ͨ͠
ԾԽج൫ͷϦιʔε࠷దԽ
ͷ֓ཁ• εϖοΫ͕ܾ·ͬͨDomUΛͲ͜ʹೖΕΔͷ͕࠷ద͔ˠΈ߹Θͤ࠷దԽʢࠞ߹ܭըʣ%PNϋʔυΣΞ$16 .FN /FU %JTL%PNϋʔυΣΞ$16 .FN /FU %JTL%PNϋʔυΣΞ$16 .FN /FU %JTL%PN6 8FCαʔό$16 .FN /FU %JTL%PN6 %#αʔό$16 .FN /FU %JTL%PN6 1SPYZαʔό$16 .FN /FU %JTL… …ʁ ʁ ʁ
ϏϯύοΩϯά• ༩͑ΒΕͨՙΛ٧ΊΔശͷ࠷খΛݟ͚ͭΔ• ۩ମྫ• 8ͷ৽ंΛτϥοΫͰҠಈ͢Δ• ৽ंͷॏྔ [33, 61, 58, 41, 50, 21, 60, 64]• τϥοΫͷ༰ྔ 120• τϥοΫͷ࠷খΛٻΊΔ
ϏϯύοΩϯάͷΠϝʔδॏ͞ɿ33ॏ͞ɿ61ॏ͞ɿ58ॏ͞ɿ41ॏ͞ɿ50ॏ͞ɿ21ॏ͞ɿ60ॏ͞ɿ64༰ྔɿ120༰ྔɿ1201234567812τϥοΫԿඞཁͳͷ͔ʁ
ϏϯύοΩϯάͷΠϝʔδॏ͞ɿ33ॏ͞ɿ61ॏ͞ɿ58ॏ͞ɿ41ॏ͞ɿ50ॏ͞ɿ21ॏ͞ɿ60ॏ͞ɿ64༰ྔɿ120༰ྔɿ1201234567812xi,j2 {0,1} 8i, jyj2 {0, 1} 8jXjxij = 1 8i☓Xiwixijc8jc=120
ϏϯύοΩϯάͷఆࣜԽXiyixi,j2 {0,1} 8i, jyj2 {0, 1} 8jXjxij = 1 8iXiwixijc8jxi,jyj8i, jతؔม੍→࠷খԽ͢Δ
DomUׂ• ϏϯύοΩϯάΛn࣍ݩʹ֦ுͨ͠ͷΛ͏• ϏϯύοΩϯάͰߟྀͨ͠ͷॏ͞ͷΈ• ߟྀ͢Δ͜ͱ• CPUʢΦʔόʔίϛοτΛߟྀʣ• ϝϞϦ༰ྔ• σΟεΫ༰ྔ• ಉډͷΈ߹Θͤ• ࣾͷӡ༻ࣄ
DomUׂͷΠϝʔδ%PN6$16.FN%JTL1%PN6$16.FN%JTL2%PN6$16.FN%JTL3%PN6$16.FN%JTL4%PN6$16.FN%JTL5%PN6$16.FN%JTL6%PN$16.FN%JTL%PN$16.FN%JTL12DomUԿඞཁͳͷ͔ʁ
DomUׂͷΠϝʔδ%PN6$16.FN%JTL1%PN6$16.FN%JTL2%PN6$16.FN%JTL3%PN6$16.FN%JTL4%PN6$16.FN%JTL5%PN6$16.FN%JTL6%PN$16.FN%JTL%PN$16.FN%JTL12Xi,j2 {0, 1} 8i, jYimemiXjmem0jXi,j8iYicpuiXjcpu0jXi,j8iYidiskiXjdisk0jXi,j8iYi2 {0, 1}8i☓XiXi,j = 1 8j
ಉډͷΈ߹ΘͤΛߟྀ%PN6$16.FN%JTL1%PN6$16.FN%JTL2%PN6$16.FN%JTL3%PN6$16.FN%JTL4%PN6$16.FN%JTL5%PN6$16.FN%JTL6%PN$16.FN%JTL%PN$16.FN%JTL12Xi,j2 {0, 1} 8i, jYimemiXjmem0jXi,j8iYicpuiXjcpu0jXi,j8iYidiskiXjdisk0jXi,j8iYi2 {0, 1}8iXj2W ebserversXi,j 1 8i8FC8FC☓αʔϏεʹ͍ͭͯಉ༷ͷ੍ͰදݱͰ͖Δ
ࣾͷӡ༻ࣄΛߟྀ%PN6$16.FN%JTL1%PN6$16.FN%JTL2%PN6$16.FN%JTL3%PN6$16.FN%JTL4%PN6$16.FN%JTL5%PN6$16.FN%JTL6%PN$16.FN%JTL%PN$16.FN%JTL12Xi,j2 {0, 1} 8i, jYimemiXjmem0jXi,j8iYicpuiXjcpu0jXi,j8iYidiskiXjdisk0jXi,j8iYi2 {0, 1}8iXi,j = 0 9i, j1SPYZ☓1SPYZ༻
DomUׂͷఆࣜԽXi,j2 {0, 1} 8i, jYimemiXjmem0jXi,j8iYicpuiXjcpu0jXi,j8iYidiskiXjdisk0jXi,j8iYi2 {0, 1}8iXiXi,j = 1 8jతؔม੍XiYi→࠷খԽ͢ΔYi Xi,j8i, jXj2W ebserversXi,j 1 8iXi,j = 0 9i, jXj2DBserversXi,j 1 8iಉډͷΈ߹Θͤӡ༻ࣄ
͜ΕΛղ͘
࣮• Python 2.7• PuLPΛͬͨ• શମͷྲྀΕ• DomUͱDom0ͷσʔλΛఆٛ• มͷఆٛʢࠓճ2͚ͭͩʣ • తؔͱ੍݅Λॻ͖Լ͍ͯ͘͠X = LpVariable.dicts('X', (range(M), range(N)), 0, 1, LpBinary)Y = LpVariable.dicts('Y', range(M), 0, 1, LpBinary)for i in range(M):m += Y[i] * dom0s[i]["mem"] * 0.8 >= lpSum([domus[j]["mem"] * X[i][j] for j in range(N)])
খ͍͞σʔληοτͰݕূ• نײ• Dom0 73• DomU 284• ࣮ߦ࣌ؒ 21.537sec• ݁Ռ ײతʹਖ਼͍݁͠Ռɺվળͷ༨͋Δ
࣮ݱͰ͖Δ͜ͱ• શମͷஔͷ࠷దԽ• ࠓ·Ͱͷͬͪ͜• DCҠసͱ͔͠ͳ͍͔͗Γग़൪͕ͳ͍• ཧతͳஔʹ͠Α͏ͱ͢Δͱॱ൪ʹਓ͕ࢮ͵• ৽نՃ࣌ͷDom0બఆͷࣗಈԽ• ੍ͦͷ··͍·ΘͤΔ• DomU͕1• Dom0͕ঢ়ଶΛͬͨঢ়ଶͰ։࢝
ࠓޙΓ͍ͨ͜ͱ• ߴԽ͍ͨ͠• Ϧιʔεͷ࣌ܥྻͷมԽΛߟྀ͍ͨ͠• ωοτϫʔΫతͳτϙϩδʔߟྀ͍ͨ͠• ະͷϩʔϧʹର͢ΔରԠ
ʢ৽ଔ͕ʣֶੜʹ͍͑ͨ͜ͱ• ݚڀྖҬͰ༷ʑͳݚڀ͕ͳ͞Ε͍ͯΔ• େͷ߹Ԡ༻ݚڀͷࣄྫͱ͔͋Δ• ࠓճѻͬͨ݁ߏݚڀ͞Εͯͨ• ࣮ͷݱͩͱ• ۩ମతͳɾधཁͱσʔλ͋Δ• దͳख๏Λબͯ͠ɺࣗͷڥʹద༻Ͱ͖Δྗ• جૅతͳࣝେࣄ• ঢ়گΛదʹϞσϦϯάͰ͖Δྗ• υϝΠϯಛ༗ͷࣝΛ׆͔ͯ͠ղܾ
·ͱΊ• ͯͳʹ͓͍ͯDCͷཧαʔόΛԾԽͯ͠Δ• ϗεςΟϯάܥͱҧͬͯڥ͕ۉ࣭Ͱͳ͍• Xenͷӡ༻पΓͷͱ՝• Ϧιʔε࠷దԽ• ϏϯύοΩϯάͱͦͷ֦ுʹ͍ͭͯ• ӡ༻Λվળ͢ΔͨΊͷπʔϧΛ࡞ͬͨͯΔ
ਓ͕ؒΔՁͷͳ͍ ࡞ۀΛ໓΅͍ͨ͠
taketo957
oldbigbuddha
optimisuke
is_ryo
i35_267
muziyoshiz
orgachem
naohachi89
wakamatsu_takumu
niftycorp
cimadai
yokawasa
bun913
malarkey
paigeccino
rasmusluckow
mojombo
samlambert
pedronauck
hannesfritz
shlominoach
hatefulcrawdad
holman
sugarenia
bkeepers