Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Amazon ECS と SpotFleet を活用した スケーラブルで低コストな ジョブワー...

Avatar for mats mats
June 01, 2017

Amazon ECS と SpotFleet を活用した スケーラブルで低コストな ジョブワーカーシステム / Amazon ECS x SpotFleet

AWS Summit Tokyo 2017 の発表資料です。

Avatar for mats

mats

June 01, 2017
Tweet

More Decks by mats

Other Decks in Technology

Transcript

  1. Copyright(C) Intimate Merger, Inc. All rights reserved 1 "NB[PO&$4ͱ 4QPU'MFFU

    Λ׆༻ͨ͠ εέʔϥϒϧͰ௿ίετͳ δϣϒϫʔΧʔγεςϜ גࣜձࣾΠϯςΟϝʔτɾϚʔδϟʔ ։ൃຊ෦ɾ43&άϧʔϓ দా࿨थ
  2. • ΠϯςΟϝʔτɾϚʔδϟʔʹ͍ͭͯ • δϣϒϫʔΧʔγεςϜ • ߏஙͷഎܠ • ୈҰੈ୅ ඇEPDLFS •

    ୈೋੈ୅ • "NB[PO&$4ͷӡ༻ͷϙΠϯτ • ࣮ӡ༻ͯ͠Έͯ • ͜Ε͔Β "NB[PO&$4Λ࠾༻͢Δํ΁ Copyright(C) Intimate Merger, Inc. All rights reserved 3 ΞδΣϯμ
  3. nגࣜձࣾΠϯςΟϝʔτɾϚʔδϟʔ • ։ൃຊ෦ • 43&άϧʔϓʢςοΫϦʔυʣ n৬຿಺༰ • σʔλॲཧج൫ͷ։ൃ • σϓϩΠϑϩʔͷ੔උ

    • ύϑΥʔϚϯεɾνϡʔχϯά • ؂ࢹɾӡ༻ • ٕज़ݕূɾπʔϧݕূ ࣗݾ঺հ Copyright(C) Intimate Merger, Inc. All rights reserved 5 দా ࿨थ
  4. ઃཱ ୅ද ैۀһ਺ ࣄۀ಺༰ Copyright(C) Intimate Merger, Inc. All rights

    reserved 6 גࣜձࣾΠϯςΟϝʔτɾϚʔδϟʔ ೥݄ ᝽ౡ ྄࣍ ໊ %.1ͷఏڙɾߏஙࢧԉ σʔλ׆༻ίϯαϧςΟϯά
  5. • Ҏ্ͷࣾ֎γεςϜͱσʔλͷड͚౉͠ • ࿈ܞઌຖʹҟͳΔσʔλܗࣜ • ҟͳΔલॲཧ͕ඞཁ • ࿈ܞઌຖʹҟͳΔ઀ଓํࣜ • FY

    3&45"1* '51 4'51 "NB[PO4 1SPUPDPM#VGGFST ˠ ݁Ռɺछྨ΋ͷϫʔΧʔ͕ඞཁʹ • ංେԽ͢Δॲཧσʔλ • σʔλͷॲཧྔʹରͯ͠εέʔϧ͢Δ࢓૊Έ͕ඞཁ • ಛఆͷδϣϒͷΈεέʔϧ͍ͤͨ͞ Copyright(C) Intimate Merger, Inc. All rights reserved 8 ߏஙͷഎܠ
  6. Auto Scaling group Copyright(C) Intimate Merger, Inc. All rights reserved

    9 ୈҰੈ୅ "NB[PO 4 "NB[PO 424 "NB[PO $MPVE8BUDI "NB[PO 4 BMBSN 'JMF  ϑΝΠϧΛ "NB[PO4΁Ξοϓϩʔυ  "NB[PO4&WFOU/PUJGJDBUJPOTͰ "NB[PO424΁௨஌  "NB[PO$MPVE8BUDI ͰΩϡʔͷ਺Ͱϫʔ ΧʔͱͳΔ "NB[PO&$Λ "VUP4DBMJOH ʢ4QPU*OTUBODFʣ  ϫʔΧʔ͸ "NB[PO424͔ΒΩϡʔΛɺ "NB[PO4͔Βॲཧର৅ͷϑΝΠϧΛऔಘ͠ɺ ॲཧΛ։࢝  ޙଓॲཧ͕͋Δ৔߹͸ɺผͷ "NB[PO4΁
  7. Auto Scaling group Copyright(C) Intimate Merger, Inc. All rights reserved

    10 ୈҰੈ୅ "NB[PO 4 "NB[PO 424 "NB[PO $MPVE8BUDI "NB[PO 4 BMBSN 'JMF  ϑΝΠϧΛ "NB[PO4΁Ξοϓϩʔυ  "NB[PO4&WFOU/PUJGJDBUJPOTͰ "NB[PO424΁௨஌  "NB[PO$MPVE8BUDI ͰΩϡʔͷ਺Ͱϫʔ ΧʔͱͳΔ "NB[PO&$Λ "VUP4DBMJOH ʢ4QPU*OTUBODFʣ  ϫʔΧʔ͸ "NB[PO424͔ΒΩϡʔΛɺ "NB[PO4͔Βॲཧର৅ͷϑΝΠϧΛऔಘ͠ɺ ॲཧΛ։࢝  ޙଓॲཧ͕͋Δ৔߹͸ɺผͷ "NB[PO4΁
  8. Auto Scaling group Copyright(C) Intimate Merger, Inc. All rights reserved

    11 ୈҰੈ୅ "NB[PO 4 "NB[PO 424 "NB[PO $MPVE8BUDI "NB[PO 4 BMBSN 'JMF  ϑΝΠϧΛ "NB[PO4΁Ξοϓϩʔυ  "NB[PO4&WFOU/PUJGJDBUJPOTͰ "NB[PO424΁௨஌  "NB[PO$MPVE8BUDI ͰΩϡʔͷ਺Ͱϫʔ ΧʔͱͳΔ "NB[PO&$Λ "VUP4DBMJOH ʢ4QPU*OTUBODFʣ  ϫʔΧʔ͸ "NB[PO424͔ΒΩϡʔΛɺ "NB[PO4͔Βॲཧର৅ͷϑΝΠϧΛऔಘ͠ɺ ॲཧΛ։࢝  ޙଓॲཧ͕͋Δ৔߹͸ɺผͷ "NB[PO4΁
  9. Auto Scaling group Copyright(C) Intimate Merger, Inc. All rights reserved

    12 ୈҰੈ୅ "NB[PO 4 "NB[PO 424 "NB[PO $MPVE8BUDI "NB[PO 4 BMBSN 'JMF  ϑΝΠϧΛ "NB[PO4΁Ξοϓϩʔυ  "NB[PO4&WFOU/PUJGJDBUJPOTͰ "NB[PO424΁௨஌  "NB[PO$MPVE8BUDI ͰΩϡʔͷ਺Ͱϫʔ ΧʔͱͳΔ "NB[PO&$Λ "VUP4DBMJOH ʢ4QPU*OTUBODFʣ  ϫʔΧʔ͸ "NB[PO424͔ΒΩϡʔΛɺ "NB[PO4͔Βॲཧର৅ͷϑΝΠϧΛऔಘ͠ɺ ॲཧΛ։࢝  ޙଓॲཧ͕͋Δ৔߹͸ɺผͷ "NB[PO4΁
  10. Auto Scaling group Copyright(C) Intimate Merger, Inc. All rights reserved

    13 ୈҰੈ୅ "NB[PO 4 "NB[PO 424 "NB[PO $MPVE8BUDI "NB[PO 4 BMBSN 'JMF  ϑΝΠϧΛ "NB[PO4΁Ξοϓϩʔυ  "NB[PO4&WFOU/PUJGJDBUJPOTͰ "NB[PO424΁௨஌  "NB[PO$MPVE8BUDI ͰΩϡʔͷ਺Ͱϫʔ ΧʔͱͳΔ "NB[PO&$Λ "VUP4DBMJOH ʢ4QPU*OTUBODFʣ  ϫʔΧʔ͸ "NB[PO424͔ΒΩϡʔΛɺ "NB[PO4͔Βॲཧର৅ͷϑΝΠϧΛऔಘ͠ɺ ॲཧΛ։࢝  ޙଓॲཧ͕͋Δ৔߹͸ɺผͷ "NB[PO4΁
  11. Auto Scaling group Copyright(C) Intimate Merger, Inc. All rights reserved

    14 ୈҰੈ୅ "NB[PO 4 "NB[PO 424 "NB[PO $MPVE8BUDI "NB[PO 4 BMBSN 'JMF  ϑΝΠϧΛ "NB[PO4΁Ξοϓϩʔυ  "NB[PO4&WFOU/PUJGJDBUJPOTͰ "NB[PO424΁௨஌  "NB[PO$MPVE8BUDI ͰΩϡʔͷ਺Ͱϫʔ ΧʔͱͳΔ "NB[PO&$Λ "VUP4DBMJOH ʢ4QPU*OTUBODFʣ  ϫʔΧʔ͸ "NB[PO424͔ΒΩϡʔΛɺ "NB[PO4͔Βॲཧର৅ͷϑΝΠϧΛऔಘ͠ɺ ॲཧΛ։࢝  ޙଓॲཧ͕͋Δ৔߹͸ɺผͷ "NB[PO4΁
  12. Auto Scaling group Copyright(C) Intimate Merger, Inc. All rights reserved

    15 ୈҰੈ୅ "NB[PO 4 "NB[PO 424 "NB[PO $MPVE8BUDI "NB[PO 4 BMBSN 'JMF  ϑΝΠϧΛ "NB[PO4΁Ξοϓϩʔυ  "NB[PO4&WFOU/PUJGJDBUJPOTͰ "NB[PO424΁௨஌  "NB[PO$MPVE8BUDI ͰΩϡʔͷ਺Ͱϫʔ ΧʔͱͳΔ "NB[PO&$Λ "VUP4DBMJOH ʢ4QPU*OTUBODFʣ  ϫʔΧʔ͸ "NB[PO424͔ΒΩϡʔΛɺ "NB[PO4͔Βॲཧର৅ͷϑΝΠϧΛऔಘ͠ɺ ॲཧΛ։࢝  ޙଓॲཧ͕͋Δ৔߹͸ɺผͷ "NB[PO4΁
  13. AutoScaling Copyright(C) Intimate Merger, Inc. All rights reserved 16 ୈҰੈ୅

    "NB[PO 4 "NB[PO 424 "NB[PO $MPVE8BUDI BMBSN Elasticsearch から IDを抽出 AutoScaling "NB[PO 4 "NB[PO 424 "NB[PO $MPVE8BUDI BMBSN ID の変換 AutoScaling "NB[PO 4 "NB[PO 424 "NB[PO $MPVE8BUDI BMBSN Amazon S3 へ アップロード
  14. Auto Scaling group Copyright(C) Intimate Merger, Inc. All rights reserved

    17 ୈҰੈ୅ "NB[PO 4 "NB[PO 424 "NB[PO $MPVE8BUDI ՝୊ • εϙοτྉۚͷߴಅ࣌ͳͲɺಛఆͷϫʔΧʔ͕ ىಈෆՄͱͳΔ • ϫʔΧʔຖʹϦιʔεʢ*OTUBODF 5ZQFʣͷ ௐ੔͕ඞཁͳ্ɺશମͰͷϦιʔεޮ཰͕ѱ͍ • ॲཧ։࢝·Ͱͷ଴ػ͕࣌ؒ௕͍ • "VUP4DBMJOH ͷઃఆ͕ଟ͘ͳΓɺӡ༻ෛՙ͕ େ͖͍ "NB[PO 4 BMBSN 'JMF
  15. spot fleet Copyright(C) Intimate Merger, Inc. All rights reserved 18

    ୈೋੈ୅ "NB[PO 4 "NB[PO 424 "NB[PO $MPVE8BUDI • جຊઃܭ͸ಉ༷ • શϫʔΧʔͷ࣮ߦ؀ڥΛίϯςφʹҠߦ • શϫʔΧʔͰ EPDLFSج൫Λڞ༻ • EPDLFSج൫ʹ "NB[PO&$4Λ࠾༻ • EPDLFSج൫ͷىಈʹ 4QPU'MFFUΛ࠾༻ • ֤ϫʔΧʔຖʹίϯςφΛ "VUP4DBMJOH "NB[PO 4 BMBSN 'JMF "NB[PO &$4
  16. Copyright(C) Intimate Merger, Inc. All rights reserved 19 • ͷαʔϏε͕Քಇ

    • छྨͷϫʔΧʔɺ.BDLFSFMʢ؂ࢹʣ ɺ'MVFOUEʢϩάίϨΫλʣ • λεΫ਺͸ʙ • ίϯςφϨδετϦʹ͸ "NB[PO&$3Λ࠾༻ ୈೋੈ୅  "NB[PO&$4
  17. Copyright(C) Intimate Merger, Inc. All rights reserved 20 • ༰ྔ͸

    W$16T • ೖࡳ͸ ࣗಈೖࡳ • *OTUBODF5ZQF͸ छ • $ܥɺ.ܥ ୈೋੈ୅  4QPU'MFFU
  18. • ϩάͷϋϯυϦϯά • ؀ڥߏங • σϓϩΠϑϩʔ • ڧ੍ 5FSNJOBUFʢ4QPU*OTUBODFʣ •

    ".* • DMPVEJOJU Copyright(C) Intimate Merger, Inc. All rights reserved 22 "NB[PO&$4ͷӡ༻ͷϙΠϯτ
  19. Copyright(C) Intimate Merger, Inc. All rights reserved 23 ϩάͷϋϯυϦϯά "QQ

    "QQ "QQ "QQ "NB[PO "VSPSB (PPHMF#JH2VFSZ • ֤*OTUBODFͰՔಇ͢Δ GMVFOUE ίϯςφͰϩάΛू໿ • ϫʔΧʔ͔Β͸ UDQͰࢀর • MPHEOB ϩάͷ -JWF5BJMςΩετϚονʹΑΔΞϥʔτ • #JH2VFSZ ௕ظʹ౉Δ෼ੳ༻ • "NB[PO"VSPSB௚ۙσʔλͷ෼ੳɺࢀর༻
  20. Copyright(C) Intimate Merger, Inc. All rights reserved 24 • ϩάऩूͷΫϥ΢υαʔϏε

    • ϦΞϧλΠϜʹࢀর͢Δ͜ͱ͕Մೳ UBJMG • ςΩετϚονʹΑΔΞϥʔτػೳ • 4MBDL &NBJM 8FCIPPL  • ௿ίετ • (#NPOUIʙ
  21. • 5FSSBGPSNΛ࠾༻ • (JU)VCͰ؅ཧ • $JSDMF$* ্Ͱ࣮ߦ • ֤ϫʔΧʔຖʹίϯϙʔωϯτΛ࡞੒ •

    "NB[PO 4 • #VDLFU • &WFOU • "NB[PO424 • "NB[PO$MPVE8BUDI • "NB[PO &$4 • "VUP4DBMJOH Copyright(C) Intimate Merger, Inc. All rights reserved 25 ؀ڥߏங (JU)VC $JSDMF$* 8FCIPPL "NB[PO 4 "NB[PO 424 "NB[PO $MPVE8BUDI "NB[PO &$4 5FSSBGPSN
  22. • $JSDMF$* ͔Β"1*ܦ༝ͰσϓϩΠ • EPDLFSCVJME • EPDLFSQVTI "NB[PO&$3 • 5BTL%FGJOJUJPOͷ࡞੒

    "NB[PO&$4 • &$44FSWJDFͷߋ৽ "NB[PO&$4 • ίʔυ͸ 1ZUIPO੡ CPUP • EPDLFS͕ར༻Մೳͳ $*αʔϏεͷ ׆༻͕͓͢͢Ί Copyright(C) Intimate Merger, Inc. All rights reserved 26 (JU)VC $JSDMF$* 8FCIPPL σϓϩΠϑϩʔ EPDLFS CVJME EPDLFS QVTI 5BTL%FGJOJUJPO࡞੒ 4FSWJDFߋ৽ "NB[PO &$3 "NB[PO &$4
  23. • Ձ֨ߴಅ࣌ͳͲڧ੍ 5FSNJOBUF࣌͸ɺਖ਼ৗͳγϟοτμ΢ϯ ϓϩηε͕ߦΘΕͳ͍ • ίϯςφ͕ڧ੍ఀࢭ͞ΕΔ • 8FCαʔόͷ৔߹͸ಛʹӨڹ͕େ͖͍ • 5FSNJOBUFͷݕ஌

    • ඵ͓͖ʹϝλσʔλΛࢀর • IUUQMBUFTUNFUBEBUBTQPUUFSNJOBUJPOUJNF • ݕ஌ޙɺ"NB[PO&$4$MVTUFS͔Βୀ໾ • ίϯςφ͸ଞͷ *OTUBODFʹΦϑϩʔυ͞ΕΔ • BNB[POFDTBHFOUͷػೳʹೖΕͯཉ͍͠ɾɾɾ Copyright(C) Intimate Merger, Inc. All rights reserved 27 ڧ੍5FSNJOBUFʢ4QPU*OTUBODFʣ
  24. • "NB[PO&$40QUJNJ[FE".*Λ࠾༻ • "NB[PO&$4ʹ࠷దԽ͞Ε͍ͯΔ • ࠷৽൛Λͦͷ··ར༻ • ZVNVQEBUF͠ͳ͍ • ".*ͷΧελϚΠζ࡞੒͸ߦΘͳ͍

    • ඞཁͳઃఆ͸ DMPVEJOJU ͔Βߦ͏ • ඞཁ࠷௿ݶͷઃఆͷΈߦ͍ɺηΩϡΞʹอͭͨΊ • "NB[PO4ʹ഑ஔͯ͠ࢀর Copyright(C) Intimate Merger, Inc. All rights reserved 28 ".*ʹ͍ͭͯ
  25. • "NB[PO4ʹ ZBNM Λ഑ஔͯ͠ࢀর • DMPVEJOJU มߋ࣌ʹ 4QPU'MFFUͷ ࡞Γ௚͕͠ඞཁʹͳΔͨΊ •

    71$&OEQPJOUͰݖݶΛ෇༩ • IUUQͰࢀর͢ΔͨΊʹඞཁ • DMPVEDPOGJH ܗࣜͰهड़ • ࣮ߦλΠϛϯάΛ੍ޚͰ͖ΔͨΊ Copyright(C) Intimate Merger, Inc. All rights reserved 29 DMPVEJOJU JODMVEF IUUQTTBQOPSUIFBTUBNB[POBXTDPN#VDLFUDMPVEJOJUZNM
  26. Copyright(C) Intimate Merger, Inc. All rights reserved 30 DMPVEJOJU Ͱߦ͍ͬͯΔ͜ͱ

    • ڧ੍ 5FSNJOBUFΛݕ஌͢Δ DSPOʢલड़ʣ • Χʔωϧύϥϝʔλͷมߋ • "NB[PO&$4ͷઃఆʢFUDFDTFDTDPOGJHʣ • *OTUBODF4UPSFͷϚ΢ϯτ • %PDLFS&OHJOFىಈલʹϚ΢ϯτ͠ͳ͍ͱར༻Ͱ͖ͳ͍ • CPPUDNE εςοϓͰͷϚ΢ϯτ͕ඞਢʢDMPVEDPOGJH ਪ঑ʣ
  27. • Մ༻ੑͷ޲্ • 4QPU'MFFUʹΑΓɺεϙοτՁ֨ͷߴಅͷӨڹΛड͚ʹ͘͘ͳͬͨ • ίετޮ཰ͷ޲্ • Մ༻ੑͷ޲্ʹΑΓɺੵۃతʹ৽ੈ୅ͷ *OTUBODFΛબ୒Մೳ •

    04෼ͷϦιʔε͕ෆཁʹͳΓɺಉ࣌ىಈ਺͕޲্ • 6QUJNFΛؾʹͤͣɺίϯςφͷ্͛Լ͕͛Մೳ Copyright(C) Intimate Merger, Inc. All rights reserved 32 "NB[PO&$4ʹͯ͠ྑ͔ͬͨ఺
  28. • εϐϯΞοϓ࣌ؒͷ୹ॖ • 4QPU*OTUBODF͸ىಈʹ͕͔͔࣌ؒΔ • EPDLFS͕ 4QPU*OTUBODFͷσϝϦοτΛิ׬ • "84ͷଞαʔϏεͱͷ࿈ܞ •

    "84ͱ౷߹͞Ε͍ͯΔͨΊɺطଘͷ࢓૊ΈΛେ͖͘ม͑ͣʹ "VUP4DBMJOH ౳͕ར༻Մೳ Copyright(C) Intimate Merger, Inc. All rights reserved 33 "NB[PO&$4ʹͯ͠ྑ͔ͬͨ఺
  29. • Ϋϥελ؅ཧͱ͍͏఺Ͱ͸՝୊΋ଟ͍ • BHFOUํࣜͳͷͰɺ٧·ͬͨΓϥά͕ੜͨ͡Γ͢Δ͜ͱ΋ଟʑ • "NB[PO&$తʹ 5FSNJOBUF͞Ε͍ͯΔ͕ɺ$MVTUFSʹ࢒͍ͬͯ Δ͜ͱ΋ • EPDLFSͷશػೳ͕࢖͑ΔΘ͚Ͱ͸ͳ͍

    • BHFOUܦ༝Ͱ EPDLFSΛ؅ཧ͍ͯ͠ΔͨΊɺ FDTBHFOUʹ࣮૷͞ Ε͍ͯͳ͍ػೳ͸࢖͑ͳ͍ Copyright(C) Intimate Merger, Inc. All rights reserved 34 "NB[PO&$4ͷ՝୊
  30. Copyright(C) Intimate Merger, Inc. All rights reserved 36 શ 4FSWJDFΛදࣔͰ͖ͳ͍

    • "NB[PO&$4ͷ؅ཧը໘ʹ શ 4FSWJDFΛදࣔͰ͖ͳ͍ • ্ݶ͕ • ϖʔδૹΓ͕ඞཁ
  31. Copyright(C) Intimate Merger, Inc. All rights reserved 39 4QPU'MFFU͸ઃఆมߋ͕ෆՄ •

    $BQBDJUZͷมߋͷΈՄ • Լهͷมߋ͸Ͱ͖ͳ͍ • ".* • *OTUBODF5ZQF • 6TFSEBUB DMPVEJOJU
  32. • ෳ਺ ";Ͱಉ࣌ʹߴಅ͢Δ͜ͱ΋͋Δ • ͦͷϨΞέʔε͕ҟͳΔ *OTUBODF5ZQFͰಉ࣌ʹى͜Δ͜ͱ ΋͋Δ Copyright(C) Intimate Merger,

    Inc. All rights reserved 40 4QPU1SJDFͷτϨϯυ BQOPSUIFBTUB BQOPSUIFBTUD NYMBSHF NYMBSHF
  33. • ಉҰ *OTUBODF'BNJMZ͕ಉ࣌ʹߴಅ͢Δ͜ͱ΋͋Δ • աڈʹ૬͕ؔͳͯ͘΋ɺಉ࣌ʹߴಅ͢ΔՄೳੑ͸େ͍ʹ͋Δ Copyright(C) Intimate Merger, Inc. All

    rights reserved 41 BQOPSUIFBTUD NYMBSHF NYMBSHF NYMBSHF NYMBSHF 4QPU1SJDFͷτϨϯυ
  34. • Ϋϥελ؅ཧͱͯ͠ͷ "NB[PO&$4 • ָͳ໘΋ଟ͍͕ɺಠࣗͷ֓೦΋ଟ͘ɺֶशίετ͕௿͍Θ͚Ͱ͸ͳ͍ • ബ͍ϥούʔͰ͋Δ͕ނʹ΍΍؇ຫ • ,VCFSOFUFT౳ͷํ͕ߴػೳ͔ͭػහ •

    (JU)VCͷ BNB[POFDTBHFOUͷϖʔδ͸ݟΔ΂͖ • "NB[PO&$4ͷڧΈ͸"84ͷଞͷαʔϏεͱͷ࿈ܞ • &MTBUJD -PBE#BMBODFS • "VUP4DBMJOH • "NB[PO$MPVE8BUDI Copyright(C) Intimate Merger, Inc. All rights reserved 43 ͜Ε͔Β "NB[PO&$4Λ࠾༻͢Δํ΁
  35. • 4QPU'MFFU ͸͓͢͢Ί͕ͩɺൃల్্ • "NB[PO&$4ར༻࣌͸࢖͏΂͖ • ͍҆ɺӡ༻ָ͕ • ࡉ͔͘ϋϯυϦϯά͍ͯ͠ͳ͍෼ɺ࣮ӡ༻ͯ͠Έͳ͍ͱ෼͔Βͳ͍͜ ͱ΋ଟ͍

    • ҙ֎ͱ௿ϨΠϠʔͷ஌͕ࣝඞཁ • LFSOFM • JOJU ىಈؔ࿈ • DMPVEJOJU Copyright(C) Intimate Merger, Inc. All rights reserved 44 ͜Ε͔Β "NB[PO&$4Λ࠾༻͢Δํ΁