Data_analyzing_platform_by_OpenStack_Sahara

OpenStack Sahara Λ࢖ͬͨσʔλ෼ੳج൫Λ࡞ͬͨ࿩ CyberAgent, Inc Makoto Hasegawa

ࣗݾ঺հ αΠόʔΤʔδΣϯτΞυςΫຊ෦ʹͯσʔληϯλʔӡ༻΍ 1SJWBUF$MPVE 0QFO4UBDL Λߏஙɾӡ༻ͨ͠Γͯ͠·͢ ࡢ೥͸0QFO4UBDL4VNNJU 7BODPVWFSBOE5PLZP Ͱొஃͤͯ͞௖͖·ͨ͠ ͍Ζ͍ΖͳॴͰͪΐͪ͜ΐ͜ൃදͤͯ͞௖͍ͨΓ͍ͯ͠·͢ .BLPUP)BTFHBXB
!NBLPDDIJ IUUQTXXXGBDFCPPLDPNNBLPDDIJ

ΞυςΫຊ෦ʹ͍ͭͯ Πϯλʔωοτ޿ࠂʹ͓͍ͯɺ޿ࠂ഑৴ͷ࠷దԽ΍ϝσΟΞͷऩӹ࠷େԽͱ͍͏؍ ఺͔ΒΞυςΫϊϩδʔͷॏཁ౓͕ߴ·͍ͬͯ·͢ɻ αΠόʔΤʔδΣϯτͰ͸ΞυςΫϊϩδʔ෼໺ʹ͓͚Δ ͜ΕΒͷαʔϏεʹ͍֤ͭͯࢠձࣾΛ௨͡։ൃ͓ͯ͠Γ·͕ͨ͠ɺ ֤αʔϏεͷ։ൃ෦໳Λԣஅͯ͠૊৫Խ͢Δઐ໳෦ॺͱͯ͠ ΞυςΫຊ෦͕ઃཱ͞Ε·ͨ͠ɻ ΞυςΫຊ෦ʹ͍ͭͯ

͋Δ೔ͷձ࿩ ʮσʔλ෼ੳͷڞ௨ج൫Έ͍ͨͳͷ࡞Εͳ͍͔ͳʁʯ ʮؾܰʹߏஙͰ͖Δ)BEPPQ؀ڥ͋Δͱ͍͍ΑͶʯ ʮඞཁʹԠͯ͡࡞ͬͨΓফͨ͠Γ͍ͨ͠ΑͶʯ ʢͦ͏͍΍&.3 ˞ Έ͍ͨͳ͜ͱ࣮ݱ͢Δ4BIBSBͳΜͯ΋Μ͋ΔΑͳ͊ ɹͰ΋4BIBSBͳΜͯӡ༻Ͱ͖Δؾ͠ͳ͍͠ಈ͔͘΋ո͍͠͠ɺ ɹ৮Γͨ͘ͳ͍ͳɺɺɺ໧ͬͱ͜ʣ ˞"84ͷ&MBTUJD.BQ3FEVDF

͋Δ೔ͷձ࿩ ʮͳΜ͔0QFO4UBDL4BIBSBͬͯͷ͕͋ΔΒ͍͠Αʂʯ ʮ͑ɹͦΕ͍͍͡ΌΜʯ ʮ͏ͪ0QFO4UBDLطʹಈ͔ͯ͠Δ͠ɺ ΠέΔͬ͠ΐʯ ʢ ʂʁʣ

͋Δ೔ͷձ࿩ ʮ4BIBSBΠέΔͬ͠ΐʯ

͋Δ೔ͷձ࿩ɾଓ ʮ ϦϦʔεϲ݄ޙͶʯ ʢʂʁɹαʔόʔͱ͔ ·ͩങͬͯͳ͍Αʁʁʣ

ͱ͍͏Θ͚ʹ͸͍͔ͣɾɾɾ Sahara ࢝Ί·ͨ͠ ʢ΍ΉΛ͑ͣʣ

OpenStack Sahara ͱ͸ ɾओʹ։ൃ͍ͯ͠Δͷ͸.JSBOUJT ɹ4UBDLBMZUJDTʹΑΕ͹.JUBLBͰͷ$PNNJU͸໿͕.JSBOUJT ɹ IUUQTUBDLBMZUJDTDPN SFMFBTFNJUBLBNPEVMFTBIBSBHSPVQNFUSJDDPNNJUT ɾ0QFO4UBDL্Ͱ&.3ͷΑ͏ͳ
ɹσʔλॲཧαʔϏεΛ࣮ݱ ɹͰ͖Δίϯϙʔωϯτ

OpenStack Sahara ͱ͸ ɾ%BTICPBSE )PSJ[PO ΋ఏڙ͞Ε͓ͯΓ ɹ)BEPPQ؀ڥΛ༰қʹߏங͢Δ͜ͱ͕Ͱ͖Δ ɾ಺෦తʹ͸)FBUͰ$MVTUFS؀ڥ͕࡞੒͞ΕΔ ɾ֤छϕϯμʔͷ)BEPPQ؀ڥ͕QMVHJOͰఏڙ͞Ε͍ͯΔ ɹ$%).BQ3"NCBSJFUDʜ

OpenStack Sahara ͱ͸ ͪͳΈʹɾɾެࣜ 0QFO4UBDLPSH ʹΑΔ 4BIBSBͷ׬੒౓͸ͱ͍͏ͱɾɾɾ

OpenStack Sahara ͱ͸

OpenStack Sahara ͱ͸ ˞࣌఺ ·ɺ͜Μͳͷؾʹͯͨ͠Β0QFO4UBDLͳΜͯ΍ͬͯΒΕͳ͍ΑͶ

ͱ͍͏Θ͚Ͱͬͦ͘͞ Sahara ࡞ͬͯΈ·ͨ͠

ΞυςΫຊ෦ͷOpenStack Nevera (Icehouse) Diana (Juno) Mille (Liberty) Gaia Acacus (Mitaka)

OpenStack Sahara JO"EUFDI ɾࠓճͷσʔλ෼ੳج൫༻ʹ৽نͰ0QFO4UBDLΛߏங ɹ$PEFOBNF"DBDVT αϋϥ࠭യͷੈքҨ࢈ΑΓഈआ ɾ͔ͤͬ͘ͷ৽نߏஙͳͷͰ࠷৽ͷ.JUBLBͰߏங ɾ࢖༻1MVHJO͸$%) $MPVEFSB
ͱ.BQ3 ɾ$PNQVUFͷ$PSF਺͸໿DPSF )5ࠐΈ

OpenStack Sahara ϋϚͬͨϙΠϯτ

OpenStack SaharaϋϚͬͨϙΠϯτ ɾѹ౗త৘ใྔͷແ͞ ɾ4BIBSBΛ࢖͑ΔΑ͏ʹͳΔ·Ͱͷεςοϓ͕ଟ͍ ɹ4BIBSB༻ͷJNBHFΛ࡞੒ ɹͦͷJNBHFΛ(MBODFʹొ࿥͠SFHJTUFS (MBODFͷUBH෇͚ ɹ/PEF(SPVQ5FNQMBUFΛ͍͔ͭ͘࡞੒ ɹ/PEF(SPVQ5FNQMBUFΛ૊Έ߹Θͤͯ$MVTUFS5FNQMBUFΛ࡞੒
ɹ͜ΕͰ΍ͬͱ$MVTUFSΛىಈͰ͖Δ ɾ)PSJ[PO্Ͱ$%)ͷ5FNQMBUFΛ࡞੒ฤू͢Δ࣌ʹ෼଴ͨ͞ΕΔ

OpenStack SaharaϋϚͬͨϙΠϯτ ɾ֤QMVHJO͸جຊతͳ$MVTUFSͷઃఆ͔͠ఏڙ͞Ε͍ͯͳ͍ ɹྫ͑͹$%)Ͱݴ͑͹,FSCFSPTରԠ΍.BQ3Ͱݴ͏4FDVSF$MVTUFSͷػೳ౳ ɹͳͷͰQMVHJO͸ಠࣗʹ$VTUPNJ[F ɾ֤QMVHJO͸࠷৽ͷWFSTJPOʹରԠ͍ͯ͠ͳ͍ ɹྫ͑͹$%)Ͱݴ͑͹ݱࡏͷ࠷৽͸͕ͩ4BIBSB͸·Ͱ͔͠ఏڙ͞Ε͍ͯͳ͍ ɹͳͷͰQMVHJO͸ಠࣗʹ$VTUPNJ[F ɹͬͯॻ͍ͯΔؒʹ͕ग़ͨ

OpenStack SaharaϋϚͬͨϙΠϯτ ɾ֤छ)BEPPQϕϯμʔͷQMVHJO͕ఏڙ͞Ε͍ͯΔ͕ɺ ɹϕϯμʔ͔Βͷαϙʔτ͕ड͚ΒΕΔͱ͸ݶΒͳ͍ ɹ๭.ࣾ͸࣮ࡍʹ4BIBSBʹDPNNJUͨ͠Γ͍ͯ͠ΔͷͰ4BIBSBʹؔͯ͠͸ڠྗతͩͬͨ ɹ๭$ࣾ͸ͦΜͳ΋ͷ΢νͰ࡞ͬͯΔΘ͚͡Όͳ͍͠஌ΒΜαϙʔτ΋Ͱ͖Μ తͳχϡΞϯε ɹɹ࣮ࡍʹ4BIBSBʹରͯ͠͸ࠓ·ͰDPNNJU ɹ๭)ࣾ͸Θ͔Γ·ͤΜ
ɾDVTUPNJ[Fͨ͠QMVHJOͷEFCVH͕͠ΜͲ͔ͬͨ ɹ$MVTUFS͕Ͱ͖͕͋Δ·ͰNJOͱ͔ ɹͦ΋ͦ΋4BIBSB༻ͷ(MBODFJNBHFͷαΠζ͕σΧΠ (#ͱ͔ ͷͰ ɹɹJOTUBODF͕ىಈ͢Δͷ΋͕͔͔࣌ؒΔ SFNPWF@VOVTFE@CBTF@JNBHFTGBMTFͰճආ͢Δ ɹىಈ·Ͱ͸ૣ͘Ͱ͖͚ͨͲىಈޙͷTFUVQॲཧͰNJO͔͔Δ

ͱɺ·͍͊Ζ͍Ζۤ࿑͠·͕ͨ͠

OpenStack Sahara·ͱΊ ɾߏஙQIBTF͸ख͕͔͔ؒͬͯେม͕ͩɺߏஙͯ͠͠·͑͹ ɹ֤छϕϯμʔͷ)BEPPQ੡඼Λखܰʹѻ͏͜ͱ͕Ͱ͖Δ ɾલड़ͷ௨ΓɺͪΐͬͱෳࡶͳઃఆΛ͠Α͏ͱ͢ΔͱQMVHJOͷվ଄͕ඞཁ ɹͳͷͰ։ൃ؀ڥͱ͔ςετ؀ڥʹద͍ͯ͠ΔͷͰ͸ ɾ΋ͬͱར༻ऀ͕૿͑ͯ͘Ε͹ϓϩδΣΫτͷ࣭΋্͕ΔͷͰ͸ͱظ଴ ɾݱࡏ͸4BIBSBͰ࡞੒͞Εͨ$MVTUFS্Ͱ͍Ζ͍ΖͳKPCΛ࣮ߦͤͯ͞ ɹಈ࡞֬ೝதʢ͜Ε͔Βຊ֨తʹ࢖ΘΕ͍ͯ͘༧ఆʣ

OpenStack Sahara JO"EUFDI ͪΌΜͱߩݙͨ͠Αʂ

αΠόʔΤʔδΣϯτΞυςΫຊ෦5FDI#MPH࢝Ί·ͨ͠ IUUQBEUFDIDZCFSBHFOUJPUFDICMPH ҰॹʹΞυςΫຊ෦Λ ੝Γ্͛ͯ͘ΕΔํ ઈࢍืूதͰ͢ ࠓ ͢ ͙ Ξ Ϋ
η ε ʂ

OpenStack Sahara Λ࢖ͬͨσʔλ෼ੳج൫Λ࡞ͬͨ࿩ CyberAgent, Inc Makoto Hasegawa ͓͠·͍

Data_analyzing_platform_by_OpenStack_Sahara

Data_analyzing_platform_by_OpenStack_Sahara

makocchi

More Decks by makocchi

Other Decks in Technology

Featured

Transcript

OpenStack Sahara Λ࢖ͬͨσʔλ෼ੳج൫Λ࡞ͬͨ࿩ CyberAgent, Inc Makoto Hasegawa

ࣗݾ঺հ αΠόʔΤʔδΣϯτΞυςΫຊ෦ʹͯσʔληϯλʔӡ༻΍ 1SJWBUF$MPVE 0QFO4UBDL Λߏஙɾӡ༻ͨ͠Γͯ͠·͢ ࡢ೥͸0QFO4UBDL4VNNJU 7BODPVWFSBOE5PLZP Ͱొஃͤͯ͞௖͖·ͨ͠ ͍Ζ͍ΖͳॴͰͪΐͪ͜ΐ͜ൃදͤͯ͞௖͍ͨΓ͍ͯ͠·͢ .BLPUP)BTFHBXB

͋Δ೔ͷձ࿩ ʮͳΜ͔0QFO4UBDL4BIBSBͬͯͷ͕͋ΔΒ͍͠Αʂʯ ʮ͑ɹͦΕ͍͍͡ΌΜʯ ʮ͏ͪ0QFO4UBDLطʹಈ͔ͯ͠Δ͠ɺ ΠέΔͬ͠ΐʯ ʢ ʂʁʣ

͋Δ೔ͷձ࿩ ʮ4BIBSBΠέΔͬ͠ΐʯ

͋Δ೔ͷձ࿩ɾଓ ʮ ϦϦʔεϲ݄ޙͶʯ ʢʂʁɹαʔόʔͱ͔ ·ͩങͬͯͳ͍Αʁʁʣ

ͱ͍͏Θ͚ʹ͸͍͔ͣɾɾɾ Sahara ࢝Ί·ͨ͠ ʢ΍ΉΛ͑ͣʣ

OpenStack Sahara ͱ͸ ɾओʹ։ൃ͍ͯ͠Δͷ͸.JSBOUJT ɹ4UBDLBMZUJDTʹΑΕ͹.JUBLBͰͷ$PNNJU͸໿͕.JSBOUJT ɹ IUUQTUBDLBMZUJDTDPN SFMFBTFNJUBLBNPEVMFTBIBSBHSPVQNFUSJDDPNNJUT ɾ0QFO4UBDL্Ͱ&.3ͷΑ͏ͳ

OpenStack Sahara ͱ͸ ɾ%BTICPBSE )PSJ[PO ΋ఏڙ͞Ε͓ͯΓ ɹ)BEPPQ؀ڥΛ༰қʹߏங͢Δ͜ͱ͕Ͱ͖Δ ɾ಺෦తʹ͸)FBUͰ$MVTUFS؀ڥ͕࡞੒͞ΕΔ ɾ֤छϕϯμʔͷ)BEPPQ؀ڥ͕QMVHJOͰఏڙ͞Ε͍ͯΔ ɹ$%).BQ3"NCBSJFUDʜ

OpenStack Sahara ͱ͸ ͪͳΈʹɾɾެࣜ 0QFO4UBDLPSH ʹΑΔ 4BIBSBͷ׬੒౓͸ͱ͍͏ͱɾɾɾ

OpenStack Sahara ͱ͸

OpenStack Sahara ͱ͸ ˞࣌఺ ·ɺ͜Μͳͷؾʹͯͨ͠Β0QFO4UBDLͳΜͯ΍ͬͯΒΕͳ͍ΑͶ

ͱ͍͏Θ͚Ͱͬͦ͘͞ Sahara ࡞ͬͯΈ·ͨ͠

ΞυςΫຊ෦ͷOpenStack Nevera (Icehouse) Diana (Juno) Mille (Liberty) Gaia Acacus (Mitaka)

OpenStack Sahara JO"EUFDI ɾࠓճͷσʔλ෼ੳج൫༻ʹ৽نͰ0QFO4UBDLΛߏங ɹ$PEFOBNF"DBDVT αϋϥ࠭യͷੈքҨ࢈ΑΓഈआ ɾ͔ͤͬ͘ͷ৽نߏஙͳͷͰ࠷৽ͷ.JUBLBͰߏங ɾ࢖༻1MVHJO͸$%) $MPVEFSB

OpenStack Sahara ϋϚͬͨϙΠϯτ

OpenStack SaharaϋϚͬͨϙΠϯτ ɾѹ౗త৘ใྔͷແ͞ ɾ4BIBSBΛ࢖͑ΔΑ͏ʹͳΔ·Ͱͷεςοϓ͕ଟ͍ ɹ4BIBSB༻ͷJNBHFΛ࡞੒ ɹͦͷJNBHFΛ(MBODFʹొ࿥͠SFHJTUFS (MBODFͷUBH෇͚ ɹ/PEF(SPVQ5FNQMBUFΛ͍͔ͭ͘࡞੒ ɹ/PEF(SPVQ5FNQMBUFΛ૊Έ߹Θͤͯ$MVTUFS5FNQMBUFΛ࡞੒

ͱɺ·͍͊Ζ͍Ζۤ࿑͠·͕ͨ͠

OpenStack Sahara JO"EUFDI ͪΌΜͱߩݙͨ͠Αʂ

αΠόʔΤʔδΣϯτΞυςΫຊ෦5FDI#MPH࢝Ί·ͨ͠ IUUQBEUFDIDZCFSBHFOUJPUFDICMPH ҰॹʹΞυςΫຊ෦Λ ੝Γ্͛ͯ͘ΕΔํ ઈࢍืूதͰ͢ ࠓ ͢ ͙ Ξ Ϋ

OpenStack Sahara Λ࢖ͬͨσʔλ෼ੳج൫Λ࡞ͬͨ࿩ CyberAgent, Inc Makoto Hasegawa ͓͠·͍