Data_analyzing_platform_by_OpenStack_Sahara

Transcript

1. OpenStack Sahara Λ࢖ͬͨσʔλ෼ੳج൫Λ࡞ͬͨ࿩ CyberAgent, Inc Makoto Hasegawa
2. ࣗݾ঺հ αΠόʔΤʔδΣϯτ
   ΞυςΫຊ෦ʹͯσʔληϯλʔӡ༻΍
   1SJWBUF
   $MPVE 0QFO4UBDL Λߏஙɾӡ༻ͨ͠Γͯ͠·͢
   ࡢ೥͸
   0QFO4UBDL
   4VNNJU
   7BODPVWFS
   BOE
   5PLZP
   Ͱొஃͤͯ͞௖͖·ͨ͠
   ͍Ζ͍ΖͳॴͰͪΐͪ͜ΐ͜ൃදͤͯ͞௖͍ͨΓ͍ͯ͠·͢ .BLPUP
   )BTFHBXB !NBLPDDIJ IUUQTXXXGBDFCPPLDPNNBLPDDIJ
3. ΞυςΫຊ෦ʹ͍ͭͯ Πϯλʔωοτ޿ࠂʹ͓͍ͯɺ޿ࠂ഑৴ͷ࠷దԽ΍ϝσΟΞͷऩӹ࠷େԽͱ͍͏؍ ఺͔ΒΞυςΫϊϩδʔͷॏཁ౓͕ߴ·͍ͬͯ·͢ɻ
   αΠόʔΤʔδΣϯτͰ͸ΞυςΫϊϩδʔ෼໺ʹ͓͚Δ
   ͜ΕΒͷαʔϏεʹ͍֤ͭͯࢠձࣾΛ௨͡։ൃ͓ͯ͠Γ·͕ͨ͠ɺ
   ֤αʔϏεͷ։ൃ෦໳Λԣஅͯ͠૊৫Խ͢Δઐ໳෦ॺͱͯ͠
   ΞυςΫຊ෦͕ઃཱ͞Ε·ͨ͠ɻ
   ΞυςΫຊ෦ʹ͍ͭͯ
4. ͋Δ೔ͷձ࿩ ʮσʔλ෼ੳͷڞ௨ج൫Έ͍ͨͳͷ࡞Εͳ͍͔ͳʁʯ
   ʮؾܰʹߏஙͰ͖Δ
   )BEPPQ
   ؀ڥ͋Δͱ͍͍ΑͶʯ
   ʮඞཁʹԠͯ͡࡞ͬͨΓফͨ͠Γ͍ͨ͠ΑͶʯ
   ʢͦ͏͍΍
   &.3 ˞
   Έ͍ͨͳ͜ͱ࣮ݱ͢Δ
   4BIBSB
   ͳΜͯ΋Μ͋ΔΑͳ͊
   ɹͰ΋
   4BIBSB
   ͳΜͯӡ༻Ͱ͖Δؾ͠ͳ͍͠ಈ͔͘΋ո͍͠͠ɺ
   ɹ৮Γͨ͘ͳ͍ͳɺɺɺ໧ͬͱ͜ʣ ˞
   "84
   ͷ
   &MBTUJD
   .BQ
   3FEVDF
5. ͋Δ೔ͷձ࿩ ʮͳΜ͔
   0QFO4UBDL
   4BIBSB
   ͬͯͷ͕͋ΔΒ͍͠Αʂʯ
   ʮ͑ɹͦΕ͍͍͡ΌΜʯ
   ʮ͏ͪ
   0QFO4UBDL
   طʹಈ͔ͯ͠Δ͠ɺ ΠέΔͬ͠ΐʯ
   ʢ ʂʁʣ
6. ͋Δ೔ͷձ࿩ ʮ4BIBSB
   ΠέΔͬ͠ΐʯ
8. ͋Δ೔ͷձ࿩ɾଓ ʮ ϦϦʔε
   ϲ݄ޙ
   Ͷʯ
   ʢʂʁɹαʔόʔͱ͔ ·ͩങͬͯͳ͍Αʁʁʣ
10. ͱ͍͏Θ͚ʹ͸͍͔ͣɾɾɾ Sahara ࢝Ί·ͨ͠ ʢ΍ΉΛ͑ͣʣ
11. OpenStack Sahara ͱ͸ ɾओʹ։ൃ͍ͯ͠Δͷ͸
    .JSBOUJT
    ɹ4UBDLBMZUJDT
    ʹΑΕ͹
    .JUBLB
    Ͱͷ
    $PNNJU
    ͸໿
    
    ͕
    .JSBOUJT
    ɹ IUUQTUBDLBMZUJDTDPN SFMFBTFNJUBLBNPEVMFTBIBSBHSPVQNFUSJDDPNNJUT
    ɾ0QFO4UBDL
    ্Ͱ
    &.3
    ͷΑ͏ͳ
    ɹσʔλॲཧαʔϏεΛ࣮ݱ
    ɹͰ͖Δίϯϙʔωϯτ
12. OpenStack Sahara ͱ͸ ɾ%BTICPBSE )PSJ[PO
    ΋ఏڙ͞Ε͓ͯΓ
    ɹ)BEPPQ
    ؀ڥΛ༰қʹߏங͢Δ͜ͱ͕Ͱ͖Δ
    ɾ಺෦తʹ͸
    )FBU
    Ͱ
    $MVTUFS
    ؀ڥ͕࡞੒͞ΕΔ
    ɾ֤छϕϯμʔͷ
    )BEPPQ
    ؀ڥ͕
    QMVHJO
    Ͱఏڙ͞Ε͍ͯΔ
    ɹ$%)
    
    .BQ3
    
    "NCBSJ
    
    FUD
    ʜ
13. OpenStack Sahara ͱ͸ ͪͳΈʹɾɾެࣜ 0QFO4UBDLPSH ʹΑΔ
    4BIBSB
    ͷ׬੒౓͸ͱ͍͏ͱɾɾɾ
14. OpenStack Sahara ͱ͸
15. OpenStack Sahara ͱ͸ ˞
    
    ࣌఺ ·ɺ͜Μͳͷؾʹͯͨ͠Β
    0QFO4UBDL
    ͳΜͯ΍ͬͯΒΕͳ͍ΑͶ
16. ͱ͍͏Θ͚Ͱͬͦ͘͞ Sahara ࡞ͬͯΈ·ͨ͠
17. ΞυςΫຊ෦ͷ
    OpenStack Nevera (Icehouse) Diana (Juno) Mille (Liberty) Gaia Acacus (Mitaka)
18. OpenStack Sahara JO
    "EUFDI ɾࠓճͷσʔλ෼ੳج൫༻ʹ৽نͰ
    0QFO4UBDL
    Λߏங
    ɹ$PEFOBNF
    
    "DBDVT
    αϋϥ࠭യͷੈքҨ࢈ΑΓഈआ
    ɾ͔ͤͬ͘ͷ৽نߏஙͳͷͰ࠷৽ͷ
    .JUBLB
    Ͱߏங
    ɾ࢖༻
    1MVHJO
    ͸
    $%) $MPVEFSB
    ͱ
    .BQ3
    ɾ$PNQVUF
    ͷ
    $PSF
    ਺͸໿
    
    DPSF
    )5ࠐΈ
19. OpenStack Sahara ϋϚͬͨϙΠϯτ
20. OpenStack Sahara
    ϋϚͬͨϙΠϯτ ɾѹ౗త৘ใྔͷແ͞
    ɾ4BIBSB
    Λ࢖͑ΔΑ͏ʹͳΔ·Ͱͷεςοϓ͕ଟ͍
    ɹ
    4BIBSB
    ༻ͷ
    JNBHF
    Λ࡞੒
    ɹ
    ͦͷ
    JNBHF
    Λ
    (MBODF
    ʹొ࿥͠
    SFHJTUFS
    (MBODF
    ͷ
    UBH
    ෇͚
    ɹ
    /PEF
    (SPVQ
    5FNQMBUF
    Λ͍͔ͭ͘࡞੒
    ɹ
    /PEF
    (SPVQ
    5FNQMBUF
    Λ૊Έ߹Θͤͯ
    $MVTUFS
    5FNQMBUF
    Λ࡞੒
    ɹ
    ͜ΕͰ΍ͬͱ
    $MVTUFS
    ΛىಈͰ͖Δ
    ɾ)PSJ[PO
    ্Ͱ
    $%)
    ͷ
    5FNQMBUF
    Λ࡞੒ฤू͢Δ࣌ʹ
    
    ෼଴ͨ͞ΕΔ
21. OpenStack Sahara
    ϋϚͬͨϙΠϯτ ɾ֤
    QMVHJO
    ͸جຊతͳ
    $MVTUFS
    ͷઃఆ͔͠ఏڙ͞Ε͍ͯͳ͍
    ɹ
    ྫ͑͹
    $%)
    Ͱݴ͑͹
    ,FSCFSPT
    ରԠ΍
    .BQ3
    Ͱݴ͏
    4FDVSF
    $MVTUFS
    ͷػೳ౳
    ɹ
    ͳͷͰ
    QMVHJO
    ͸ಠࣗʹ
    $VTUPNJ[F
    ɾ֤
    QMVHJO
    ͸࠷৽ͷ
    WFSTJPO
    ʹରԠ͍ͯ͠ͳ͍
    ɹ
    ྫ͑͹
    $%)
    Ͱݴ͑͹ݱࡏͷ࠷৽͸
    
    ͕ͩ
    4BIBSB
    ͸
    
    ·Ͱ͔͠ఏڙ͞Ε͍ͯͳ͍
    ɹ
    ͳͷͰ
    QMVHJO
    ͸ಠࣗʹ
    $VTUPNJ[F
    ɹ
    ͬͯॻ͍ͯΔؒʹ
    
    ͕ग़ͨ
22. OpenStack Sahara
    ϋϚͬͨϙΠϯτ ɾ֤छ
    )BEPPQ
    ϕϯμʔͷ
    QMVHJO
    ͕ఏڙ͞Ε͍ͯΔ͕ɺ
    ɹϕϯμʔ͔Βͷαϙʔτ͕ड͚ΒΕΔͱ͸ݶΒͳ͍
    ɹ
    ๭
    .
    ࣾ͸࣮ࡍʹ
    4BIBSB
    ʹ
    DPNNJU
    ͨ͠Γ͍ͯ͠ΔͷͰ
    4BIBSB
    ʹؔͯ͠͸ڠྗతͩͬͨ
    ɹ
    ๭
    $
    ࣾ͸ͦΜͳ΋ͷ΢νͰ࡞ͬͯΔΘ͚͡Όͳ͍͠஌ΒΜ
    αϙʔτ΋Ͱ͖Μ
    తͳχϡΞϯε
    ɹɹ࣮ࡍʹ
    4BIBSB
    ʹରͯ͠͸ࠓ·Ͱ
    DPNNJU
    
    ɹ
    ๭
    )
    ࣾ͸Θ͔Γ·ͤΜ
    ɾDVTUPNJ[F
    ͨ͠
    QMVHJO
    ͷ
    EFCVH
    ͕͠ΜͲ͔ͬͨ
    ɹ
    $MVTUFS
    ͕Ͱ͖͕͋Δ·Ͱ
    
    NJO
    ͱ͔
    ɹ
    ͦ΋ͦ΋
    4BIBSB
    ༻ͷ
    (MBODF
    JNBHF
    ͷαΠζ͕σΧΠ (#
    ͱ͔ ͷͰ
    ɹɹJOTUBODF
    ͕ىಈ͢Δͷ΋͕͔͔࣌ؒΔ
    SFNPWF@VOVTFE@CBTF@JNBHFT
    
    GBMTF
    Ͱճආ͢Δ
    ɹ
    ىಈ·Ͱ͸ૣ͘Ͱ͖͚ͨͲىಈޙͷ
    TFUVQ
    ॲཧͰ
    
    NJO
    ͔͔Δ
23. ͱɺ·͍͊Ζ͍Ζۤ࿑͠·͕ͨ͠
24. OpenStack Sahara
    ·ͱΊ ɾߏங
    QIBTF
    ͸ख͕͔͔ؒͬͯେม͕ͩɺߏஙͯ͠͠·͑͹
    ɹ֤छϕϯμʔͷ
    )BEPPQ
    ੡඼Λखܰʹѻ͏͜ͱ͕Ͱ͖Δ
    ɾલड़ͷ௨ΓɺͪΐͬͱෳࡶͳઃఆΛ͠Α͏ͱ͢Δͱ
    QMVHJO
    ͷվ଄͕ඞཁ
    ɹͳͷͰ։ൃ؀ڥͱ͔ςετ؀ڥʹద͍ͯ͠ΔͷͰ͸
    ɾ΋ͬͱར༻ऀ͕૿͑ͯ͘Ε͹ϓϩδΣΫτͷ࣭΋্͕ΔͷͰ͸ͱظ଴
    ɾݱࡏ͸
    4BIBSB
    Ͱ࡞੒͞Εͨ
    $MVTUFS
    ্Ͱ͍Ζ͍Ζͳ
    KPC
    Λ࣮ߦͤͯ͞
    ɹಈ࡞֬ೝதʢ͜Ε͔Βຊ֨తʹ࢖ΘΕ͍ͯ͘༧ఆʣ
25. OpenStack Sahara JO
    "EUFDI ͪΌΜͱߩݙͨ͠Αʂ
26. αΠόʔΤʔδΣϯτ
    ΞυςΫຊ෦
    5FDI
    #MPH
    ࢝Ί·ͨ͠ IUUQBEUFDIDZCFSBHFOUJPUFDICMPH ҰॹʹΞυςΫຊ෦Λ ੝Γ্͛ͯ͘ΕΔํ
    ઈࢍืूதͰ͢ ࠓ ͢ ͙ Ξ Ϋ η ε ʂ
27. OpenStack Sahara Λ࢖ͬͨσʔλ෼ੳج൫Λ࡞ͬͨ࿩ CyberAgent, Inc Makoto Hasegawa ͓͠·͍