Upgrade to Pro — share decks privately, control downloads, hide ads and more …

eskeeperを使ったファイル定義によるindex管理

po3rin
October 20, 2021

 eskeeperを使ったファイル定義によるindex管理

eskeeperで便利にindex&aliasを管理しよう
https://github.com/po3rin/eskeeper

po3rin

October 20, 2021
Tweet

More Decks by po3rin

Other Decks in Programming

Transcript

  1. Indices management


    by file definition


    using eskeeper
    #elasticsearchjp

    View Slide

  2. தଜ߂෢
    ΤϜεϦʔͷ"*ɾػցֶशνʔϜͰݕࡧج൫
    पΓΛ୲౰͍ͯ͠Δɻ(P͕޷͖ɻ
    ֤छΞΧ΢ϯτQPSJOͰ΍ͬͯ·͢ɻ
    )*SPNV/BLBNVSB

    View Slide

  3. ΤϜεϦʔͰ͸&MBTUJDTFBSDIΛར༻͍ͯ͠Δ͕ɺੵۃతʹ
    ݕࡧվળ͍ͯ͠ΔͷͰɺJOEFYͷมߋ͕සൟʹൃੜ͠ɺ؅ཧ
    ͮ͠Β͍ঢ়گͩͬͨɻ
    ՝୊
    *446&

    View Slide

  4. ݕࡧج൫νʔϜͰ͸JOEFYͷ৽ن࡞੒BMJBT੾Γସ͑Ͱ
    NBQQJOHͷมߋ౳ʹରԠ͍ͯ͠ΔŇ৽͍͠JOEFYʹରͯ͠
    ࠶౓σʔλ౤ೖΛߦ͏
    ӡ༻
    01&3"5*0/
    OFXTW
    OFXTW
    /FXTBMJBT
    3FRVFTU
    0MEJOEFY
    /FXJOEFY
    4XJUDIJOEFY
    *OTFSUNBTUFSEBUB

    View Slide

  5. ӡ༻
    01&3"5*0/
    ,JDLKPC %FQMPZ+PC
    खಈΩοΫͳϝϯςφϯε+PC CBTI
    ͷ਺ʑ
    DSFBUFJOEFYDSFBUFBMJBTTXJUDIJOEFY

    View Slide

  6. ՝୊
    *446&
    ࠓɺBMJBTʹඥ͍ͮͯΔJOEFYͷόʔδϣϯͬͯԿ͚ͩͬʁʁ
    JOEFYೖΕସ͑ͷͨͼʹεΫϦϓτʹൃੜ͢Δ%J
    ff
    ɺίϛοτ
    લόʔδϣϯͷJOEFY͕DMPTF͞Εͯͳ͍ʂ
    ؒҧͬͨNBQQJOHͰJOEFY࡞ͬͯ͠·ͬͨʂʂ
    ઃఆมߋͷϨϏϡʔΛ௨͍ͨ͠

    View Slide

  7. *B$ͱ͸ΠϯϑϥΛએݴతʹ؅ཧ͢ΔࣄͰιϑτ΢ΣΞ։ൃϓϩηεΛΠ
    ϯϑϥͷΦʔτϝʔγϣϯʹੜ͔͢Ξϓϩʔνɻ͜ΕΛ্ख͘Ӭଓϛυϧ
    ΢ΣΞͰ͋Δ&MBTUJDTFBSDIʹద༻Ͱ͖ͳ͍͔
    ɾهड़తͳΞϓϩʔνʹΑΔႈ౳ੑ୲อ
    ɾఆٛϑΝΠϧʹΑΔόʔδϣϯ؅ཧ
    ɾܧଓςετγεςϜɺϓϩηε
    *B$
    *OGSBTUSVDUVSFBTDPEF

    View Slide

  8. ႈ౳ੑΛอͪͳ͕ΒఆٛϑΝΠϧͰ
    &MBTUJDTFBSDI*OEFYBMJBTΛએݴత
    ʹ؅ཧͯ͘͠ΕΔΛ࡞ͬͨ
    FTLFFQFS
    &MBTUJDTFBSDI*OEFYLFFQFS

    View Slide

  9. ͜ͷΑ͏ʹఆٛϑΝΠϧͰ&MBTUJDTFBSDIͷ
    ঢ়ଶΛએݴͰ͖ΔɻӬଓϨΠϠʔͳͷͰૢ
    ࡞͸XSJUFPOMZʹࠓ͸ߜ͍ͬͯΔɻͭ·Γ
    ݱࡏͷ࣮૷͸׬શͳ*B$Λଥڠ͢ΔࣄͰσʔ
    λΛޡͬͯফ͢ϦεΫΛආ͚͍ͯΔɻ
    FTLFFQFS
    &MBTUJDTFBSDI*OEFYLFFQFS

    View Slide

  10. ΦϥΠϦʔͷʰ*OGSBTUSVDUVSFBT$PEFʱ
    ͷதͰ*B$πʔϧ͕࣋ͭ΂͖ػೳʹ͍ͭͯͷه
    ड़͕͋Δɻ͔͜͜Β͸͜ͷຊΛࢀߟʹ
    FTLFFQFSͰ΋ҙࣝͨ͠*B$πʔϧ࡞੒ͷϓϥ
    ΫςΟεΛ঺հ͍ͯ͘͠
    *B$Λҙࣝͨ͠$-*ͷ࡞๏
    *B$BXBSF$-*#FTU1SBDUJDF

    View Slide

  11. ཁ݅ઃఆͷ֎ࡏԽ
    ൓෮Մೳੑͷ୲อɻ:BNMͰ͋Ε͹ɺ͋
    ΒΏΔط੒πʔϧͰಡΈॻ͖Ͱ͖Δɻ

    View Slide

  12. ཁ݅ແਓ࣮ߦͷαϙʔτ
    ແਓ࣮ߦ͸ίϚϯυͱͯࣗ͠ಈͰ࣮ߦͰ͖Δ͚ͩͰ͸ෆे෼ɻਓ͕ؒؔ༩͠
    ͳͯ͘΋ߴ͍৴པੑͰ࣮ߦͰ͖Δ͜ͱ͕ॏཁɻͦ͜ͰԼهͷཁૉ͕ඞཁɻ
    ɾႈ౳ੑ
    ɾࣄલνΣοΫ
    ɾࣄޙνΣοΫ
    ɾ໨ʹݟ͑ΔܗͰͷࣦഊ
    ɾύϥϝʔλԽ

    View Slide

  13. ཁ݅ແਓ࣮ߦͷαϙʔτ
    FTLFFQFSͰ͸جຊతͳႈ౳ੑɺࣄલ
    νΣοΫɺࣄޙνΣοΫɺ໨ʹݟ͑Δܗ
    Ͱͷࣦഊͱ͍͏ཁ݅Λ࣮૷͍ͯ͠Δɻ͜
    ΕʹΑΓʮΦʔτϝʔγϣϯڪා঱ʯΛ
    ݮΒ͢ɻ

    View Slide

  14. FTLFFQFSͰ͸Լهͷεςʔδʹ෼ׂ͞ΕΔ
    ઃఆϑΝΠϧͷόϦσʔγϣϯ
    ඥͮ͘NBQQJOH
    fi
    MF͸ଘࡏ͢Δ͔
    ඞਢϑΟʔϧυ͸ຬͨ͞Ε͍ͯΔ͔
    ࣄલνΣοΫ
    JOEFY͕࣮ࡍʹ࡞ΕΔ͔ Ұ࣌తͳJOEFYΛ࣮ࡍʹ࡞੒

    BMJBTͱʹඥͮ͘JOEFY͸ଘࡏ͢Δͷ͔
    ࣮ߦεςʔδ
    ࣮ࡍʹఆٛϑΝΠϧͷঢ়ଶΛಉظͤ͞Δ
    ࣄޙνΣοΫ
    ఆٛϑΝΠϧʹ͋ΔJOEFY΍BMJBT͕࡞ΒΕ͔ͨ

    View Slide

  15. SFJOEFYͷαϙʔτ
    FTLFFQFSͰ͸SFJOEFYΛαϙʔτɻ
    جຊతͳSFJOEFYΦϓγϣϯΛࢦఆͰ͖
    Δɻ͜ΕͰJOEFY࡞੒ͷޙʹSFJOEFYΛ
    ૸ΒͤΔ͜ͱ͕Ͱ͖Δɻ

    View Slide

  16. Ϣʔεέʔε

    View Slide

  17. ϢʔεέʔεNBQQJOHมߋ
    NBQQJOHͷ"OBMZ[FSͷઃఆΛมߋ͢Δͱ͖ͳͲ͸طଘNBQQJOHΛಈతʹมߋͰ͖ͳ͍ͷͰɺJOEFYΛ࡞
    ੒ͯ͠ɺσʔλΛ΋͏Ұ౓ೖΕ௚͢ඞཁ͕͋ΔɻͦͷࡍʹFTLFFQFSΛ࢖͑͹ίϚϯυൃ

    View Slide

  18. ϢʔεέʔεJOEFY࡞੒ࡁΈ&MBTUJDTFBSDI%PDLFS
    fi
    MFͷੜ੒
    ΤϜεϦʔͰ͸FF༻ͷJOEFYੜ੒ࡁΈ%PDLFS
    fi
    MFΛ༻ҙ͍ͯ͠ΔɻϩʔΧϧͷಈ࡞֬ೝͰ΋ར༻Ͱ͖Δɻ

    View Slide

  19. Ϣʔεέʔε6OJU5FTU࣌ͷ*OEFY࡞੒
    FTLFFQFS͸(Pͷύοέʔδͱͯ͠࢖͑ΔܗͰఏڙ͍ͯ͠ΔͷͰɺςετ࣌ʹJOEFYΛੜ੒Մೳɻྫ͑͹
    FTSFJOEFYFSͰ͸FTLFFQFSΛ࢖ͬͨςετΛ࣮૷͍ͯ͠Δɻ

    IUUQTHJUIVCDPNQPSJOFTSFJOEFYFSCMPCNBJONBJO@UFTUHP

    View Slide

  20. ݁Ռ
    $06$-64*0/
    JOEFY؅ཧ༻ͷLT+PCɺγΣϧεΫϦϓτͳͲΛେ૟আ͠
    ͯɺϦϙδτϦ͔ΒϑΝΠϧΛ࡟আͨ͠ɻ


    ໿೥ؒFTLFFQFSΛӡ༻ͯ͠େ෼҆ఆͨ͠ͷͰɺ͜Ε͔Β
    ΋FTLFFQFSΛҭ͍͖ͯͯ·͢ɻ

    View Slide

  21. ՝୊
    *446&
    ݱঢ়JOEFY࡟আΛαϙʔτ͍ͯ͠ͳ͍ͷͰɺෆཁͳJOEFY͸ఆظతʹखಈͰফ͢ඞཁ͕͋
    Δɻ5FSSBGPSNͷUGTUBUFతͳϑΝΠϧΛอଘͰ͖ΔΑ͏ʹ͢Ε͹ྑͦ͞͏ɻߏ૝த


    FTLFFQFSͷSFJOEFY͸ઃఆΛ࠷దԽ͠ͳ͍ͷͰɺ͋·ΓύϑΥʔϚϯε͕ྑ͘ͳ͍
    SFJOEFYऴྃΛݕ஌Ͱ͖ͳ͍ɻ
    1SFDIFDLTUBHF͕஗͍ɻݱঢ়JOEFY࡞੒࡟আ͕૸ΔͷͰɺͳΜͱ͔NBQQJOH
    WBMJEBUPSΛ૊ΈࠐΊͳ͍΋ͷ͔

    View Slide

  22. Indices management


    by file definition


    using eskeeper
    #elasticsearchjp

    View Slide