論理削除と、そこでのElasticsearch活用 | 論理削除 Casual Talks #1 / soft_delete

Transcript

1. 1.

   ࿦ཧ࡟আͱɺͦ͜Ͱͷ &MBTUJDTFBSDI׆༻ 
   ࿦ཧ࡟আ
   $BTVBM
   5BMLT
   
   !NJTPPCV

2. 2.

   ࣗݾ঺հ ࢓ࣄ SBJMTΞϓϦΛͭͬͯ͘ӡ༻ ॴଐ υϦίϜʹ೥൒ʢࡀʙʣ ໊લ !NJTPPCVʢদ࡚ʣ ࿦ཧ࡟আΛͨ͘͞Μ͖ͯ͠·ͨ͠

3. 3.

   ࿩͢͜ͱ ✦ ͓͜ͳ͖ͬͯͨ࿦ཧ࡟আʹ͍ͭͯ
   ✦ ࿦ཧ࡟আΛ΍ΊɺϩάΛ&MBTUJDTFBSDIʹ
 ೖΕΔΑ͏ʹͨ͜͠ͱ ࡟আํ๏બ୒ͷࢀߟʹͯ͠΋Β͑Ε͹
   !

4. 4.

   લஔ͖ ✦ ϚελʔσʔλͰͳ͍
   ✦ ͨ͘͞Μ͋Δ
   ✦ ࡟আޙ͸ɺΞϓϦຊମ͔Βࢀর͠ͳ͍ɺ෮׆͠ͳ͍
   ✦ ӡ༻্ɺޙ͔Β࡟আσʔλΛݟΕΔඞཁ͕͋Δ ͜͜Ͱ͸ɺ࡟আ͢Δσʔλ͸ҎԼͷ৚݅ͷ΋ͷ

5. 5.

   ࡟আ͢Δ࣌ͷํ๏ ✦ ࡟আϑϥά
   ✦ ࡟আςʔϒϧ
   ✦ &MBTUJDTFBSDIͰϩά

6. 6.

   ࡟আϑϥά

7. 7.

   ࡟আϑϥά ✦ 3%#͔ΒϨίʔυΛ෺ཧ࡟আ͢ΔͷͰ͸ͳ͘ɺ
 ʮ࡟আͷঢ়ଶʯΛ࣋ͨͤΔ
   ✦ ීஈͷࢀরͰ͸ɺ࡟আঢ়ଶͷϨίʔυΛӅ͢
 ΫΤϦ΍WJFXΛ͔ͭ͏
   ✦ ࡟আͷঢ়ଶʹ͸ɺCPPM΍JOUɺEBUFUJNF͕࢖ΘΕΔ

8. 8.

   ࡟আϑϥά
   ྫ user_comments id: int user_id: int comment: text deleted_at: datetime

   ࢀর SELECT * FROM user_comments WHERE user_id = 1 AND deleted_at IS NULL; ࡟আ UPDATE user_comments SET deleted_at = NOW() WHERE id = 1;
9. 9.

   ࡟আϑϥά
   ར఺ ✦ ςʔϒϧʹΧϥϜΛͭ௥Ճ͢Δ͚ͩ
   ✦ ࡟আͨ͠σʔλͷࢀর΍෮׆ָ͕
 ʢ΄΅΍Βͳ͍૝ఆʜʣ
   ✦ %&-&5&ΑΓ61%"5&ͷํ͕ύϑΥʔϚϯε͕
 ͍͍

10. 10.

    ࡟আϑϥά
    ܽ఺ ✦ ςʔϒϧ༰ྔ͕૿Ճ͠΍͍͢
    ✦ ΫΤϦ͕ඇ௚ײతʹͳΔ
    ✦ ࢀরͰ͸৚݅௥Ճɺ࡟আʹ͸61%"5&
    ✦ 3%#ʹΑͬͯ͸ɺ6/*26&
    */%&9͕࢖͍ʹ͍͘
    ✦

    3%#ͱͯ͠ɺઃܭ͕Ϗϛϣʔ
11. 11.

    ࡟আςʔϒϧ

12. 12.

    ࡟আςʔϒϧ ✦ ෺ཧ࡟আͨ͠ϨίʔυΛɺͦͷ··ΞʔΧΠϒ༻ͷ
 ςʔϒϧʹҠ͢
    ✦ ཤྺςʔϒϧͱݺ͹ΕΔ΋ͷ΋ɺࣅͨܗΛ
 ͱΔ͜ͱ͕͋Δ

13. 13.

    ࡟আςʔϒϧ
    ྫ ίϝϯτΛ࡟আ͢Δ user_comments id: int user_id: int comment: text archived_user_comments

    id: int user_id: int comment: text archived_at: datetime %&-&5& */4&35
14. 14.

    ࡟আςʔϒϧ
    ྫ ΧʔυΛച٫͢Δ user_cards id: int user_id: int card_id: int level:

    int user_card_sale_histories id: int user_id: int card_id: int level: int money: int sold_at: datetime %&-&5& */4&35
15. 15.

    ࡟আςʔϒϧ
    ར఺ ✦ ݩʹͳΔςʔϒϧͷ༰ྔ͸૿Ճ͠ʹ͍͘
    ✦ ࡟আςʔϒϧͰύʔςΟγϣϯΛ੾Δͱɺ
 ݹ͍σʔλΛָʹফͤΔ

16. 16.

    ࡟আςʔϒϧ
    ܽ఺ ✦ ֎෦Ωʔ੍໿͕࢖͑ͳ͍

17. 17.

    ͜͜·Ͱͷ·ͱΊ ✦ ࡟আϑϥά͸ਏ͍
    ✦ ࡟আςʔϒϧ͸ѱ͘ͳ͍͕ʜଞͷख΋ߟ͑Δ

18. 18.

    ࡟আϩά

19. 19.

    ࡟আϩά ✦ 3%#͔Β෺ཧ࡟আ͠ɺ࡟আσʔλΛ
 ผ్ϩάͱͯ͠ه࿥͢Δ
    ✦ 3%#ଆΛγϯϓϧʹͰ͖Δ
    ✦ ϩάʹ͸ɺ&MBTUJDTFBSDIΛ࢖͍ͬͯΔ

20. 20.

    &MBTUJDTFBSDIͱ͸ ✦ ෼ࢄυΩϡϝϯτετΞ
    ✦ 3&45
    
    +40/
    ✦ Α͘ݟΔར༻ྫ
    ✦ શจݕࡧΤϯδϯ
    ✦

    ϩάΛೖΕΔ
    ✦ ௕͍ͷͰɺ͔͜͜Β&4ͱলུදه͢Δ
    !
21. 21.

    &4ʹϩάΛೖΕΔ ࡟আͨ͠σʔλΛ&4ʹೖΕΔ { "user_comment_deleted_log": { "properties": { "user_id": { "type":

    "integer" }, "comment": { "type": "string" }, “deleted_at": { "type": "date" } } } } user_comments id: int user_id: int comment: text %&-&5& */4&35
22. 22.

    &4Ͱͷσʔλઃܭ { "app_log_20150831": { "mappings": { "user_comment_deleted_log": { "properties": {

    "user_id": { "type": "integer" }, "comment": { "type": "string" }, "deleted_at": { "type": "date" } } } } } } index RDBͷσʔλϕʔεΈͨ ͍ͳ΍ͭɻ ೔୯ҐͰindex͢Δɻ type RDBͷςʔϒϧ Έ͍ͨͳ΍ͭɻ छྨͰtypeΛ෼͚Δɻ JOEFYͱUZQFʢͱVTFS@JEʣΛࢦఆͯ͠ɺϩάΛऔΓग़͢ field RDBͷΧϥϜΈ͍ͨͳ ΍ͭɻ
23. 23.

    ✦ ΞΫγϣϯͰ3%#ͷෳ਺ͷϨίʔυΛফ͢৔߹͸ɺ ϩά͸·ͱΊͯͭ෼ͰೖΕΔ
    ✦ ࣮ࡍ͸ɺVTFS@JEͳͲͷݕࡧͰ࢖͍͍ͨ΋ͷҎ֎ͷ ϑΟʔϧυ͸ɺѹॖͯͭ͠ʹ·ͱΊΔ
    ✦ ༰ྔରࡦ΍ɺϚοϐϯάʢσʔλߏ଄ʣఆٛͷ
 ൚༻Խ
    ✦

    VTFS@JEͰSPVUJOHͯ͠ύϑΥʔϚϯε޲্ &4Ͱͷσʔλઃܭ
24. 24.

    &4ͷϩάͷࢀর ✦ ઐ༻ͷϥΠϒϥϦΛͭ͘ΓɺͦΕΛ௨͍ͯ͠Δ
    ✦ औಘͨ͠σʔλ͸ɺѹॖΛҙࣝͤͣɺ3%#ͱࣅͨ
 ײ֮Ͱ࢖͑Δ

25. 25.

    'MVFOUEͰɺઐ༻ͷϩά
    ϑΝΠϧΛऩू Hadoop Elasticsearch 'MVFOUE ϩάΛऩूͯ͠؅ཧͰ͖Δπʔϧ )BEPPQ ฒྻ෼ࢄॲཧΛ࣮ݱ͢Δϛυϧ΢ΣΞ App App

    App CBUDIͰ
 CVML
    JOTFSU ΞϓϦ͔Β௚઀ೖΕͳ͍ߏ੒ ϩά͕&4ʹ֨ೲ͞ΕΔ·Ͱ
26. 26.

    )BEPPQ ू໿ɾ෼ੳ &MBTUJDTFBSDI Ϣʔβʔ୯ҐͰͷϩάݕࡧ )BEPPQͱ&4ͷ࢖͍෼͚

27. 27.

    ✦ 3%#ଆΛγϯϓϧʹग़དྷΔ
    ✦ 3%#ͷ༰ྔΛؾʹ͢Δ͜ͱ͕ݮΔ
    ✦ σʔλͷ஝ੵ͕͠΍͍͢
    ✦ ৽ͨͳϩάͷ௥Ճָ͕ &4Ͱͷ࡟আϩά
    ར఺

28. 28.

    ✦ ࡟আޙɺ&MBTUJDTFBSDI͔ΒݟΒΕΔΑ͏ʹͳΔ
 ·Ͱʹ͕͔͔࣌ؒΔ
    ✦ ڐ༰Ͱ͖ͳ͍ͱ͖͸ɺ3%#Λ࢖ͬͨΓɺ
 3%#ͱ&MBTUJDTFBSDIΛ߹Θͤͯ࢖ͬͨΓ
    ✦ ৴པੑΛΑΓߴ͍ͨ͘͠ͱ͖΋ɺ3%#Λ࢖͏ &4Ͱͷ࡟আϩά
    ܽ఺

29. 29.

    ·ͱΊ ✦ ಛʹن໛͕େ͖Ίͩͱɺ࡟আϑϥά͸ਏ͍ࣄ͕ଟ͍
    ✦ &MBTUJDTFBSDIʹ࡟আϩάΛ͍ΕΔͱָ
    ✦ ঢ়گʹԠͯ͡ɺద੾ʹ࡟আํ๏ΛબΜͰ͍͖·͠ΐ͏