論理削除と、そこでのElasticsearch活用 | 論理削除 Casual Talks #1 / soft_delete

イベント: 論理削除 Casual Talks #1 : ATND https://atnd.org/events/68902
発表者: https://twitter.com/misoobu

Transcript

1. ࿦ཧ࡟আͱɺͦ͜Ͱͷ &MBTUJDTFBSDI׆༻ 
   ࿦ཧ࡟আ
   $BTVBM
   5BMLT
   
   !NJTPPCV
2. ࣗݾ঺հ ࢓ࣄ SBJMTΞϓϦΛͭͬͯ͘ӡ༻ ॴଐ υϦίϜʹ೥൒ʢࡀʙʣ ໊લ !NJTPPCVʢদ࡚ʣ ࿦ཧ࡟আΛͨ͘͞Μ͖ͯ͠·ͨ͠
3. ࿩͢͜ͱ ✦ ͓͜ͳ͖ͬͯͨ࿦ཧ࡟আʹ͍ͭͯ
   ✦ ࿦ཧ࡟আΛ΍ΊɺϩάΛ&MBTUJDTFBSDIʹ
 ೖΕΔΑ͏ʹͨ͜͠ͱ ࡟আํ๏બ୒ͷࢀߟʹͯ͠΋Β͑Ε͹
   !
4. લஔ͖ ✦ ϚελʔσʔλͰͳ͍
   ✦ ͨ͘͞Μ͋Δ
   ✦ ࡟আޙ͸ɺΞϓϦຊମ͔Βࢀর͠ͳ͍ɺ෮׆͠ͳ͍
   ✦ ӡ༻্ɺޙ͔Β࡟আσʔλΛݟΕΔඞཁ͕͋Δ ͜͜Ͱ͸ɺ࡟আ͢Δσʔλ͸ҎԼͷ৚݅ͷ΋ͷ
5. ࡟আ͢Δ࣌ͷํ๏ ✦ ࡟আϑϥά
   ✦ ࡟আςʔϒϧ
   ✦ &MBTUJDTFBSDIͰϩά
6. ࡟আϑϥά
7. ࡟আϑϥά ✦ 3%#͔ΒϨίʔυΛ෺ཧ࡟আ͢ΔͷͰ͸ͳ͘ɺ
 ʮ࡟আͷঢ়ଶʯΛ࣋ͨͤΔ
   ✦ ීஈͷࢀরͰ͸ɺ࡟আঢ়ଶͷϨίʔυΛӅ͢
 ΫΤϦ΍WJFXΛ͔ͭ͏
   ✦ ࡟আͷঢ়ଶʹ͸ɺCPPM΍JOUɺEBUFUJNF͕࢖ΘΕΔ
8. ࡟আϑϥά
   ྫ user_comments id: int user_id: int comment: text deleted_at: datetime ࢀর SELECT * FROM user_comments WHERE user_id = 1 AND deleted_at IS NULL; ࡟আ UPDATE user_comments SET deleted_at = NOW() WHERE id = 1;
9. ࡟আϑϥά
   ར఺ ✦ ςʔϒϧʹΧϥϜΛͭ௥Ճ͢Δ͚ͩ
   ✦ ࡟আͨ͠σʔλͷࢀর΍෮׆ָ͕
 ʢ΄΅΍Βͳ͍૝ఆʜʣ
   ✦ %&-&5&ΑΓ61%"5&ͷํ͕ύϑΥʔϚϯε͕
 ͍͍
10. ࡟আϑϥά
    ܽ఺ ✦ ςʔϒϧ༰ྔ͕૿Ճ͠΍͍͢
    ✦ ΫΤϦ͕ඇ௚ײతʹͳΔ
    ✦ ࢀরͰ͸৚݅௥Ճɺ࡟আʹ͸61%"5&
    ✦ 3%#ʹΑͬͯ͸ɺ6/*26&
    */%&9͕࢖͍ʹ͍͘
    ✦ 3%#ͱͯ͠ɺઃܭ͕Ϗϛϣʔ
11. ࡟আςʔϒϧ
12. ࡟আςʔϒϧ ✦ ෺ཧ࡟আͨ͠ϨίʔυΛɺͦͷ··ΞʔΧΠϒ༻ͷ
 ςʔϒϧʹҠ͢
    ✦ ཤྺςʔϒϧͱݺ͹ΕΔ΋ͷ΋ɺࣅͨܗΛ
 ͱΔ͜ͱ͕͋Δ
13. ࡟আςʔϒϧ
    ྫ ίϝϯτΛ࡟আ͢Δ user_comments id: int user_id: int comment: text archived_user_comments id: int user_id: int comment: text archived_at: datetime %&-&5& */4&35
14. ࡟আςʔϒϧ
    ྫ ΧʔυΛച٫͢Δ user_cards id: int user_id: int card_id: int level: int user_card_sale_histories id: int user_id: int card_id: int level: int money: int sold_at: datetime %&-&5& */4&35
15. ࡟আςʔϒϧ
    ར఺ ✦ ݩʹͳΔςʔϒϧͷ༰ྔ͸૿Ճ͠ʹ͍͘
    ✦ ࡟আςʔϒϧͰύʔςΟγϣϯΛ੾Δͱɺ
 ݹ͍σʔλΛָʹফͤΔ
16. ࡟আςʔϒϧ
    ܽ఺ ✦ ֎෦Ωʔ੍໿͕࢖͑ͳ͍
17. ͜͜·Ͱͷ·ͱΊ ✦ ࡟আϑϥά͸ਏ͍
    ✦ ࡟আςʔϒϧ͸ѱ͘ͳ͍͕ʜଞͷख΋ߟ͑Δ
18. ࡟আϩά
19. ࡟আϩά ✦ 3%#͔Β෺ཧ࡟আ͠ɺ࡟আσʔλΛ
 ผ్ϩάͱͯ͠ه࿥͢Δ
    ✦ 3%#ଆΛγϯϓϧʹͰ͖Δ
    ✦ ϩάʹ͸ɺ&MBTUJDTFBSDIΛ࢖͍ͬͯΔ
20. &MBTUJDTFBSDIͱ͸ ✦ ෼ࢄυΩϡϝϯτετΞ
    ✦ 3&45
    
    +40/
    ✦ Α͘ݟΔར༻ྫ
    ✦ શจݕࡧΤϯδϯ
    ✦ ϩάΛೖΕΔ
    ✦ ௕͍ͷͰɺ͔͜͜Β&4ͱলུදه͢Δ
    !
21. &4ʹϩάΛೖΕΔ ࡟আͨ͠σʔλΛ&4ʹೖΕΔ { "user_comment_deleted_log": { "properties": { "user_id": { "type": "integer" }, "comment": { "type": "string" }, “deleted_at": { "type": "date" } } } } user_comments id: int user_id: int comment: text %&-&5& */4&35
22. &4Ͱͷσʔλઃܭ { "app_log_20150831": { "mappings": { "user_comment_deleted_log": { "properties": { "user_id": { "type": "integer" }, "comment": { "type": "string" }, "deleted_at": { "type": "date" } } } } } } index RDBͷσʔλϕʔεΈͨ ͍ͳ΍ͭɻ ೔୯ҐͰindex͢Δɻ type RDBͷςʔϒϧ Έ͍ͨͳ΍ͭɻ छྨͰtypeΛ෼͚Δɻ JOEFYͱUZQFʢͱVTFS@JEʣΛࢦఆͯ͠ɺϩάΛऔΓग़͢ field RDBͷΧϥϜΈ͍ͨͳ ΍ͭɻ
23. ✦ ΞΫγϣϯͰ3%#ͷෳ਺ͷϨίʔυΛফ͢৔߹͸ɺ ϩά͸·ͱΊͯͭ෼ͰೖΕΔ
    ✦ ࣮ࡍ͸ɺVTFS@JEͳͲͷݕࡧͰ࢖͍͍ͨ΋ͷҎ֎ͷ ϑΟʔϧυ͸ɺѹॖͯͭ͠ʹ·ͱΊΔ
    ✦ ༰ྔରࡦ΍ɺϚοϐϯάʢσʔλߏ଄ʣఆٛͷ
 ൚༻Խ
    ✦ VTFS@JEͰSPVUJOHͯ͠ύϑΥʔϚϯε޲্ &4Ͱͷσʔλઃܭ
24. &4ͷϩάͷࢀর ✦ ઐ༻ͷϥΠϒϥϦΛͭ͘ΓɺͦΕΛ௨͍ͯ͠Δ
    ✦ औಘͨ͠σʔλ͸ɺѹॖΛҙࣝͤͣɺ3%#ͱࣅͨ
 ײ֮Ͱ࢖͑Δ
25. 'MVFOUEͰɺઐ༻ͷϩά
    ϑΝΠϧΛऩू Hadoop Elasticsearch 'MVFOUE ϩάΛऩूͯ͠؅ཧͰ͖Δπʔϧ )BEPPQ ฒྻ෼ࢄॲཧΛ࣮ݱ͢Δϛυϧ΢ΣΞ App App App CBUDIͰ
 CVML
    JOTFSU ΞϓϦ͔Β௚઀ೖΕͳ͍ߏ੒ ϩά͕&4ʹ֨ೲ͞ΕΔ·Ͱ
26. )BEPPQ ू໿ɾ෼ੳ &MBTUJDTFBSDI Ϣʔβʔ୯ҐͰͷϩάݕࡧ )BEPPQͱ&4ͷ࢖͍෼͚
27. ✦ 3%#ଆΛγϯϓϧʹग़དྷΔ
    ✦ 3%#ͷ༰ྔΛؾʹ͢Δ͜ͱ͕ݮΔ
    ✦ σʔλͷ஝ੵ͕͠΍͍͢
    ✦ ৽ͨͳϩάͷ௥Ճָ͕ &4Ͱͷ࡟আϩά
    ར఺
28. ✦ ࡟আޙɺ&MBTUJDTFBSDI͔ΒݟΒΕΔΑ͏ʹͳΔ
 ·Ͱʹ͕͔͔࣌ؒΔ
    ✦ ڐ༰Ͱ͖ͳ͍ͱ͖͸ɺ3%#Λ࢖ͬͨΓɺ
 3%#ͱ&MBTUJDTFBSDIΛ߹Θͤͯ࢖ͬͨΓ
    ✦ ৴པੑΛΑΓߴ͍ͨ͘͠ͱ͖΋ɺ3%#Λ࢖͏ &4Ͱͷ࡟আϩά
    ܽ఺
29. ·ͱΊ ✦ ಛʹن໛͕େ͖Ίͩͱɺ࡟আϑϥά͸ਏ͍ࣄ͕ଟ͍
    ✦ &MBTUJDTFBSDIʹ࡟আϩάΛ͍ΕΔͱָ
    ✦ ঢ়گʹԠͯ͡ɺద੾ʹ࡟আํ๏ΛબΜͰ͍͖·͠ΐ͏