データ基盤品質向上のための一年

DataEngineeringStudy #11

Transcript

1. 䚷ᅵᕝ⛱⏕
   䝕䞊䝍ᇶ┙ရ㉁ྥୖ䛾䛯䜑䛾୍ᖺ
   $XZXKC
   
   

   View Slide

2. ┠ḟ
   Ɣ ⮬ᕫ⤂௓
   Ɣ 㐺᫬ᛶ┘ど䝅䝇䝔䝮䛾ᑟධ
   Ɣ /RRNHU䛾ᑟධ
   Ɣ GEW&ORXG䛾ᑟධ
   Ɣ 䛥䛔䛤䛻
   
   

   View Slide

3. ᅵᕝ⛱⏕7VXFKLNDZD7RVKLNL
   
   Ɣ ឡ▱┴ฟ㌟
   Ɣ ᖺᮾᕤ኱᝟ሗ⌮ᕤᏛ㝔༞
   Ɣ ᰴᘧ఍♫䝍䜲䝭䞊
   ż '5('DWD5HOLDELOLW\(QJLQHHULQJ䝏䞊䝮
   ż 䝕䞊䝍ᇶ┙䛾㛤Ⓨ䞉ಖᏲ䞉㐠⏝
   ż ศᯒᇶ┙䛾㛤Ⓨ䞉ಖᏲ䞉㐠⏝
   Ɣ 7ZLWWHU#WYWJB
   
   ⮬ᕫ⤂௓
   

   View Slide

4. 
   ⣙ᖺ๓䛾䝕䞊䝍ᇶ┙
   

   View Slide

5. 
   ̐᭦᪂䝍䜲䝭䞁䜾䛾㐜ᘏ
   %LJ4XHU\䝴䞊䝄䞊䛛䜙᭦᪂䝍䜲䝭䞁䜾䛜㐜䜜䛶䛔䜛
   䛸䛾ධಙ䛜ቑຍ
   䛭䛾㒔ᗘ'5(䝏䞊䝮䛜༶ᑐᛂ
   ┘ど䛿䛔䛟䛴䛛ධ䜜䛶䛔䛯䛜䚸䜲䞁䝣䝷䜔䚸䝕䞊䝍䝟
   䜲䝥䝷䜲䞁䛺䛹ከᒱ䛻䜟䛯䜛䝞䜾䛾Ⓨ⏕※䛜䛒䜚ᑐᛂ
   䛻᫬㛫䛜ྲྀ䜙䜜䜛䜘䛖䛻
   䝕䞊䝍ရ㉁䛾ၥ㢟Ⅼ
   ʍ᭦᪂㢖ᗘ┘ど6/26/$䛾ᑟධ
   㐺᫬ᛶ䜢6/,䛸䛧䛶ྛ䝕䞊䝍䝋䞊䝇䛤䛸䛻 6/$䜢ศᯒ
   ⪅䛸ᐃ⩏
   䜶䝷䞊䝞䝆䜵䝑䝖䜢タ䛡䜛䛣䛸䛷᪂つ㛤Ⓨ䛻᫬㛫䛜๭
   䛡䜛䜘䛖䛻䛺䜛
   䝫䝇䝖䝰䞊䝔䝮䛷ᨵၿ䜒ᅇ䜛
   %LJ4XHU\䛾᭱⤊᭦᪂᫬้䜢┘ど䛩䜛䛣䛸䛷 '5(䝏䞊
   䝮䛜䜶䝷䞊䛻᪩䛟Ẽ䛵䛡䜛䜘䛖䛻䛺䜛
   ̐
   ̐
   ̐
   ̐
   

   View Slide

6. 
   6/,6/$6/2䛾ᐃ⩏
   6HUYLFH/HYHO,QGLFDWRU
   䝃䞊䝡䝇䛾ရ㉁䜢Ᏺ䜛䛯䜑䛾ᣦᶆ
   6/,
   6/$
   6/2
   6HUYLFH/HYHO$JUHHPHQW
   6/,䛷ᐃ⩏䛧䛯ᣦᶆ䛻㛵䛩䜛䝃䞊䝡䝇ᥦ౪⪅䛸
   䛾ዎ⣙◚䛳䛯᫬䛻䛹䛖䛩䜛䛛䛺䛹
   6HUYLFH/HYHO2EMHFWLYH
   6/,䛷ᐃ⩏䛧䛯ᣦᶆ䛾ලయⓗ䛺┠Ᏻ
   

   View Slide

7. 
   '5(䝏䞊䝮䛻䛚䛡䜛6/,6/26/$䛾ᐃ⩏
   6HUYLFH/HYHO,QGLFDWRU
   䝕䞊䝍䝟䜲䝥䝷䜲䞁䛾㐺᫬ᛶ䝕䞊䝍䝋䞊䝇䛾᭦᪂䛛䜙䛹
   䛾䛟䜙䛔㐜䜜䛶㌿㏦ඛ䛷ᐇ⏝ྍ⬟䛻䛺䜛䛛
   6/,
   6/$
   6/2
   6HUYLFH/HYHO$JUHHPHQW
   䝕䞊䝍䝋䞊䝇䛤䛸䛻%LJ4XHU\౑⏝⪅䛸⤖䜀䜜䛯㐺
   ᫬ᛶ䛻㛵䛩䜛ዎ⣙
   ◚䛳䛯ሙྜ䛿䝫䝇䝖䝰䞊䝔䝮䜢ᐇ᪋
   ౛䝕䞊䝍䝋䞊䝇$䛿᪥䛾㐺᫬ᛶ䛷䛾㌿㏦
   6HUYLFH/HYHO2EMHFWLYH
   '5(䝏䞊䝮ෆ䛷Ỵᐃ䛥䜜䛯䝕䞊䝍䝋䞊䝇䛤䛸䛾㐺
   ᫬ᛶ䛾┠ᶆ
   ౛䝕䞊䝍䝋䞊䝇$䛿KRXU䛾㐺᫬ᛶ䛷䛾㌿㏦
   

   View Slide

8. 
   㐺᫬ᛶ䛾┘ど
   㐜ᘏ᫬㛫┘ど䝅䝇䝔䝮䛾ᐇ⿦
   ྛ✀䝕䞊䝍䝟䜲䝥䝷䜲䞁䛾㐺᫬ᛶ䛻㛵䛩䜛
   6/2䛸%LJ4XHU\䛾䝯䝍䝕䞊䝍䛷䛒䜛᭱⤊᭦᪂
   ᫬㛫䜢ẚ㍑
   6/26/$䜘䜚䜒᭦᪂᫬㛫䛜㐜ᘏ䛧䛶䛔䛯䜙
   VODFN䛻㏻▱䛧䚸㞀ᐖᑐᛂ䞉䝫䝇䝖䝰䞊䝔䝮䜢ᐇ
   ᪋
   䝁䞊䝗䛿S\WKRQ䛷సᡂ䛧䚸*LWKXE$FWLRQV䛷
   ᐃᮇᐇ⾜
   

   View Slide

9. 
   ᣺䜚㏉䜚
   㐺᫬ᛶ䛾6/26/$䜢ᐃ⩏䛩䜛䛣䛸䛻䜘䛳䛶䚸ศᯒ⪅䛿䝕䞊䝍䛾㌿㏦᫬㛫䛻䛚䛡䜛㐜ᘏ䜢ᢕ
   ᥱ䛧䛺䛜䜙ศᯒ䛜ྍ⬟䛻䛺䛳䛯
   '5(䝏䞊䝮䜒㞀ᐖᑐᛂ䜢ᐇ᪋䛩䜛㝿䛾ᇶ‽್䛻䜘䜚䚸㞀ᐖᑐᛂ䛸ᶵ⬟㛤Ⓨ䜢䝞䝷䞁䝇䜘䛟ᐇ
   ⾜䛩䜛䛣䛸䛜䛷䛝䜛䜘䛖䛻䛺䛳䛯
   

   View Slide

10. 䜽䜶䝸䛾ಟṇ䛚
    㢪䛔䛧䜎䛩
    䛣䛾䝎䝑䝅䝳䝪䞊䝗䛾
    సᡂ䛚㢪䛔䛧䜎䛩
    
    䝕䞊䝍ရ㉁䛾ၥ㢟Ⅼ
    ̐ศᯒ䝏䞊䝮䜈䛾౫㢗㐣ከ
    ศᯒ䝏䞊䝮䛻䜽䜶䝸䛾సᡂ䚸ಟṇ䛺䛹䛾౫㢗䛜ቑຍ
    ㄡ䛛䛜సᡂ䛧䛯䜽䜶䝸䜢෌฼⏝䛩䜛䛣䛸䛷ᑡ䛧䛪䛴䝈
    䝺䛜Ⓨ⏕
    ʍ/RRNHU䛾ᑟධ
    /RRNHU䛷஦๓䛻64/䜢ᐃ⩏䛧䛶䛒䛢䜛䛣䛸䛷䚸䜽䜶䝸
    䛾᭩䛝᪉䛻䜘䜛䝈䝺䜢ῶ䜙䛩䚹
    ㄡ䛷䜒䝎䝑䝅䝳䝪䞊䝗䜢⡆༢䛻సᡂ䛷䛝䜛䜘䛖䛻䛩䜛
    䛣䛸䛷䚸䝕䞊䝍ά⏝䛾ಁ㐍䜢ᮇᚅ
    

    View Slide

11. 
    /RRNHU䛾ᑟධ
    /RRNHU䛻䜘䜛䝕䞊䝍ရ㉁䛾ྥୖ
    㢖⦾䛻ศᯒ䛷⏝䛔䜙䜜䜛ᣦᶆ䜢 ':+䛸䛧䛶
    /RRNHU䛛䜙ᐃ⩏
    /RRN0/䛻䜘䜛64/ᐃ⩏䛾୍ᮏ໬
    ([SORUH䛻䜘䜛䝎䝑䝅䝳䝪䞊䝗సᡂ䛾⡆᫆໬
    5HGDVK䛷⏝䛔䜙䜜䜛䝎䝑䝅䝳䝪䞊䝗䛾⨨᥮
    

    View Slide

12. 
    ᣺䜚㏉䜚
    /RRNHU䛾ᑟධ䛻䜘䜚䚸/RRN0/䛻グ㏙䛧䛯ᣦᶆ䛻㛵䛧䛶䛿ㄡ䛷䜒⡆༢䛻䝎䝑䝅䝳䝪䞊䝗䜢సᡂ
    䛷䛝䚸䛭䛾䝕䞊䝍䛾ရ㉁䜒ୖ䛜䛳䛯
    /RRNHU䛷ᐃ⩏䛧䛯ᣦᶆ䜢%LJ4XHU\䛛䜙䜒ศᯒྍ⬟䛺≧ែ䛻䛩䜛䛣䛸䛷䚸䝕䞊䝍䝫䞊䝍䝹䜔
    5HGDVK䛷䛾䝕䞊䝍䛾ရ㉁䜒㧗䛟䛺䛳䛯
    /RRNHU䛿ゝㄒ䛭䛾䜒䛾䛿64/䜢ᇶᮏ䛸䛧䛶䛔䜛䛾䛷䜻䝱䝑䝏䜰䝑䝥䛿⡆༢䛰䛳䛯䛜䚸䝁䞊䝗ᵓ
    ᡂ䛾タィ䛿㞴䛧䛟䚸ఱᗘ䛛඲య䛾タィ䜢䜔䜚┤䛧䛯
    5HGDVK䛷⏝䛔䜙䜜䛶䛔䜛䝎䝑䝅䝳䝪䞊䝗䜢 /RRNHU䛻⛣⾜䛧䜘䛖䛸䛧䛶䛔䜛䛜 /RRN0/䛻ᐃ⩏
    䛩䜉䛝ᣦᶆ䜒ከ䛟䚸䜎䛰⛣⾜㏵୰䛷䛒䜛
    /RRNHU䛾䝁䝭䝳䝙䝔䜱䛜ᗈ䛔䛾䛷䚸௚♫䛥䜣䛸 /RRNHU䛾ᵓᡂ䛻䛴䛔䛶┦ㄯ䛧䛺䛜䜙㛤Ⓨ䛷䛝
    䛯䛾䛷䛩䛤䛟ຓ䛛䛳䛯
    

    View Slide

13. 
    ̐(7/䛾7ฎ⌮䛾䝒䞊䝹౫Ꮡᛶ䚸⫧኱໬䚸୙㏱᫂ᛶ
    䝕䞊䝍㔞䛾ቑຍ䛻క䛔䝬䝇䜻䞁䜾䛺䛹䛾ຍᕤฎ⌮䜢
    ⾜䛳䛶䛔䜛HPEXONෆ䛾7ฎ⌮䝁䞊䝗䛾ᐇ⾜᫬㛫䛜⫧኱
    ໬䛧䛶䛝䛯
    WURFFR䛺䛹䛾HPEXON௨እ䛾䝕䞊䝍䝟䜲䝥䝷䜲䞁䛾ᑟ
    ධ䛻䜘䜚7ฎ⌮䛜HPEXON䛻౫Ꮡ䛧䛶䛔䜛
    HPEXON䛾䝁䞊䝗䜢ㄞ䜎䛺䛔䛸 7ฎ⌮䛾ෆᐜ䛜ᢕᥱ䛷
    䛝䛪䚸ศᯒ⪅䛛䜙䛩䜛䛸୙㏱᫂䛺ฎ⌮䛷䛒䜛
    䝕䞊䝍ရ㉁䛾ၥ㢟Ⅼ
    ʍGEW&ORXG䛾ᑟධ䛻䜘䜛(/7䝟䜲䝥䝷䜲䞁䛾ᵓ⠏
    GEW&ORXG䜢⏝䛔䛶HPEXON䛷⾜䛳䛶䛔䛯7ฎ⌮䜢௦᭰
    䝕䞊䝍䝟䜲䝥䝷䜲䞁䛻⏝䛔䛶䛔䜛䝒䞊䝹䛻౫Ꮡ䛫䛪
    䛻䚸%LJ4XHU\䛻཰㞟䛧䛯䝕䞊䝍䛻ᑐ䛧䛶ᵝ䚻䛺ຍᕤ䛜
    ྍ⬟䛻
    ຍᕤ䜢୍⟠ᡤ䛻㞟䜑䜛䛣䛸䛷䚸ศᯒ⪅䛻ຍᕤ᝟ሗ䜢
    㐺ษ䛻ఏ䛘䜙䜜䜛䜘䛖䛻ᮇᚅ
    䝬䝇䜻䞁䜾䛺䛹䛾ຍᕤฎ⌮
    ¡
    

    View Slide

14. 
    ᣺䜚㏉䜚
    GEW&ORXG䛾ᑟධ䛻䜘䜚䚸䛹䛾䝕䞊䝍䝟䜲䝥䝷䜲䞁䛛䜙䝕䞊䝍䜢཰㞟䛧䛶䜒ඹ㏻䛾ຍᕤ䛜䛷䛝
    䜛䜘䛖䛻䛺䛳䛯
    GEW&ORXG䛿䜲䞁䝣䝷䛾ᩚഛ䛜୙ᚲせ䛺䛯䜑䚸䝏䞊䝮䝯䞁䝞䞊䛜ᑡ䛺䛔 '5(䝏䞊䝮䛻䛿㐺ษ
    䛺䝒䞊䝹䛰䛳䛯䚹ゝㄒ䜒 64/䜢ᇶᮏ䛸䛧䛶䛔䜛䛾䛷ᑟධ䜎䛷䛾䝁䝇䝖䛜ప䛛䛳䛯
    (7/ᇶ┙䜢(/7ᇶ┙䛻ኚ᭦䛩䜛㝿䛻䚸ຍᕤ䛧䛶䛺䛔䝕䞊䝍䜢≉ᐃ䛾 *&3䝥䝻䝆䜵䜽䝖䛻ಖᏑ
    䛩䜛ᚲせ䛜䛒䜛䛜䚸 *&3䛾,$0ᵓᡂ䛜」㞧䛷䛭䛣䛛䜙ᡭ䜢䛴䛡䜛䛾䛜኱ኚ䛰䛳䛯
    

    View Slide

15. 
    ᭱㏆䛾䝕䞊䝍ᇶ┙
    

    View Slide

16. 
    䛣䜜䛛䜙䛾ရ㉁䛾䛚䛡䜛ㄢ㢟
    䝕䞊䝍ရ㉁䛻䛚䛡䜛 6/,䛸䛧䛶㐺᫬ᛶ䜢ᐃ⩏䛧䛯䛜䚸௚䛻䜒୍ពᛶ䚸᏶඲ᛶ䛺䛹䛾ᣦᶆ䛜䛒
    䜚䚸┘ど䛺䛹䜢㐺ᛂ䛩䜛䛣䛸䛷ရ㉁䛾ྥୖ䜢┠ᣦ䛧䛯䛔
    GEW&ORXG䛿'5(䝏䞊䝮䜢୰ᚰ䛸䛧䛯䝕䞊䝍ຍᕤ䚸 /RRNHU䛿ศᯒ⪅䛜୰ᚰ䛸䛺䜛ຍᕤ䜢ᢸᙜ
    䛩䜛䛣䛸䛷䝕䞊䝍ศᯒ䛻䛚䛡䜛䝁䝇䝖䚸ရ㉁䛾ྥୖ䜢┠ᣦ䛧䛯䛔
    ྛ✀%,䝒䞊䝹䛾ᙺ๭䜢ศᢸ䛧䚸㐺ษ䛺 %,䝒䞊䝹䛾౑⏝䜢඲♫ⓗ䛻㐺ᛂ䛧䚸ရ㉁䛾㧗䛔䝕䞊
    䝍ά⏝䜢ಁ㐍䛧䛯䛔
    

    View Slide

17. 
    䛥䛔䛤䛻
    㼔㼠㼠㼜㼟㻦㻛㻛㼙㼑㼑㼠㼥㻚㼚㼑㼠㻛㼙㼍㼠㼏㼔㼑㼟㻛㼙㻱㻶㼜㻵㼚㼤㻳㻺㼒㼁㼅䈊 㼔㼠㼠㼜㼟㻦㻛㻛㼣㼣㼣㻚㼣㼍㼚㼠㼑㼐㼘㼥㻚㼏㼛㼙㻛㼜㼞㼛㼖㼑㼏㼠㼟㻛㻡㻣㻥㻤㻝㻜䈊
    

    View Slide