Upgrade to Pro — share decks privately, control downloads, hide ads and more …

ちょっぴりDiveDeepするAWSの時間 AWS Dev Day 2023 Tokyo 延長戦 実践データ移行 〜はてなダイアリーや魔法のiらんどの事例と共に〜

ちょっぴりDiveDeepするAWSの時間 AWS Dev Day 2023 Tokyo 延長戦 実践データ移行 〜はてなダイアリーや魔法のiらんどの事例と共に〜

tkzwtks

June 30, 2023
Tweet

More Decks by tkzwtks

Other Decks in Technology

Transcript

  1. DiveDeep AWS
    AWS Dev Day Tokyo
    i

    View full-size slide

  2. 舅䄕磆☭
    2015 11
    KADOKAWA
    GigaViewer

    View full-size slide

  3. 舅䄕磆☭
    䌕飈׊磬塷
    i

    View full-size slide

  4. 儖仼ֽ鎇׊׌׾׆כ

    View full-size slide

  5. 儖仼ֽ鎇׊׌׾׆כ
    2020 4 i

    View full-size slide

  6. i
    KADOKAWA
    1999
    2020 4

    View full-size slide

  7. 2020
    ˝ بتطّ⯇二
    ˝ 二بتطّ׫ס㵸鐄ظ٭ذ璡ס燯车
    ˝ ☪㍑╚מֽ鎇׊׌׾סע׆ה׼ס鎇갭

    View full-size slide

  8. ظ٭ذ燯车
    ˝ 仾بتطّ־׼二بتطّ׫סظ٭ذ燯Ⳃ
    ˝ ⶡמրظ٭ذي٭ت؅燯׌٬二׊ׂ׌׾ցכַֹ׻ֹם鎇ך
    עםַ
    ˝ 仾بتطّסظ٭ذ؅二بتطّך׵✳ֻ׾׻ֹמ燯Ⳃ

    View full-size slide

  9. ր仾بتطّסظ٭ذ؅二بتطّך׵✳ֻ
    ׾׻ֹמ燯Ⳃցכע
    ˝ 仾بتطّכ二بتطّסت؞٭ُ؅ُشم٤ء׌׾
    ˝ ُشم٤ء׊ג⩝מظ٭ذ؅燯Ⳃ
    ˝ ظ٭ذס㚺䬵
    ˝ ❆㵸鐄ס鋗嫎ֿ二仾بتطّꝴך㚺؂זיַ׾

    View full-size slide

  10. ظ٭ذꝴס❣㰆꞊➟כ⭚杼סꯂ樑
    -> ->

    View full-size slide

  11. ׷׽גַ׆כ

    View full-size slide

  12. ׷׽גַ׆כ

    View full-size slide

  13. StepFunctions + AWS Batch + S
    AWS StepFunctions + AWS Batch
    StepFunctions
    AWS Batch
    S
    JSON S

    View full-size slide

  14. 燯车ס⛼䡵
    S
    S
    S

    View full-size slide

  15. تط٭عُب٤

    View full-size slide

  16. تط٭عُب٤
    batch

    View full-size slide

  17. Savepoint
    S / JSON
    S JSON
    batch_size

    View full-size slide

  18. Savepoint
    S / /
    {$batch_type}/batch_id={$batch_id}/
    status={$status}/{$uuid}
    batch_type:
    batch_id: ID
    status: pending/succeeded/failed
    uuid: ID

    View full-size slide

  19. Savepoint
    /batch_id={$batch_id}/status={$status}
    status /
    failed pending

    View full-size slide

  20. 磵冽
    20 ⾒ 10h
    -> ->

    View full-size slide

  21. 磵冽
    savepoint
    status pending

    View full-size slide

  22. ䷉״י◄❆־׼㰢שظ٭ذ燯车

    View full-size slide

  23. 燯车嶖⤓
    /

    View full-size slide

  24. 燯车嶖⤓
    ˝ ظ٭ذꄈ釤犉׽
    ˝ ⪒⛮燯车侇ꝴס釤犉׽
    ˝ ْ٤طػ٤تؗؕ٤غؗס吾鋀
    ˝ 牊걉
    ˝ ⛰؅燯׌־
    ˝ 䣽ַ亠ֿ㚺؂׾׵סע㚺䬵

    View full-size slide

  25. 燯车嶖⤓
    bulk insert
    /
    )

    View full-size slide

  26. ֵ׽ֿכׇֹ׉ַױ׊ג

    View full-size slide