Upgrade to Pro — share decks privately, control downloads, hide ads and more …

大量データをFirestoreに効率的に移行する勘所

ANDPAD inc
February 25, 2021

 大量データをFirestoreに効率的に移行する勘所

2021/02/25 ANDPAD & Media Do 〜BtoB開発の舞台裏〜

ANDPAD inc

February 25, 2021
Tweet

More Decks by ANDPAD inc

Other Decks in Programming

Transcript

  1. Copyright © 2020 Present ANDPAD Inc. This information is confidential

    and was prepared by ANDPAD Inc. for the use of our client. It is not to be relied on by and 3rd party. Proprietary & Confidential 無断転載・無断複製の禁止 大量データをFirestoreに効率的に移行する勘所 株式会社アンドパッド 開発本部 SWE 椎野 太喜 2021/02/25 ANDPAD & MediaDo 〜BtoB開発の舞台裏〜
  2. 自己紹介 椎野 太喜(しいのたいき) • 出身 ◦ 茨城県 • 経歴 ◦

    10人規模のベンチャー → 株式会社アンドパッド • 専門領域 ◦ Webフロントエンド。状況に応じてサーバーサイドなど他 の領域にも日々チャレンジしている。 • 好きなこと ◦ 釣り、銭湯 @buena926
  3. アジェンダ 1. 背景 2. Firestore移行のゴールは? 3. データ移行の課題 4. データ移行の全体像 5.

    処理パフォーマンス向上に向けてどのように進めていったか 6. データ同期後のデータ検証をどのように進めていったか 7. まとめ
  4. 1. 背景 Copyright © 2021 Present ANDPAD Inc. This information

    is confidential and was prepared by ANDPAD Inc. for the use of our client. It is not to be relied on by and 3rd party. Proprietary & Confidential 無断転載・無断複製の禁止
  5. 2. Firestore移行のゴールは? Copyright © 2021 Present ANDPAD Inc. This information

    is confidential and was prepared by ANDPAD Inc. for the use of our client. It is not to be relied on by and 3rd party. Proprietary & Confidential 無断転載・無断複製の禁止
  6. 3. データ移行の課題 Copyright © 2021 Present ANDPAD Inc. This information

    is confidential and was prepared by ANDPAD Inc. for the use of our client. It is not to be relied on by and 3rd party. Proprietary & Confidential 無断転載・無断複製の禁止
  7. 4. データ移行の全体像 Copyright © 2021 Present ANDPAD Inc. This information

    is confidential and was prepared by ANDPAD Inc. for the use of our client. It is not to be relied on by and 3rd party. Proprietary & Confidential 無断転載・無断複製の禁止
  8. 5. 処理パフォーマンス向上に向けて どのように進めていったか Copyright © 2021 Present ANDPAD Inc. This

    information is confidential and was prepared by ANDPAD Inc. for the use of our client. It is not to be relied on by and 3rd party. Proprietary & Confidential 無断転載・無断複製の禁止
  9. • 検証用のDBを用意 • 並行処理数の調整と以下の調整も合わせて行った ◦ RDSからのデータ取得数 ◦ クエリチューニング ◦ コネクションを再利用する時間

    ① 検証用DBを用意した上で、並行処理数の最適値を探る 本番DBと同じデータ量 のRDSを用意 検証用のFirebaseプロジェク トを用意
  10. 6. データ同期後のデータ検証を どのように進めていったか Copyright © 2021 Present ANDPAD Inc. This

    information is confidential and was prepared by ANDPAD Inc. for the use of our client. It is not to be relied on by and 3rd party. Proprietary & Confidential 無断転載・無断複製の禁止
  11. 7. まとめ Copyright © 2021 Present ANDPAD Inc. This information

    is confidential and was prepared by ANDPAD Inc. for the use of our client. It is not to be relied on by and 3rd party. Proprietary & Confidential 無断転載・無断複製の禁止