MoT TechTalk #12 タクシーアプリ『GO』大規模トラフィックを捌く分析データ基盤の全容に迫る！

■ 内容
・Dataflow による車両位置情報のストリーミング収集パイプライン
・CDC（Change Data Capture）を使ったデータ収集の事例紹介
・dbtとDataformの検証から導入まで
・AI予約サービスのMLOps事例紹介

■ スライド内リンク集
p. 8
DeNA TechCon 2022 https://techcon2022.dena.dev/spring/session/arrival-predictio-ai-2-social-implementation/
MoT TechTalk #10 https://jtx.connpass.com/event/236252/
p. 10
MoT TechTalk #7 https://jtx.connpass.com/event/226030/
p. 16
Mercari Dataflow Template https://engineering.mercari.com/blog/entry/20210928-mtf2021-day3-2/
p. 52
BigQuery Assertion https://cloud.google.com/bigquery/docs/reference/standard-sql/debugging-statements?hl=ja
p. 60
採用情報 https://hrmos.co/pages/mo-t/jobs/1000004

■ YouTube
https://youtu.be/HJdP4_H_hJI?t=185

■ connpass
https://jtx.connpass.com/event/249940/

Transcript

1. View Slide

2. View Slide

3. View Slide

4. View Slide

5. View Slide

6. View Slide

7. View Slide

8. View Slide

9. View Slide

10. View Slide

11. View Slide

12. View Slide

13. View Slide

14. View Slide

15. View Slide

16. View Slide

17. View Slide

18. View Slide

19. View Slide

20. View Slide

21. View Slide

22. View Slide

23. View Slide

24. View Slide

25. View Slide

26. View Slide

27. View Slide

28. View Slide

29. View Slide

30. View Slide

31. View Slide

32. View Slide

33. View Slide

34. View Slide

35. View Slide

36. View Slide

37. View Slide

38. View Slide

39. View Slide

40. View Slide

41. View Slide

42. View Slide

43. View Slide

44. View Slide

45. View Slide

46. View Slide

47. View Slide

48. View Slide

49. View Slide

50. View Slide

51. View Slide

52. View Slide

53. View Slide

54. View Slide

55. View Slide

56. View Slide

57. View Slide

58. View Slide

59. View Slide

60. View Slide

61. View Slide