複数の外部サービスデータの統合と変換を実現する Railsのインポートアーキテクチャ / Rails import architecture for integration and transformation of multiple external service data

Reject on Rails 2024 LT資料

参考：Findy Team+のデータインポートのアプリケーションアーキテクチャを大公開！ - Findy Tech Blog

Transcript

1. ෳ਺ͷ֎෦αʔϏεσʔλͷ౷߹ͱม׵Λ࣮ݱ͢Δ RailsͷΠϯϙʔτΞʔΩςΫνϟ 2024/10/17 Reject on Rails 2024 ϑΝΠϯσΟגࣜձࣾɹԕ౻ ܆
2. ࣗݾ঺հ 2 ENDʢԕ౻ ܆ʣ 2023೥2݄ʹϑΝΠϯσΟʹೖࣾ RailsΛϝΠϯʹFindy Team+ͷ։ൃΛ͍ͯ͠·͢ Kaigi on Rails CFP ࠓճॳఏग़ʂ gotanda.rb ॳࢀՃʂ @aiandrox
3. ࠓ೔࿩͢͜ͱ • ෳ਺ͷ֎෦αʔϏε͔ΒσʔλΛऔಘ͍ͯ͠ΔFindy Team+ ʹ͓͚ΔσʔλΠϯϙʔτͷΞʔΩςΫνϟʹ͍ͭͯ • چΞʔΩςΫνϟͰੜ͍ͯͨ͡՝୊Λղফ͢ΔͨΊʹऔΓೖ Εͨ৽ΞʔΩςΫνϟ 3
4. Findy Team+ͱ͸ʁ 4 ։ൃੜ࢈ੑͷՄࢹԽɺ։ൃϓϩηεͷ৳ͼ͠Ζͷൃݟɺܧଓతͳ վળΛαϙʔτ
5. 5 Findy Team+ͱ͸ʁ • ϓϧϦΫͳͲʹؔ͢Δɹ ͞·͟·ͳσʔλΛऔಘ • Ͳͷ֎෦αʔϏεͰ΋ɹ ಉ͡UIͰσʔλΛදࣔ
6. σʔλΠϯϙʔτͷΞʔΩςΫνϟʢچʣ 6
7. 7 Findy Team+ͷσʔλΠϯϙʔτͷΞʔΩςΫνϟ ಠࣗGemͷ Πϯελϯε Transformer૚ ಠࣗGemͷ Πϯελϯε දࣔσʔλ༻ ςʔϒϧ Importer૚ Client૚ GitLab ςʔϒϧ GitHub ςʔϒϧ
8. 8 Findy Team+ͷσʔλΠϯϙʔτͷΞʔΩςΫνϟ ಠࣗGemͷ Πϯελϯε ಠࣗGemͷ Πϯελϯε දࣔσʔλ༻ ςʔϒϧ GemΛར༻͠ɺϨεϙϯεΛ GemͷΠϯελϯεͱͯ͠औಘ͢Δ Transformer૚ Importer૚ Client૚ GitLab ςʔϒϧ GitHub ςʔϒϧ
9. 9 Findy Team+ͷσʔλΠϯϙʔτͷΞʔΩςΫνϟ ಠࣗGemͷ Πϯελϯε ಠࣗGemͷ Πϯελϯε දࣔσʔλ༻ ςʔϒϧ Transformer૚ Importer૚ Client૚ GitLab ςʔϒϧ GitHub ςʔϒϧ αʔϏεಠࣗͷσʔλߏ଄ͷ·· αʔϏε͝ͱͷσʔλ֨ೲ༻ςʔϒϧʹอଘ
10. 10 Findy Team+ͷσʔλΠϯϙʔτͷΞʔΩςΫνϟ ಠࣗGemͷ Πϯελϯε ಠࣗGemͷ Πϯελϯε දࣔσʔλ༻ ςʔϒϧ Transformer૚ Importer૚ Client૚ GitLab ςʔϒϧ GitHub ςʔϒϧ ֤αʔϏεͷσʔλߏ଄ࠩ෼Λ ٵऩ͠ɺڞ௨ͷςʔϒϧʹอଘ
11. ैདྷͷΞʔΩςΫνϟͷ՝୊ 11
12. 12 ಠࣗGemͷ Πϯελϯε ಠࣗGemͷ Πϯελϯε දࣔσʔλ༻ ςʔϒϧ Transformer૚ Importer૚ Client૚ GitLab ςʔϒϧ GitHub ςʔϒϧ Client૚ͱImporter૚͕ີ݁߹͍ͯ͠Δ 😢 Importer૚ͰσʔλͷfetchɺՃ޻ɺ Ϩίʔυอଘʹඞཁͳ֎෦ΩʔΛऔಘɺ ҰׅอଘΛߦ͍ͬͯΔ 😢 Importer૚ͷςετʹAPIͷελϒ͕ ඞཁ ैདྷͷΞʔΩςΫνϟͷ՝୊
13. 13 ಠࣗGemͷ Πϯελϯε Transformer૚ ಠࣗGemͷ Πϯελϯε දࣔσʔλ༻ ςʔϒϧ Importer૚ Client૚ GitLab ςʔϒϧ GitHub ςʔϒϧ ΤϥʔϋϯυϦϯάɺϦτϥΠॲཧͳͲ͕ Client૚ɾImporter૚ͷ͍ΖΜͳՕॴͰ࣮૷ ͞Ε͍ͯΔ ैདྷͷΞʔΩςΫνϟͷ՝୊
14. ैདྷͷΞʔΩςΫνϟͷ՝୊ 14 ৽ͨͳίʔυ؅ཧπʔϧʹରԠ͢ΔͷΛ͖͔͚ͬʹ Client૚ɾImporter૚ͷΞʔΩςΫνϟΛݟ௚͠
15. ৽ͨͳσʔλΠϯϙʔτͷΞʔΩςΫνϟ 15
16. 16 ৽ͨͳσʔλΠϯϙʔτͷΞʔΩςΫνϟ Representation Πϯελϯε දࣔσʔλ༻ ςʔϒϧ Bitbucket ςʔϒϧ Backlog ςʔϒϧ Representation Πϯελϯε Transformer૚ Importer૚ Client૚
17. ैདྷͷΞʔΩςΫνϟͷ՝୊ͷղܾ • Client૚ͱImporter૚͕ີ݁߹͍ͯ͠Δ 17 Client૚͔ΒΠϯελϯεΛImporter૚ʹ౉͢Α͏ʹ͠ɺ Importer૚͸ϨίʔυΛอଘ͢Δ͜ͱʹ஫ྗ͢Δ
18. ैདྷͷΞʔΩςΫνϟͷ՝୊ͷղܾ • ΤϥʔϋϯυϦϯάɺϦτϥΠॲཧͳͲ͕Client૚ɾ Importer૚ͷ͍ΖΜͳՕॴͰ࣮૷͞Ε͍ͯΔ 18 Client૚ͰϦτϥΠॲཧͱΤϥʔΫϥεͷ࡞੒Λߦ͍ɺ ΤϥʔϋϯυϦϯά͸Importer૚Ͱߦ͏Α͏ʹͨ͠
19. ৽ͨͳσʔλΠϯϙʔτͷΞʔΩςΫνϟ • Client૚Λlib഑Լʹஔ͘Α͏ʹͨ͠ 19 . ┣━━━ app ┃ ┣━━ importer ┃ ┃ ┣━━ service_a ┃ ┃ ┗━━ service_b ┃ ┗━━ transformer ┗━━━ lib ┣━━ service_a_client ┗━━ service_b_client
20. 20 Before ಠࣗGemͷ Πϯελϯε Client૚ ֎෦ αʔϏε ֎෦ αʔϏε app After Representation Πϯελϯε αʔϏεಠࣗ ςʔϒϧ දࣔσʔλ༻ ςʔϒϧ Client૚ Importer૚ Transformer૚ Importer૚ Transformer૚ αʔϏεಠࣗ ςʔϒϧ දࣔσʔλ༻ ςʔϒϧ app lib
21. 21 ৽ͨͳσʔλΠϯϙʔτͷΞʔΩςΫνϟ ֎෦αʔϏεͷAPI΍ σʔλͷऔಘॲཧͷࠩ෼Λٵऩ ֤ΞιγΤʔγϣϯΛอ࣋͠ ඞཁͳσʔλΛอଘ͢Δ ֤αʔϏεͷσʔλߏ଄ ͷࠩ෼Λٵऩ Ҏલ͸ີ݁߹͍֤ͯͨ͠૚ͷ੹຿͕໌֬ʹͳͬͨ Client૚ ֎෦ αʔϏε Representation Πϯελϯε Importer૚ Transformer૚ αʔϏεಠࣗ ςʔϒϧ දࣔσʔλ༻ ςʔϒϧ app lib
22. ࠓޙ΍Γ͍ͨ͜ͱ 22
23. • શαʔϏεʹ͓͚ΔΞʔΩςΫνϟͷ౷Ұ • GitHub, GitLab͸·ͩچΞʔΩςΫνϟͷ·· • lib഑Լʹஔ͍֤ͨαʔϏεͷσʔλऔಘॲཧͷGemԽ 23 ࠓޙ΍Γ͍ͨ͜ͱ
24. ·ͱΊ 24
25. 25 ·ͱΊ Findy Team+Ͱ͸ɺClient૚ɾImporter૚ɾTransformer૚Ͱ ֎෦αʔϏεͷࠩ෼Λٵऩ͍ͯ͠Δ Client૚ ֎෦ αʔϏε Representation Πϯελϯε Importer૚ Transformer૚ αʔϏεಠࣗ ςʔϒϧ දࣔσʔλ༻ ςʔϒϧ app lib