Firestoreコスト圧縮の旅

Transcript

1. Firestore ίετѹॖͷཱྀ @bigplants May 21st 2024 @Hack@DELTA
2. Who am I ? • Daiki Hirakata (42) • Software Engineer • Main Programing Languages: PHP, TypeScript • Primary interests: DevOps, Docker, Kubernetes, GCP @bigplants
3. ے೑ϥϯφʔܥΤϯδχΞ
4. ͪΐͬͱ͚ͩએ఻
5. ઈࢍ։ൃऀืूதʂ • ϓϩμΫτ໊: ͸ͨLuck • ళฮαʔϏεۀ޲͚ʹγϑτػೳ Λ͸͡Ίͱͨ͠DXαʔϏε • ϞόΠϧΞϓϦͱ؅ཧը໘ͷWebΛఏڙ • PHP, TypeScript, Firebase, GCP • Laravel, React, Vue.js • גࣜձࣾHataLuck and Person
6. ͸ͨLuckͷγεςϜߏ੒ • DB͸FirestoreͱCloud SQL ͷϋΠϒϦουߏ੒ • Firebase -> Cloud SQLʹҰ ෦ͷσʔλΛಉظ • API͸Functions, Cloud Run
7. ࠓ೔ͷ͓୊ • Firebaseͷར༻࣮੷ • FirestoreͷίετѹॖͷͨΊͷௐࠪ • ՝ۚѹॖͷͨΊʹ΍ͬͨ͜ͱ • ݱࡏ࣮ࢪதͷࢪࡦͱ͜Ε͔Β
8. Firebaseͷར༻࣮੷
9. ن໛ײ • Cloud Functions • HTTP Trigger: 184 • Event Trigger: 167 • Cloud Firestore • Collections: over 100
10. Firestoreίετ • GCPશମͷ5ׂ͕Firestore • 98%͸Read! Read 3.5ԯ/day
11. Firestoreίετ 2022೥1݄͔Βݱࡏ·Ͱ ૿͑ͯ͸ݮΒͯ͠ɺ·ͨ૿͑ͯ
12. Ͳ͔͜ΒRead͞Ε͍ͯΔͷ͔ʁ • Cloud Functions • iOS/Android୺຤ • ؅ཧը໘ͷWeb
13. FirestoreίετѹॖͷͨΊͷ ௐࠪ
14. ԿΛௐࠪ͢Δ͔ʁ • ௐࠪͷ໨త͸Ͳͷػೳ͔Β࠷΋Read͕ଟ͍͔ ಛఆͯ͠ରԠ͢Δػೳͷ༏ઌ౓Λ͚ͭΔ͜ͱ • අ༻ରޮՌ͕ߴ͍ͱ͜Ζ͔Βணख͍ͯ͘͠ • ػೳผɺΞΫηεݩΫϥΠΞϯτผʹReadͷ ݅਺Λूܭ͢Δ
15. Ͳ͔͜Β݅਺Λநग़Ͱ͖Δͷ ͔ʁ • ؂ࠪϩά • Firestore/Datastore API • ※ ͜Ε͕།ҰͷFirestoreͷΞΫηεϩά ؂ࠪϩάͷඅ༻: ¥18,000/day!
16. ؂ࠪϩάͰऔΕΔσʔλ • ΦϖϨʔγϣϯ • GetDocument, RunQuery, CreateDocument ͳͲͳͲ • υΩϡϝϯτͷύε • ϢʔβΤʔδΣϯτ
17. ؂ࠪϩά • ੥ٻϨϙʔτͷRead Opsͱ؂ࠪϩάΛ෇͚߹ ΘͤΔ • ੥ٻϨϙʔτͷSKU: Cloud Firestore Read Ops Japanͷ݅਺͕՝ۚ୯Ґ
18. ۤ࿑ͨ͠ͱ͜Ζᶃ • FirestoreͷΞΫηεݩΛಛఆ͖͠Εͳ͍ • FunctionsͰ΋Firestore TriggerΠϕϯτͳͷ͔ HTTP TriggerΠϕϯτͳͷ͔Θ͔Βͳ͍ • ListenͰ࣮ࡍʹRead՝͕ۚ૸Δର৅ͷϩά͕ͲΕ͔ ൑ผΛ͚ͭΒΕͳ͍
19. ۤ࿑ͨ͠ͱ͜Ζᶄ • ؂ࠪϩάͱRead Opsͷ݅਺͕શવ߹Θͳ͍ • ࠷ऴతͳGoogleαϙʔτ͔Βͷճ౴ • ʮ؂ࠪϩά͔ΒRead Opsͷ಺༁͸௥͑ͳ͍ Αʙʯ <- Ͱ͖Δͬͯݴͬͨ͡ΌʔΜ orz
20. ௐࠪஅ೦ʂʂ (໿1.5ϲ݄Λඅ΍ͨ͠)
21. ͦΕͰ΋ಈ͖ग़͞ͳ͚Ε͹ʂ
22. ՝ۚѹॖͷͨΊʹ΍ͬͨ͜ͱ
23. ՝ۚѹॖࢪࡦ • FirestoreτϦΨFunctionsͷೋॏൃՐ๷ࢭͷϦ ΞʔΩςΫνϟ • ΞΫςΟϏςΟϩάͷҠߦ • FirestoreΩϟογϡػߏͷߏங • ΤΫεϙʔτର৅σʔλΛਫ਼ࠪ
24. FirestoreτϦΨFunctions ͷೋॏൃՐʁ • FirestoreτϦΨFunctions͸ॏෳ࣮ͯ͠ߦ͞Ε Δ͜ͱ͕͋Δ • ႈ౳ੑ͕୲อ͞Ε͍ͯΕ͹OK͕ͩɺɺ
25. ႈ౳ੑ͕୲อ͞Ε͍ͯͳ͍ Functions͕ଟ਺͋Γ
26. Functions͕ೋॏʹൃՐ͠ͳ͍ ࢓૊Έ͕ඞཁ
27. ΋ͱ΋ͱ࣮ࢪ͍ͯͨ͠ೋॏൃՐ ๷ࢭͷ࢓૊Έ • ൃՐ࣌ʹΠϯϕϯτIDΛFirestoreʹॻ͖ࠐΉ • ΠϕϯτID͕͢Ͱʹଘࡏ͢Ε͹ॲཧΛεΩο ϓɻͳ͚Ε͹ॲཧΛߦ͏
28. ΠϕϯτIDΛFirestoreʹ֨ೲ
29. Firestoreॻ͖ࠐΈίετ͕૿Ճ • ࠷ॳ͸ؾʹͳΒͳ͍͘Β͍͕ͩͬͨػೳ͕૿ ͑ɺϦΫΤετ਺͕૿͑ͯ͘ΔͱͦΕͳΓʹ໨ ཱͭΑ͏ʹͳͬͨ
30. ೋॏൃՐ๷ࢭͷϦΞʔΩςΫ νϟ • ॻ͖ࠐΈઌΛFirestore ͔Β Redis ʹมߋ • شൃσʔλ͸Firestoreʹஔ͔ͳ͍ 💰໿ ¥50,000/month ѹॖ (Write)
31. ΞΫςΟϏςΟϩάͷҠߦ • ΞΫςΟϏςΟϩάͱ͸ಛఆͷϢʔβૢ࡞ͷϩά ͷ͜ͱ • ΋ͱ΋ͱFirestoreʹϩάΛ֨ೲ͍ͯͨ͠ • Ϣʔβ͕૿͑Δͱ͡Θ͡Θॻ͖ࠐΈྔ͕ଟ͘ͳΔ • FirestoreͷΤΫεϙʔτର৅σʔλʹͳ͍ͬͯͨ
32. ΞΫςΟϏςΟϩάͷҠߦ • Firestore ͔Β BigQuery ʹҠߦ • ΤΫεϙʔτର৅͔Βআ֎ • ϩά͸Firestoreʹ͸ஔ͔ͳ͍ʂ 💰໿ ¥50,000/month ѹॖ (Write) 💰໿ ¥500,000/month ѹॖ (ΤΫεϙʔτͷRead)
33. FirestoreΩϟογϡػߏͷߏங • ϢʔβϚελ΍ళฮϚελͳͲΑ͘ࢀর͞Ε ΔσʔλΛRedisʹΩϟογϡ 💰໿ ¥100,000/month ѹॖ (Read)
34. ͦΕͰ΋ͳ͓૿͑ଓ͚Δίετ
35. ݱࡏਐߦதͷίετѹॖରࡦ With גࣜձࣾDELTA͞Μ
36. FirestoreͷΤΫεϙʔτΛ΍Ί Δ • ௚ۙ ¥100Ϛϯ/݄ͷReadͷ൒෼͕ΤΫεϙʔ τ • ΤΫεϙʔτͷ໨త • όοΫΞοϓ(༗ࣄͷࡍͷ෮ݩ͕໨త) • σʔλ෼ੳ༻్ͷBigQueryΠϯϙʔτ
37. FirestoreͷόοΫΞοϓ • FirestoreͷόοΫΞοϓ εέδϡʔϧͱϙΠ ϯτΠϯλΠϜϦΧόϦʹஔ͖׵͑
38. σʔλ෼ੳ • ࠩ෼όοΫΞοϓΛBigQuery΁ • Firebase ExtensionsΛར༻
39. Stream Firestore to BigQuery • https://extensions.dev/extensions/ fi rebase/ fi restore-bigquery-export • Cloud Firestore ίϨΫγϣϯ಺ͷυΩϡϝϯτ Λ BigQuery ʹΤΫεϙʔτɻΤΫεϙʔτ͸Ϧ ΞϧλΠϜ͔ͭ૿෼Ͱ͋ΔͨΊɺBigQuery ͷσʔ λ͸ Cloud Firestore ͷίϯςϯπͷϛϥʔͱ Δɻ
40. Firestore׬શҠߦ
41. ͍ͭʹຊ֨࢝ಈʂʂ
42. Firestore -> Cloud SQL΁ͷҠ ߦ Cloud Functions Cloud Firestore Cloud Run Cloud SQL ̍೥Ҏ্ͷϓϩδΣΫτʹͳΔ
43. Firestoreʹ͍ͭͯ૝͏ࣄ • εέʔϥϏϦςΟ͕ߴͯ҆͘ՁͳͷͰɺαʔϏε্ཱͪ ͛࣌͸ΧδϡΞϧʹԿͰ΋ஔ͖ͨ͘ͳΔ • ͕ɺɺ͋ͱ͋ͱɺ͓ۚʹΨπϯͱ௓Ͷฦͬͯ͘Δ • αʔϏεن໛͕େ͖͘ͳΔͱσʔλετΞ͸Firestoreͩ ͚Ͱ͸Կ͔ͱਏ͍ • ࢖͍ॴ͸Ұ෦ͷϚΠΫϩαʔϏεͷόοΫΤϯυͱଊ͑ ͓ͯ͘ͱͬ͘͠Γ͘Δ
44. ࠓ೔ͷ·ͱΊ • ϩά΍شൃσʔλ͸Firestoreʹ͸ͳΔ΂͘ஔ ͔ͳ͍ • Ϣʔβ਺͕૿͑Δͱ৭Μͳ΋ͷ͕δϫδϫͱ ૿͍͑ͯ͘ • Firestore͸ن໛͕େ͖͘ͳͬͯ͘Δͱίετί ϯτϩʔϧ͕೉͘͠ͳΔ
45. Thank You 🛹 ཱྀ͸ͭͮ͘