Tuning GraphQL on Rails

Kaigi on Rails 2024でお話しました。

Transcript

1. Tuning GraphQL on Rails - 10.26 ༗໌ίϩγΞϜ ిྲྀരഁσεϚον -
2. ࢁԼ
   ࿨඙
   
   !QZBNB
   (.0ϖύϘ
   ٕज़ج൫νʔϜ
   
   
   γχΞɾϓϦϯγύϧ
   
   
   ɹΩϟϯϓɺཱྀߦɺώϧτϯ८ΓɺεϚϒϥ
   
   
   
   
   
   ػցֶशɺ$*$%
3. Kaigi on Rails 2024 ࠷ߴͰ͢!!1
4. ࠓ೔࿩͢͜ͱ 1. ݱ৔঺հ 2. ൃੜ͍ͯͨ͠՝୊ 3. ͲͷΑ͏ʹղܾ͔ͨ͠ 4. ࣮ફN+1ղফ 5. ೔ʑͷӡ༻ 6. զ͕Ոʹ͓͚Δચ୕पظͷ໰୊Λ͍͔ʹղܾ͔ͨ͠
5. ίʔυαϯϓϧʹ͍ͭͯ • ձ৔ͰͷΈ΍͢͞Λ༏ઌͯ͠ɺຊདྷඞཁͳ࣮૷Λ࡟ͬͯίʔυαϯϓϧͱ ͍ͯࣔͯ͠͠ΔՕॴ͕ଟʑ͋Γ·͢ɻ • ͦΕΒ͍͠ίʔυ͸github.com/pyama86/kaigi-on-rails-2024
 Λ֬ೝ͍ͯͩ͘͠͞ɻ
6. ݱ৔Ұے
   ೥
7. minne ϋϯυϝΠυϚʔέοταʔϏε 1. ࡞඼ൢച 2. ࡞Ոࢧԉ 3. ϝσΟΞɾ޿ࠂ
8. minneͷΞϓϦέʔγϣϯߏ੒֓ཁ browser mobile app Web UI Rails Next.js Rails API ϞϊϦεߏ੒ͳRails ※ਤ্͸Rails͕̎ͭ͋ΔΑ͏ʹݟ͑·͕͢ɺͦΕ͸࢒૾Ͱ͋Γɺ࣮ࡍ͸1ϦϙδτϦͰಉ͡ίʔυͰ͢ɻ WEB UIͷϨϯμϦϯάͱɺAPIͷෛՙɺτϥϑΟοΫ͕ҟͳΔͨΊɺϦιʔε෼཭͍ͯ͠·͢ɻ
9. minneͷγεςϜߏ੒֓ཁ ΦϯϓϨϛεͱAWSͷϚϧνΫϥ΢υߏ੒ on premises AWS NKE(k8s) OpenStack Web Web API API EKS(k8s) EC2 Batch Direct
 Connect RDS Elastic xxx ѹ౗తͳ௿ίετ͕ͩɺ ϓϥοτϑΥʔϜͷ؅ཧίετ͕͋Δ ίετ͸ֻ͔Δ͕ɺσʔλετΞͷ ϚωʔδυɾαʔϏεͳͲӡ༻ෛՙܰݮ Web API
10. ൃੜ͍ͯͨ͠
    ՝୊
11. ૿͑ଓ͚ΔVM ΦϯϓϨϛε: 120VM(16vCPU/32GB Memory) AWS: 20ʙ80VM※(8vCPU/16G Memory) ※AWS͸ϐʔΫλΠϜʹΦϯϓϨϛεͷτϥϑΟοΫΛΦϑϩʔυ͓ͯ͠Γɺ
 ΦʔτεέʔϧʹΑͬͯ୆਺͕૿ݮ͢Δ ෛՙ͕ߴ͍ˠͱΓ͋͑ͣVM૿΍͢ͷ࿈࠯
12. https:// fi nance.yahoo.co.jpΑΓҾ༻ ݮΓଓ͚Δۚ Կ΋ͯ͠ͳ͍ͷʹ རӹݮͬͨΜͰ͚͢Ͳɾɾɾʁ
13. ???????????????????????????
14. !?!?!?!?!?!?!?!?!?!?!?!?!?!?!?!?!?
15. ͍ͭ͜ɺN+5000͡ΌͶ͔͐ʂʂʂ
16. ͲͷΑ͏ʹ
    վળ͔ͨ͠
17. ͲͷΑ͏ʹվળ͔ͨ͠ʁ query { orders { id customer { name } } } select * from orders; select * from customers where customers_id = 1; select * from customers where customers_id = 2; select * from customers where customers_id = 3; … select * from customers where customers_id = 5000; GraphQLͰΑ͋͘ΔN+1ͳΫΤϦ
18. ͲͷΑ͏ʹվળ͔ͨ͠ʁ • lookaheadΛར༻͢Δ • όονϩʔυΛར༻͢Δ • Shopify/graphql-batch • GraphQL::Dataloader select * from orders; select * from … where customers_id in(1, 2…5000);
19. lookaheadΛར༻ͨ͠ઌಡΈ lookahead͕γϯϓϧʹॻ͚Δ
20. HSBQIRMCBUDI
21. promise.rb RubyͷPromises/A+४ڌͷϥΠϒϥϦ https://github.com/lgierth/promise.rb thenʹ౉͞ΕͨϒϩοΫ͕஗Ԇ࣮ߦ͞ΕΔ
22. select * from orders; select * from customers where customers_id = 1; select * from customers where customers_id = 2; select * from customers where customers_id = 3; … select * from customers where customers_id = 5000; Ͳ͜Λ஗Ԇ࣮ߦͤ͞Δ͔ʁ ID͚ͩઌʹूΊͱ͍ͯɺ ΫΤϦ͸͋ͱ͔Β஗Ԇ࣮ߦͯ͠ ·ͱΊͯ౤͍͛ͨ
23. https://github.com/Shopify/graphql-batch/blob/main/examples/association_loader.rb customer_idΛΩϡʔʹ௥Ճͯ͠ɺ PromiseΛฦ٫ queue = [1, 2, 3, 4 … 5000]
24. Promise.sync=Promiseͷ࣮ߦ query { orders { id customer { name } } } ্͔Βॱ൪ʹઙ͍ॱʹPromise.sync͕ίʔϧ͞ΕΔ 1. Ordersͷϓϩϛε͕࣮ߦ͞ΕΔ 2. Customerͷϓϩϛε͕ ࣮ߦ͞ΕΔ
25. Promise.sync 1.recordsʹ͸loadͰ queueʹཷ·͍ͬͯͨ஋͕౉Δɻ ஗Ԇ࣮ߦର৅ͷϨίʔυΛ ·ͱΊͯpreload 2.Ϩίʔυ͝ͱʹ݁ՌΛ ෼ׂͯ͠ຒΊࠐΉ
26. in۟ʹ5000΋Ҿ਺౉͢ͳ͸ॾઆ͋Δ select * from orders; select * from … where customers_id in(1, 2…5000); ActiveRecord::Associations::PreloaderͰ in۟ʹ·ͱΊΒΕΔ
27. ࣮ફ/ ղফ
28. Πϯελϯεϝιου query { orders { id customer { name isLoyal } } } select 1 As one from sales where customers_id = 1; select 1 As one from sales where customers_id = 2; select 1 As one from sales where customers_id = 3; … ഁ໓ϩυϦήεʂʂʂʂʂ
29. Πϯελϯεϝιου զʑʹ͸஗Ԇ࣮ߦ͕͋Δ͡Όͳ͍͔
30. ଠ٬͕ա͗Δ
31. LoaderΛॻ͘ REST API͔ΒͷҠߦ࣌ͳͲ طଘͷϝιου͸ खΛೖΕͮΒ͍
32. LoaderΛॻ͘ customer_id ͝ͱʹɺsalesͰιʔτͨ݁͠Ռͷ ্͔Βॱʹ1,2,3…ͷΑ͏ʹ൪߸Λ;Δ existsʁͷ൑ఆΛ͍ͨ͠ͷͰɺcustomer_id͋ͨΓ 1͚݅ͩऔΕ͹OK
33. LoaderΛॻ͘ ΫΤϦͷ݁ՌΛPromiseͷ໭Γ஋ʹઃఆ
34. LoaderͷϝϦοτɾσϝϦοτ 1. LoaderͰεοΩϦ͔͚Δ 2. Loaderཚཱ͢ΔͱLoaderʹϏδωε ϩδοΫ͕ຒΊࠐ·ΕͯɺϞσϧͱ
 ࠩҟ͕ੜ·ΕΔ͜ͱ͕͋Γɺ
 όάͷԹচͱͳΓ͑Δ
35. ύϑΥʔϚϯεͷ໰୊ͷ୳͠ํ APMΛ࢖͏ͷ͕͓͢͢Ί
36. ύϑΥʔϚϯεͷ໰୊ͷ୳͠ํ query { orders { id customer { name isLoyal } } } ΫΤϦͷਂ͕͞ઙ͍ॱʹΫΤϦ͕࣮ߦ͞ΕΔ
37. ύϑΥʔϚϯεͷ໰୊ͷ୳͠ํ APMͷεύϯΛ෼͚ΔͱɺΑΓ୳͠΍͍͢
38. ࣮੷঺հ ΦϯϓϨϛε: 120VM -> 30VM AWS: 20ʙ80VM -> 20VM(εέʔϧΞ΢τ͕ෆཁʹͳͬͨ) minneʹ͓͍ͯ͸ύϑΥʔϚϯε͕޲্
39. ϝτϦΫε΋େ෯ʹվળ ΤϯυϙΠϯτͷϨΠςϯγɺDBͷCPU࢖༻཰͕վળ
40. ೔ʑͷӡ༻
41. ͳΜͰͳΜʁʁʁ ਆ͕͔ͬͨνϡʔχϯά ೔ʑগͮͭ͠αʔϏε͸஗͘ͳΔ
42. ೔ʑαʔϏε͸ॱௐʹ੒௕ɺ ͓٬ͷসإͰ͞ΒͳΔඈ༂Λ໨ඪ • minne޿ࠂ • ಈըίϯςϯπ • minne PLUS https://tech.pepabo.com/2024/08/05/minne-movie/ ৽ػೳ͕૿͑Δ=৽͍͠ΫΤϦ͕૿͑Δ
43. SLIͱSLO SLI = Service Level Indicator αʔϏεϨϕϧࢦඪ SLO = Service Level Objective αʔϏεϨϕϧ໨ඪ GraphQLͷϨΠςϯγΛSLIʹઃఆ
44. SLIͱSLOͷܾΊํ αʔϏεͷKPI͔ΒϒϨΠΫμ΢ϯܾͯ͠ΊΔ minneʹ͓͚ΔΧʔτΠϯͱϨεϙϯελΠϜͷ૬ؔ ੺͍఺=ΧʔτΠϯ ੨͍఺=཭୤
45. ϞχλϦϯάख๏ • SaaS(Datadog/New Relic/Sentry) • OpenTelemetry with Grafana Stack ͍ΘΏΔAPMͰՄ؍ଌੑΛ্͛Δͷ͕ྑ͍
46. OpenTelemetry چདྷɺ4BB4΍044͝ͱʹ࣮૷͞Ε͍ͯͨςϨϝτϦσʔλͷඪ४Խ IUUQTDMPVEOBUJWFEBZTKQPZ https://opentelemetry.connpass.com/
47. OpenTelemetry https://opentelemetry.io/docs/ ֤ݴޠͷSDK΍ ࣗಈܭ૷ɺखಈܭ૷ ΍ϛυϧ΢ΣΞ͔Β ςϨϝτϦσʔλΛ ग़ྗ
48. OpenTelemetry https://opentelemetry.io/docs/ ඪ४Խ͞Εͨϓϩτίϧʹ ରԠͨ͠ΤʔδΣϯτ
49. OpenTelemetry https://opentelemetry.io/docs/ 4BB4΍
    ϗετ͞Εͨ044
    ࠩ͠ସ͑Մೳ
50. μογϡϘʔυ ͖͍͠஋؂ࢹ & ຖिΈΜͳͰோΊΔ • ϦϦʔεʹىҼͨ͠ϨεϙϯεѱԽ • αʔϏεͷ݈શੑͷ೴಺ಉظ
51. ࠓ೔࿩ͨ͜͠ͱ • N+1ͷ໰୊͸graphql-batchͷAssociation Loader΋͘͠͸ GraphQL::DataLoaderͷͦΕʹ४͡Δ࣮૷Ͱ͍͍ͩͨย෇͘ • ҆қʹઌಡΈ͢ΔͱɺϨίʔυ਺ͷଟ͍ςʔϒϧΛେྔʹϩʔυͯ͠͠· ͏͜ͱ͕͋ΔͷͰͦ͏͍͏έʔεͰ͸ࣗ࡞ͷLoaderΛॻ͘ • LoaderΛཚཱ͢ΔͱɺϞσϧͱͷ࣮૷ࠩҟ͕ੜ·ΕΔ͜ͱ΋͋ΔͷͰɺҰ ؏ੑΛ࣮࣋ͭ૷ʹ͢Δ • ೔ʑͷϞχλϦϯάͰύϑΥʔϚϯεͷྼԽʹରॲ͢Δ
52. ਓྨͷΞ΢τϓοτΛ૿΍͠·͠ΐ͏ ࠷৽ͷ࠾༻৘ใΛνΣοΫˠ !QC@SFDSVJU