RSpec for AWSフルマネージドサービス

■イベント
【福岡】GMOペパボ × Sansan合同勉強会 「歴史ある大規模サービスがまだなお成長する秘訣」
https://sansan.connpass.com/event/71727/

■登壇概要
タイトル：RSpec for AWSフルマネージドサービス
登壇者：Eight事業部 サーバサイドエンジニア 藤井洋太郎

Transcript

1. ɹɹɹ RSpec for ɹAWSϑϧϚωʔδυαʔϏε 
   ౻Ҫ
   ༸ଠ࿠
2. ZPUBSP ౻Ҫ༸ଠ࿠
3. දࢀಓ
4. 4BOTBOͷ̎ͭͷαʔϏε ๏ਓ޲໊͚ࢗ؅ཧαʔϏε ݸਓ޲໊͚ࢗΞϓϦ
7. ᶃ ໊ࢗΛεΩϟϯ ᶅ OCRॲཧˍΦϖϨʔλʔೖྗ OCRͱΦϖϨʔλʔʹΑΔଟॏೖྗ ᶆ σʔλϕʔεԽ • ςΩετσʔλ • ը૾σʔλ ᶇ ΞϓϦέʔγϣϯͰ׆༻ ໊ࢗͷݕࡧɾӾཡɾฤू ᶄσʔλૹ৴ Πϯλʔωοτ ͓٬༷ Database ໊ࢗΛ “ࢿ࢈”ͱͯ͠؅ཧ ໊ࢗΛ ࢿ࢈ͱͯ͠؅ཧ ೖྗαʔϏε Ϋϥ΢υαʔ Ϗε 4BOTBOͷ࢓૊Έ
8. ۀछɺن໛Λ໰Θͣɺ ࣾΛ௒͑Δಋೖ
9. ݸ ਓ ޲ ͚ ໊ ࢗ Ξ ϓ Ϧ
10. 150ສਓ͕ར༻͢Δɺ໊ࢗΛ࣠ʹͨ͠ϏδωεSNS ໊ࢗ؅ཧ ਓࣄ৘ใΛ௨஌ ؔ࿈͢Δاۀͷχϡʔε άϧʔϓϝοηʔδ
11. ৽ଔ4೥໨ 28ࡀ ج൫νʔϜ Ϧʔμʔ ύϑΥվળ ΞʔΩςΫνϟ ಋೖ
12. 4BOTBOגࣜձࣾ
    ԭೄ୲౰
    ࣗশ
13. 4BOTBOגࣜձࣾ
    വؗ୲౰
    ·ͩճ͚ͩ
14. 4BOTBOגࣜձࣾ
    ෱Ԭ୲౰
    ʹ΋ͳΓ͍ͨ
15. ๺͔Β ೆ·Ͱ
16. ຊ୊ ࠓճͷษڧձͷςʔϚ
17. ྺ࢙͋Δେن໛αʔϏε͕ ·ͩͳ͓੒௕͢Δൿ݃ <
    
    
    
    
    
    
    
    
    
    
    
    
    
    
    
    >
18. 🤔
19. &JHIUͷن໛ͱαʔϏεߏ੒
20. Ϣʔβ਺ 150ສਓ ೥ؒ 1ԯຕ ࠃ಺໊ࢗަ׵ 10%
21. ྦྷܭԯຕҎ্
    σʔλԽ
    
    σʔλϕʔεԽ
22. 3BJMTΞϓϦέʔγϣϯ
23. ͦͯ͠
24. D I D KPI D D N B P P A B/ I N W D W Recommendation Feed AWSʹΰϦοΰϦʹґଘ💊 AWS100αʔϏεͷ͏ͪͷ ໿൒਺Λར༻
25. 3BJMT
    ʷ
    "84αʔϏε
    ʷ
    ඼࣭ 😌
26. ϑϧϚωʔδυαʔϏεͷϝϦοτɾσϝϦοτ ӡ༻ίετݮ ϞχλϦϯά΍ࣗಈԽ ҡ࣋ίετߴ ηΩϡϦςΟߴ ϝϦοτ σϝϦοτ ؔ৺ࣄͷ෼཭ ϩʔΧϧ։ൃ؀ڥ ςετ(CI)؀ڥ ͕ͳ͍ʂʂʂ
27. ϑϧϚωʔδυ͋Δ͋Δᶃ ʮ4UVC͕ͪ͠ʯ 👷 ϩʔΧϧ 4UVC ࣮؀ڥ ࣄલʹఆٛͨ͠ϨεϙϯεΛৗʹฦ͢ Aws.config[:stub_responses] = true
28. ϑϧϚωʔδυ͋Δ͋Δᶄ ʮςετॻ͔ͳ͘ͳΓ͕ͪʯ TUVCͩΒ͚ͷςετ͸ʮઈରʹམͪͳ͍ςετʯ
    Λॻ͘͜ͱͱಉٛʹײͯ͘͡Δ it ‘true͸trueͰ͋Δ͜ͱ’ do expect(true).to eq true end
29. ϑϧϚωʔδυ͋Δ͋Δᶅ ʮϩʔΧϧ͔Β4UBHJOHʹͭͳ͕͗ͪʯ ELEL͠ͳ͕Β
    ࣮ࡍͷ4UBHJOH؀ڥʹͭͳ͙ ϩʔΧϧ ࣮؀ڥ ~/.aws/credentials aws_access_key_id=[stagingͷkey] aws_secret_access_key=[stagingͷsecret]
30. ϑϧϚωʔδυ͋Δ͋Δᶆ ʮεςʔδϯάʹͭͳ͍Ͱ΍Β͔͕ͪ͠ʯ ϩʔΧϧ ࣮؀ڥ bundle exec rake db migrate:reset ໭͢ͷ๨ΕͯϦηοτ🎉
31. ඼࣭௿Լ ϦεΫߴ ϝϯςφϯεੑ ௿Լ ੜ࢈ੑ௿Լ
32. ʮϩʔΧϧͰಈ͔ͳ͍ʯ͸
    ݈શ͡Όͳ͍
33. ͱ͍͏͜ͱͰ͜Ε͔Β࿩͢͜ͱΛߦͰ·ͱΊΔͱ
    
    ओཁػೳ͸ҙ஍Ͱ΋ϩʔΧϧͰಈ͔ͦ͏
    
    ϩʔΧϧͰಈ͔͢ࡍͷߴ଎ԽςΫχοΫ
    
    %PDLFSΛ࢖ͬͨҰൃ؀ڥߏஙʂ
34. &JHIU
    ͷϩʔΧϧࣄ৘
35. Aurora DynamoDB ElastiCache Elasticsearch Service SQS CloudSearch S3 Redshift ϩʔΧϧ؀ڥʹ શ্ཱ͕ͯͪΔ
36. ͍ΘΏΔʮ'BLFܥʯΛ
    ۦ࢖ͯ͠ϩʔΧϧ؀ڥͰ׬݁ͤ͞Δ
37. Aurora Mysql5.6 Redshift Postgres DynamoDB DynamoDB Local SQS ElasticMQ S3 FakeS3 Elasticsearch Service Elasticsearch ElastiCache Memcached & Redis CloudSearch nozama-cloudsearch "84αʔϏε
    ⾩
    'BLFܥରԠҰྫ
38. ϩʔΧϧͰಈ࡞·Ͱͷجຊ4UFQ  ֤'BLFܥΞϓϦέʔγϣϯΛ%PXOMPBE
    
    *OTUBMM
    جຊ044ͱͯ͠ެ։͞Ε͍ͯΔͷͰແঈͰར༻Ͱ͖Δ
     ΞϓϦέʔγϣϯ 3BJMT ॳظԽॲཧͰ֤"XT
    $MJFOUͷ޲͖ઌΛ
    Ͱ্ཱͪ͛ͨϓϩηεͷFOEQPJOUʹมߋ ~/con fi g/initializers/aws.rb if Rails.env.test? || Rails.env.development? Aws.con fi g[:dynamodb] = { endpoint: 'http://localhost:8000', access_key_id: 'fake_akid', secret_access_key: ‘fake_secret’, } … end
39. ϩʔΧϧͰಈ࡞·Ͱͷجຊ4UFQ  ͜Ε͚ͩͰEFWFMPQNFOU؀ڥ͸ಈ͘🎉
     34QFD౳Ͱಈ͔ͨ͢ΊʹɺσʔλॳظԽॲཧΛ௥Ճ
    ɾ%ZOBNP%#ͷ৔߹ҎԼͷΑ͏ͳॲཧΛ௥Ճ  dTQFDTVQQPSUEZOBNPECSC౳Λ༻ҙ
     ACFGPSF TVJUF A
    Ͱςετ༻ςʔϒϧ࡞੒ॲཧ
     QSFQFOE@CFGPSF FBDI
    Ͱσʔλ࡟আॲཧ
     BQQFOE@BGUFS TVJUF
    Ͱςετ༻ςʔϒϧ࡟আॲཧ ίʔυ͸ https://qiita.com/yotaro/items/caff6dc4c6b6ed2b19ee Λࢀߟʹ
40. ςετ؀ڥߏங࣌ͷ஫ҙ఺  8FC.PDL౳Λ࢖͍ͬͯΔ৔߹͸࢖༻͢ΔαʔϏεΛڐՄͯ͋͠ ͛Δඞཁ͕͋Δ
    
    
     αʔϏεʹΑͬͯ͸σʔλ࡟আ͢Δ"1*͕ແ͍ͷͰࣗ࡞͠ͳ͚Ε ͹ͳΒͳ͍ɻ%ZOBNP%#
    -PDBMͷ৔߹ con fi g.before(:suite) do … WebMock.disable_net_connect!( allow_localhost: true, allow: [‘http://127.0.0.1:8000'], # DynamoDB Local΁ͷΞΫηεΛڐՄ ) end  શςʔϒϧΛTDBOͯ͠JUFNऔಘ
     औಘͨ͠JUFNͷ࡟আ"1*Λίʔϧ
41. ֤αʔϏε෼͜ͷΑ͏ͳ
    গ͠໘౗͍͘͞😅 ઃఆΛ
    ͢Δ͚ͩͰ։ൃ؀ڥςε τ؀ڥ͕ಈ͍ͯ޾ͤʂ
42. ͱ͸ͳΒͳ͍🙅
43. ςετَ͕ͷΑ͏ʹ஗͘ͳΔ 40෼ 10෼
44. શͯͷςετέʔεͰ
    શͯͷαʔϏεͷσʔλ࡟আॲཧ
    ͕૸ͬͯ͠·͏  dTQFDTVQQPSUEZOBNPECSC౳Λ༻ҙ
     ACFGPSF TVJUF A
    Ͱςετ༻ςʔϒϧ࡞੒ॲཧ
     QSFQFOE@CFGPSF FBDI
    Ͱσʔλ࡟আॲཧ
     BQQFOE@BGUFS TVJUF
    Ͱςετ༻ςʔϒϧ࡟আॲཧ
45. 34QFDߴ଎Խ5JQT🐎  34QFDͷλάػೳΛ࢖ͬͯ
    ඞཁͳͱ͖ʹඞཁͳαʔϏε͚ͩॳظԽ
     σʔλૠೖ͞ΕͨςʔϒϧΛهԱͯ͠
    ૂ͍ଧͪͰແବͳ͘ॳظԽʂ
46. 34QFDͷλάػೳ🔖 RSpec.con fi gure do |con fi g| con fi g.prepend_before(:each, :dynamodb) do # dynamodbͱ͍͏λά͕෇͚ΒΕͨ # ςετέʔε͚ͩॳظԽॲཧΛߦΘͤΔ͜ͱ͕Մೳ ... end end describe 'DynamoDBʹର͢Δૢ࡞', :dynamodb do # dynamodbͷॳظԽॲཧ͕ߦΘΕΔ … end describe 'DynamoDB͕ؔ܎ͳ͍ૢ࡞' do # dynamodbͷॳظԽॲཧ͸ߦΘΕͳ͍ɻ # itemͷଘࡏ༗ແ͕ςετͷ݁ՌʹӨڹ͠ͳ͍৔߹͸ॳظԽ͠ͳ͍ɻ … end ॳ ظ Խ ॲ ཧ ֤ ς ε τ έ ᴺ ε
47. ࢖༻͞ΕͨςʔϒϧͷϝϞԽ
    📝 module UsedTableRecorder def used_tables @used_tables ||= [] end def clear_used_tables @used_tables = [] end [:put_item, :update_item].each do|method| de fi ne_method method do|*args, &block| request_item = args[0] used_tables << request_item[:table_name] super(*args, &block) end end [:batch_write_item].each do|method| de fi ne_method method do|*args, &block| request_items = args[0][:request_items] used_tables.concat(request_items.keys) super(*args, &block) end client = Aws::DynamoDB::Client.new( stub_responses: false ) client.extend(UsedTableRecorder) RSpec.con fi gure do |con fi g| con fi g.prepend_before(:each, :dynamodb) do # ॳظԽ͢Δର৅ͷςʔϒϧͷΈऔಘ truncate_tables = client.used_tables.uniq.compact # ্هςʔϒϧͷΈॳظԽॲཧ ... end end
48. ςετَ͕ͷΑ͏ʹૣ͘ͳΔ😄 40෼ 10෼ 13෼ ಋೖલ ಋೖ్த ࠷ऴܗଶ ͜ΕͩͬͨΒڐ༰Ͱ͖ Δʂ
49. ։ൃ؀ڥ໰୊ͳ͠ʂ
    ςετ΋଎͘ͳͬͯ໰୊ͳ ͠ʂ͜ΕͰνʔϜϝϯόʔશ һ
    ϋοϐʔʂ😍
50. ͱ͸ͳΒͳ͍🙅
51. े਺ݸͷαʔϏεΛ্ཱͪ͛ Δͷ͕໘౗͗ͯ͘͢͞ߏங͢ ΔؾʹͳΒͳ͍
52. λΠϛϯά΍ݸਓͷ؀ڥʹΑͬͯ
    Πϯετʔϧ͞ΕΔ
    όʔδϣϯ͕ҟͳͬͯಈ͔ͳ͍⚙
53. ͊͞ ΁޲͔͓͏͔
54. &JHIUͷ։ൃ༻
    AEPDLFSDPNQPTFZNMA version: '2' services: dynamodb: image: ['ECRʹ্͛ͨimageΛࢦఆ'] ports: - "8000:8000" restart: always elasticmq: image: ['ECRʹ্͛ͨimageΛࢦఆ'] ports: - "9324:9324" restart: always redis: image: redis:alpine ports: - "6379:6379" restart: always mysqld: image: mysql:5.6 ports: - "3306:3306" environment: MYSQL_ROOT_PASSWORD: rootpass restart: always elasticsearch: image: elasticsearch:5.3 ports: - "9200:9200" - "9300:9300" environment: - "ES_JAVA_OPTS=-Xms300m -Xmx500m" restart: always fakes3: image: ['ECRʹ্͛ͨimageΛࢦఆ'] ports: - "4569:4569" restart: always fakes3test: image: ['ECRʹ্͛ͨimageΛࢦఆ'] ports: - "4570:4569" restart: always memcached: image: memcached:alpine ports: - "11211:11211" restart: always cloudsearch: image: ['ECRʹ্͛ͨimageΛࢦఆ'] links: - mongo:mongo_for_cs_1 - elasticsearch:elasticsearch_for_cs_1 ports: - "15808:15808" restart: always mongo: image: mongo ports: - "27017:27017" restart: always postgres: image: postgres:alpine ports: - "5432:5432" restart: always
55. AWS Service FakeܥαʔϏε Docker Hub ެࣜImage༗ແ Aurora Mysql5.6 ‒ Redshift Postgres ‒ DynamoDB DynamoDB Local ✕ SQS ElasticMQ ✕ S3 FakeS3 ✕ Elasticsearch Service Elasticsearch ‒ ElastiCache Memcached & Redis ‒ CloudSearch nozama-cloudsearch ✕
56. ެࣜJNBHF͕ແ͍΋ͷ͸ࣗ࡞ͯ͠"84
    &$3Ͱ؅ཧ "NB[PO
    &$3 ࣗ࡞%PDLFSGJMF༻ϦϙδτϦ ߋ৽ %PDLFSGJMF Ϗϧυґཔ CVJME͞Ε ͨ*NBHFΛ
    QVTI ϝΠϯϦϙδτϦ %PDLFS
    )VC EPDLFSDPNQPTFZNM ެࣜΠϝʔδ
    ΛQVMM ࣗ࡞ΠϝʔδΛQVMM
57. ։ൃ؀ڥ໰୊ͳ͠ʂ
    ςετ໰୊ͳ͠ʂ
    ϩʔΧϧ؀ڥҰൃߏஙʂ
    NKEϋοϐʔʂ😍
58. ͓·͚
59. ࣗྗͰؤுΒͳͯ͘΋
    -PDBM4UBDL
    1+5ͰશͯखʹೖΔʂ ͔΋ IUUQTMPDBMTUBDLDMPVE
60. ·ͱΊ
61. αʔϏεͷ҆ఆՔಇͱܧଓత੒௕ʹ͸ ଥڠͳ͖ ʮϩʔΧϧ؀ڥ։ൃߏஙʯ ͕ෆՄܽʂ
62. ࠷ޙʹʂ
63. ࠙਌ձͰEightͰ໊ࢗަ׵͠·͠ΐ͏
64. Your business network