サーバーレスアーキテクチャで作ったIoTのバックエンドシステムで遭遇したエラーと対処法

by yuji nishimura

Slide 1

Slide 1 text

αʔόʔϨεͰ࡞ͬͨ *P5ͷόοΫΤϯυγεςϜͰ ૺ۰ͨ͠Τϥʔͱରॲ๏ $9ࣄۀຊ෦ ੢ଜ༞ೋ

Slide 2

Slide 2 text

#cmdevio2019

Slide 3

Slide 3 text

εϥΠυ͸ޙͰೖख͢Δ͜ͱ͕ग़དྷ·͢ͷͰ ൃදதͷ಺༰ΛϝϞ͢Δඞཁ͸͋Γ·ͤΜɻ ࣸਅࡱӨΛ͢Δ৔߹͸ ϑϥογϡɾγϟολʔԻ͕ग़ͳ͍Α͏ʹ͝഑ྀ͍ͩ͘͞ Attention

Slide 4

Slide 4 text

ࣗݾ঺հ 2019 APN AWS Top Engineersೝఆ AWSೝఆ 2017/5 ΫϥεϝιουJoin ౦ژ͔ΒେࡕʹUλʔϯస৬ ೖࣾ࣌͸৘γεॴଐ ೖࣾલ͸ISPͷձࣾͰӡ༻อक ܦྺ ੢ଜ ༞ೋ(28) CXࣄۀຊ෦ॴଐ େࡕΦϑΟεࡏ੶

Slide 5

Slide 5 text

ൃද಺༰ αʔόʔϨεͳIoTγεςϜΛ ӡ༻͍ͯ͠·ͨ͠ ͦ͜Ͱɺૺ۰ͨ͠Τϥʔͱରॲ๏ͱ ͔ͦ͜ΒֶΜͩ͜ͱΛڞ༗͠·͢

Slide 6

Slide 6 text

ຊൃදͷର৅ऀɾ໨త ର৅ऀ w"84*P5΍-BNCEBͰͲ͏͍͏ͱ͜ΖʹؾΛ͚ͭͨΒ͍͍͔ɹ ஌Γ͍ͨਓ w*P5ɺαʔόϨεΛ͜Ε͔Β΍͍͖͍ͬͯͨਓ ໨త w-BNCEB "84*P5ͷϋϚΓͦ͏ͳಛੑΛ஌ͬͯ΋Β͏ w͜Ε͔Β*P5΍αʔόʔϨεΛ΍Δਓͷࢀߟʹ

Slide 7

Slide 7 text

ΞδΣϯμ wαʔόʔϨεͱ͸ w"84*P5$PSFͷ֓ཁ wΞʔΩςΫνϟͷઆ໌ wΤϥʔ͔ΒֶΜͩͭͷ͜ͱ wͲΜͳΤϥʔʹૺ۰͔ͨ͠ w·ͱΊ NJO NJO NJO NJO NJO NJO

Slide 8

Slide 8 text

αʔόʔϨεͱ͸

Slide 9

Slide 9 text

ར༻ऀଆ͕αʔόʔͷଘࡏΛ ҙࣝ͠ͳͯ͘ྑ͍ ΞʔΩςΫνϟ

Slide 10

Slide 10 text

αʔόʔϨεͷಛ௃ wΫϥ΢υϕϯμʔʹΑΔɹ ϚωʔδυαʔϏε wαʔϏεͷӡ༻؅ཧ͸͢΂ͯɹ Ϋϥ΢υϕϯμʔʹ͓·͔ͤ w04΍ϛυϧ΢ΣΞͷύον͸ ࣗಈͰదԠ w׬શैྔ՝ۚ wΞΠυϧ࣌ؒʹ՝ۚ͞Εͳ͍ wϓϩάϥϜ͕࣮ߦ͞Εͨ࣌ؒʹର͠ ͯ՝ۚ wߴՄ༻ੑ wΫϥ΢υϕϯμʔଆͰউखʹ৑௕Խ wࣗಈతʹεέʔϧΞοϓ

Slide 11

Slide 11 text

AWS Lambda

Slide 12

Slide 12 text

"84-BNCEBͷಛ௃ wΠϕϯτυϦϒϯ wࣗಈతʹεέʔϧ wϛϦඵ୯Ґͷ՝ۚ αʔόʔϨε։ൃͷίΞαʔϏε αʔόʔΛ؅ཧͤͣʹϓϩάϥϜ͕࣮ߦͰ͖Δ ίϯϐϡʔςΟϯάαʔϏε wߴ͍ࣗ༝౓ͱॊೈੑ w༷ʑͳݴޠʹରԠʢ/PEFKT 1ZUIPO +BWB (P FUDʣ wଟ͘ͷ"84αʔϏεͱ࿈ܞՄೳ

Slide 13

Slide 13 text

"84-BNCEBͷྉۚ wϦΫΤετճ਺ʹର͢Δ՝ۚ w݄ສ݅·Ͱ͸ແྉɺສ݅͋ͨΓ ౦ژϦʔδϣϯ w࣮ߦ࣌ؒʹର͢Δ՝ۚ ϝϞϦ(MB) ݄ͷແྉ࿮(ඵ਺) 100ϛϦඵ୯ҐͷՁ֨(USD) 128 3,200,000 0.000000208 192 2,133,333 0.000000313 256 1,600,00 0.000000417 ... ... ... ݸਓϨϕϧͰར༻͢Δ෼ʹ͸΄΅ྉۚ͸͔͔Βͳ͍ͷͰؾܰʹར༻Ͱ͖Δ

Slide 14

Slide 14 text

αʔόʔϨε։ൃͱ͸ αʔόʔϨε։ൃ͸ Lambda΍ϚωʔδυαʔϏεΛ ૊Έ߹ΘͤͯγεςϜΛ ߏங͍͖ͯ͠·͢

Slide 15

Slide 15 text

αʔόʔϨεͷϝϦοτ wίετͷ࠷దԽ͕ਤΕΔ wӡ༻ෛՙͷ௿ݮ wΞϓϦͷ࣮ߦ؀ڥ͕͙͢ʹखʹೖΔ wؾܰʹࢼͤΔ

Slide 16

Slide 16 text

AWS IoT Coreͷ֓ཁ

Slide 17

Slide 17 text

"84*P5$PSFͷ֓ཁ w༷ʑͳσόΠεͱ"84ΛηΩϡΞʹ઀ଓ wσόΠεσʔλʹର͢Δॲཧ΍ΞΫγϣϯΛ࣮ߦՄೳ wσόΠεΛϦϞʔτͰ੍ޚɾ؅ཧ͢Δ͜ͱ͕Մೳ wෳ਺ͷػೳ͔Βߏ੒͞ΕΔϚωʔδυαʔϏε https://www.slideshare.net/AmazonWebServicesJapan/aws-black-belt-online-seminar-2016-aws-iot

Slide 18

Slide 18 text

"84*P5$PSFͷશମ૾ https://www.slideshare.net/AmazonWebServicesJapan/aws-black-belt-online-seminar-2016-aws-iot

Slide 19

Slide 19 text

"84*P5$PSFͷྉۚͷ֓ཁ wैྔ՝ۚɺ࠷௿ར༻ྉۚͳ͠ w઀ଓ࣌ؒɿ64% ઀ଓສ෼͋ͨΓ wϝοηʔδɿԯ݅·Ͱ64% ສ݅͋ͨΓ wϨδετϦɺσόΠεγϟυ΢ɿ64% ສ݅͋ͨΓ wτϦΨʔϧʔϧɺ࣮ߦΞΫγϣϯɿ64%ɹɹɹɹɹɹ τϦΨʔ͞Εͨϧʔϧສ݅͋ͨΓ࣮ߦ͞ΕͨΞΫ γϣϯສ݅͋ͨΓ https://aws.amazon.com/jp/iot-core/pricing/ ※౦ژϦʔδϣϯͰͷྉۚମܥ

Slide 20

Slide 20 text

"84*P5$PSFͷݟੵΓπʔϧ wެࣜͰݟੵΓπʔϧʢΤΫηϧʣ͕ఏڙ https://aws.amazon.com/jp/iot-core/pricing/

Slide 21

Slide 21 text

ΞʔΩςΫνϟͷઆ໌

Slide 22

Slide 22 text

ΞʔΩςΫνϟͷུ֓ਤͷઆ໌ AWS IoT Core IoT thing Lambda IoT rule Kinesis Data Streams DynamoDB Kinesis Data Firehose Amazon S3 Lambda DynamoDB IoT rule IoT rule Amazon Athena ొ࿥ॲཧ Πϕϯτอଘ ϩάอଘ σόΠεɿՈͷதʹ͋Γෳ਺ͷσόΠε͕ͭͳ͕ΔϋϒσόΠε ϓϩτίϧɿHTTPS HTTP  protocol γεςϜɿσʔλΛ஝ੵ͢ΔγεςϜ

Slide 23

Slide 23 text

Τϥʔ͔ΒֶΜͩ5ͭͷ͜ͱ

Slide 24

Slide 24 text

Τϥʔ͔ΒֶΜͩͭͷ͜ͱ w"1*͕ඇಉظλΠϓ͔ಉظλΠϓ͔ҙࣝ w4%,ʹ͓͚ΔλΠϜΞ΢τ஋ɺϦτϥΠઃఆΛ๨Εͣઃఆ w,JOFTJT-BNCEBͷϦτϥΠํ๏ʹ͍ͭͯཧղ w-BNCEBΤϥʔ࣌௨஌͢Δ࢓૊Έͱ93BZΛಋೖ͓ͯ͘͠ w"84αϙʔτʹ໰͍߹ΘͤͰ͖Δ؀ڥΛ੔͓͑ͯ͘

Slide 25

Slide 25 text

ͲΜͳΤϥʔʹૺ۰͔ͨ͠

Slide 26

Slide 26 text

Slide 27

Slide 27 text

ૺ۰ͨ͠৔໘ σόΠεاۀ ʮAPIίʔϧͯ͠΋Τϥʔ͕ ฦͬͯ͘Δͱ͖͕͋Δʯ

Slide 28

Slide 28 text

ݪҼ AWS IoTͷAPI͸ ඇಉظॲཧͷͨΊ ޙଓͷॲཧ͕׬ྃ͢Δલʹ ࣍ͷϦΫΤετ͕དྷ͍ͯͨ

Slide 29

Slide 29 text

w͜ͷॲཧͷޙ͸ɺ͜ͷॲཧͱ͍͏࿈ଓతͳϦΫΤετ ϦΫΤετ಺༰ IoT hardware AWS IoT Core DynamoDB Lambda API Gateway ᶄϨεϙϯε 200ok ᶃϦΫΤετ ᶅ࣮ߦϦΫΤετ ᶆॲཧ࣮ߦத ᶇϦιʔεऔಘϦΫΤετ ᶈॲཧະ׬ྃͷͨΊΤϥʔ

Slide 30

Slide 30 text

ରࡦ wγʔέϯγϟϧͳॲཧͷͱ͖ൃੜ w"84*P5͔Β0,͕ฦ͖ͬͯͯ΋ɺ"84*P5ʹඥͮ͘ -BNCEBͷॲཧ͕׬͍ྃͯ͠Δͱ͸ݶΒͳ͍ wޙଓͷॲཧ͕ΤϥʔͱͳΔ͜ͱ͕͋Δ σόΠεଆͰϦτϥΠॲཧΛೖΕ͓ͯ͘͜ͱ

Slide 31

Slide 31 text

wσόΠεଆ͕ϦτϥΠॲཧΛೖΕͯ΋Β͏ ରࡦ IoT hardware AWS IoT Core DynamoDB Lambda API Gateway ᶄϨεϙϯε 200ok ᶃϦΫΤετ ᶅ࣮ߦϦΫΤετ ᶆॲཧ࣮ߦத ᶇϦιʔεऔಘϦΫΤετ ᶈॲཧະ׬ྃͷͨΊΤϥʔ ᶉϦτϥΠ

Slide 32

Slide 32 text

Slide 33

Slide 33 text

ૺ۰ͨ͠৔໘ كʹLambda͕λΠϜΞ΢τ͢Δ

Slide 34

Slide 34 text

ͲΜͳݱ৅͔ w௨ৗ਺ඵͰऴΘΔॲཧ͕ɺ͋Δͱ͖ҟৗʹॲཧ͕͔͔࣌ؒΓ λΠϜΞ΢τΤϥʔ͢Δͱ͖͕͋Δ wස౓͸ҰिؒʹҰճ͋Δ͔ͳ͍͔ w-BNCEBͰઃఆͰ͖ΔλΠϜΞ΢τ஋͸໰୊ͳ͍

Slide 35

Slide 35 text

ݪҼ Lambda͔ΒผAWSαʔϏεʹ ௨৴͢Δͱ͖ͷωοτϫʔΫΤϥʔ

Slide 36

Slide 36 text

wΤϥʔͰ઀ଓཱ͕֬Ͱ͖ͣɺॲཧ͕ਐ·ͣλΠϜΞ΢τ w93BZʹΑΔՄࢹԽʹΑͬͯݪҼಛఆ ݪҼ DynamoDB Lambda ωοτϫʔΫΤϥʔ

Slide 37

Slide 37 text

ରࡦ w"844%,ʹ͸λΠϜΞ΢τ஋ͱϦτϥΠճ਺͕ઃఆͰ͖Δ wͦΕͧΕॳظ஋͕ઃఆ͞Ε͍ͯΔ AWS SDK ࠷େࢼߦճ਺ ઀ଓλΠϜΞ΢τ ιέοτλΠϜΞ΢τ Python(Boto3) αʔϏεʹΑΓҟͳΔ 60ඵ 60ඵ JavaScript/Node.js αʔϏεʹΑΓҟͳΔ ֘౰ͳ͠ 120ඵ Java 3 10ඵ 50ඵ .NET 4 100ඵ 300ඵ Go 3 ֘౰ͳ͠ ֘౰ͳ͠ https://aws.amazon.com/jp/premiumsupport/knowledge-center/lambda-function-retry-timeout-sdk/ λΠϜΞ΢τ஋Λมߋ͠ద੾ʹϦτϥΠ͞ΕΔΑ͏ʹઃఆมߋ

Slide 38

Slide 38 text

CPUPͷઃఆྫ wDPOOFDU@UJNFPVU઀ଓΛཱ֬͢Δ·Ͱͷ଴ػ࣌ؒ wSFBE@UJNFPVUཱ֬ͨ͠઀ଓ͔ΒϨεϙϯε·Ͱͷ଴ػ࣌ؒ wNBY@BUUFNQUTϦτϥΠճ਺ import boto3 from botocore.config import Config config = Config(connect_timeout=5, read_timeout=5, retries={'max_attempts': 10}) DYNAMODB = boto3.resource('dynamodb', config=config) ઃఆྫʣ઀ଓλΠϜΞ΢τɺιέοτλΠϜΞ΢τɿ5ඵɹϦτϥΠճ਺ɿ10ճ

Slide 39

Slide 39 text

Slide 40

Slide 40 text

ૺ۰ͨ͠৔໘ Τϥʔͨ͠Lambda͕ ͣͬͱϦτϥΠ͠ଓ͚Δ

Slide 41

Slide 41 text

ঢ়گ w,JOFTJT%BUB4USFBNTͱ-BNCEB͕࿈ܞͨ͠ߏ੒ wଞ͸Τϥʔ͕ൃੜͯ͠΋ͣͬͱϦτϥΠ͢Δ͜ͱ͸ͳ͍ w,JOFTJT಺ͷଞͷσʔλ͸ॲཧ͞ΕͣΩϡʔʹͨ·Γଓ͚Δ Kinesis Data Streams AWS IoT Core DynamoDB IoT hardware Lambda

Slide 42

Slide 42 text

ݪҼ ετϦʔϜϕʔεͷΠϕϯτιʔεͷͱ͖ LambdaͷϦτϥΠ͸ σʔλͷ༗ޮظݶ͕੾ΕΔ·Ͱ ܁Γฦ͢࢓༷ͷͨΊ

Slide 43

Slide 43 text

-BNCEBͷಛੑ Lambdaʹ͸ෳ਺ͷݺͼग़͠λΠϓ͕͋Δ

Slide 44

Slide 44 text

-BNCEBͷݺͼग़͠ w-BNCEB͸τϦΨʔʹΑͬͯݺͼग़͠λΠϓ͕ҟͳΔ wλΠϓ wಉظݺͼग़͠ɿ"1*( σϑΥϧτಈ࡞ ɺ4%,ͳͲ͔Β-BNCEBىಈ wετϦʔϜɿ,JOFTJT%BUB4USFBNT %ZOBNP%#4USFBNT wϙʔϦϯάɿ424 wඇಉظݺͼग़͠ɿ4ɺ4/4ɺ$8ͳͲɻϦτϥΠ͸ࣗಈతʹճɺ஗Ԇ͋Γ wݺͼग़͠λΠϓʹΑͬͯϦτϥΠͷ࢓ํ΋ҟͳΔ

Slide 45

Slide 45 text

ಉظݺͼग़͠ʢετϦʔϜʣͷϦτϥΠͷڍಈ wσʔλͷ༗ޮظݶ͕੾ΕΔ·ͰϦτϥΠ wϦΫΤετͷॱংΛ୲อ͢Δ࢓૊ΈΛ΋ͭͨΊ wࣦഊͨ͠ॲཧ͕੒ޭ͢Δ·Ͱ৽͍͠ϨίʔυͷಡΈࠐΈ͕ɹ ϒϩοΫ͞ΕΔ w,JOFTJT%BUB4USFBNTɿσϑΥϧτ࣌ؒɺ࠷େ೔ w%ZOBNP%#ɿ࣌ؒ

Slide 46

Slide 46 text

ରࡦ ႈ౳ੑΛߟྀͨ͠ίʔυʹमਖ਼

Slide 47

Slide 47 text

Slide 48

Slide 48 text

ૺ۰ͨ͠৔໘ αʔόʔϨεͳγεςϜͰΤϥʔ͕ ൃੜͨ͠ͱ͖ͷݪҼಛఆ͕େม

Slide 49

Slide 49 text

ΤϥʔͷݪҼಛఆ͸େม wෳ਺ͷ-BNCEB͕͋Δͱɺ͍ͭɺͲ͜Ͱҟৗ͕ى͖͍ͯΔ͔ൃݟ͕େม wݕ஌͢Δ࢓૊Έ͸αʔυύʔςΟαʔϏεΛ࢖Θͳͯ͘΋ɹɹɹɹɹɹ $MPVE8BUDIͰ͋Δఔ౓͸ΧόʔՄೳ wڽͬͨ͜ͱΛ͢Δͱ-BNCEBΛ࢖͏ඞཁ͕Ͱͯ͘Δ CloudWatch Alarmͷઃఆͱ CloudWatchͰఏڙ͞ΕΔμογϡϘʔυͰ࠷௿ݶͷ͜ͱ͸Ͱ͖Δ

Slide 50

Slide 50 text

-BNCEBΤϥʔΛ௨஌͢Δ࢓૊Έ Lambda͕Τϥʔͨ͠Β௨஌͕ඈͿΑ͏ʹΞϥʔϜ࡞੒Ͱ͖Δ ΞΧ΢ϯτϨϕϧͰͷΤϥʔঢ়گ͕Θ͔ΔμογϡϘʔυ͕ఏڙ͞Ε͍ͯΔ

Slide 51

Slide 51 text

ศརͳμογϡϘʔυ͕ఏڙ͞Ε͍ͯΔ γεςϜʹҟৗ͕͋ͬͨͱ͖ɺίίΛݟΔͱྑͦ͞͏

Slide 52

Slide 52 text

Τϥʔͨ͠-BNCEBΛಛఆͨ͠ޙͷमਖ਼΋େม w-BNCEB͸ෳ਺"84αʔϏεͱ࿈ܞ͢Δ͜ͱ͕ଟ͘ɺ Ͳ͜ͷॲཧΛमਖ਼ͨ͠Βྑ͍͔ͷΘ͔Βͳ͘ͳΔ w93BZͳͲͷ಺෦ͷॲཧΛՄࢹԽ͢ΔτϨʔγϯάαʔϏε Λಋೖ͓ͯ͘͠ AWS X-Ray

Slide 53

Slide 53 text

93BZΛಋೖ͢ΔϝϦοτ w-BNCEB಺෦ͷॲཧΛՄࢹԽͯ͘͠ΕΔ wͲ͜ͷॲཧʹ໰୊͕͋Δ͔ͷमਖ਼Օॴͷख͕͔͔Γʹ

Slide 54

Slide 54 text

Slide 55

Slide 55 text

ૺ۰ͨ͠৔໘ ϚωʔδυαʔϏεͷ ࢓༷ͷ೺Ѳ͕େม

Slide 56

Slide 56 text

࢓༷ͷ೺Ѳ͸ࠔ೉ wϩδοΫҎ֎ͷΤϥʔͷݪҼ͸αʔϏε࢓༷ͷߟྀ࿙Ε͕େ൒ wυΩϡϝϯτ͸ॆ࣮͍ͯ͠Δ͕ɺ๲େͰ͢΂ͯΛ೺Ѳ͢Δͷ͸ࠔ೉ w"84͸೔ʑΞοϓσʔτ͞Ε͍ͯΔ wαʔϏε಺෦ͷॲཧ͕มΘͬͨӨڹ΋͋Δ w-BNCEBͷ࣮૷͕ѱ͍ͷ͔ɺαʔϏε࢓༷ͳͷ͔Λ੾Γ෼͚Δ͜ͱ͕ॏཁ ϚωʔδυαʔϏεΛ׆༻ͨ͠γεςϜΛӡ༻͢Δࡍ͸ AWSαϙʔτ͸ඞਢ

Slide 57

Slide 57 text

"84αϙʔτ w໰͍߹Θͤ͢Δʹ͸༗ྉϓϥϯΛબ୒͢Δඞཁ͕͋Δ w"84ͷύʔτφʔاۀͷαʔϏεΛ͏·͘׆༻͠અ໿͠Α͏ AWSΤϯλʔϓϥΠζ૬౰ͷAWSαϙʔτΛແྉఏڙ AWSར༻අҰ཯5%OFF

Slide 58

Slide 58 text

·ͱΊ

Slide 59

Slide 59 text

*P5αʔόʔϨεͰؾΛ͚ͭΔ͜ͱ w"1*͕ඇಉظλΠϓ͔ಉظλΠϓ͔ҙࣝ w4%,ʹ͓͚ΔλΠϜΞ΢τ஋ɺϦτϥΠઃఆΛ๨Εͣઃఆ w,JOFTJT-BNCEBͷϦτϥΠํ๏ʹ͍ͭͯཧղ w-BNCEBΤϥʔ࣌௨஌͢Δ࢓૊Έͱ93BZΛಋೖ͓ͯ͘͠ w"84αϙʔτʹ໰͍߹ΘͤͰ͖Δ؀ڥΛ੔͓͑ͯ͘

Slide 60

Slide 60 text

No content