Slide 1
Slide 1 text
Copyright (C) DeNA Co.,Ltd. All Rights Reserved.
Hiroyoshi HOUCHI
Office of Technology Development
System Management Unit
DeNA Co., Ltd.
*54Λࢧ͑Δ
ใूج൫
ΞʔΩςΫνϟ
*545FDI4UVEZ"84*P5
1
Slide 2
Slide 2 text
Copyright (C) DeNA Co.,Ltd. All Rights Reserved.
ࣗݾհ
์Ղ !IJYJ@IZJ
w ݄dݱΦʔϓϯϓϥοτϑΥʔϜγεςϜࣄۀ෦
4PDJBM"1* ։ൃ
͚ࣾ.PCJMF#BB4 ։ൃϦʔμ
ڠۀҊ݅ ։ൃΠϯϑϥ
"OE"QQ ΫϥυΞʔΩςΫνϟઃܭ
w ݄dΦʔτϞʔςΟϒࣄۀຊ෦
ΫϥυγεςϜΞʔΩςΫτɾڞ௨ج൫
w ݄dγεςϜຊ෦
શࣾԣஅΫϥυγεςϜΞʔΩςΫτ ΛΔͭΓ
ΦʔτϞʔςΟϒҾ͖ଓ͖
2
Slide 3
Slide 3 text
Copyright (C) DeNA Co.,Ltd. All Rights Reserved.
ຊͷൃද༰
3
Slide 4
Slide 4 text
Copyright (C) DeNA Co.,Ltd. All Rights Reserved.
*54Λࢧ͑Δใूج൫ΞʔΩςΫνϟ
⁃ ं྆ొػೳ
⁃ ं྆ɾαʔόʹର͢ΔೝূೝՄ
⁃ ใͷऩू
⁃ ं྆ͦͷͷͷใͷऩू
⁃ ΤοδίϯϐϡʔςΟϯάͷੳใͷऩू
⁃ ं྆ใͷఏڙ
⁃ ं྆ใͷϦΞϧλΠϜऔಘػೳͷఏڙ
⁃ δΦؔΛ༻͍ͨं྆ใͷఏڙ
⁃ ੳγεςϜͷใఏڙ
4
Slide 5
Slide 5 text
Copyright (C) DeNA Co.,Ltd. All Rights Reserved.
*54Λࢧ͑Δใूج൫ΞʔΩςΫνϟ
⁃ ं྆ొػೳ
⁃ ं྆ɾαʔόʹର͢ΔೝূೝՄ
⁃ ใͷऩू
⁃ ं྆ͦͷͷͷใͷऩू
⁃ ΤοδίϯϐϡʔςΟϯάͷੳใͷऩू
⁃ ं྆ใͷఏڙ
⁃ ं྆ใͷϦΞϧλΠϜऔಘػೳͷఏڙ
⁃ δΦؔΛ༻͍ͨं྆ใͷఏڙ
⁃ ੳγεςϜͷใఏڙ
5
Slide 6
Slide 6 text
Copyright (C) DeNA Co.,Ltd. All Rights Reserved.
ࢀߟࢿྉ
λΫϕϧʹ͍ͭͯ
⁃ AWS Summit 2018 Tokyo - DeNA ΦʔτϞʔςΟϒʹ͓͚Δ AWS ׆༻ࣄྫ
ٕज़෦ʹ͍ͭͯ
⁃ DeNA TechCon 2018 – AWS IoTΛ༻͍ͨDeNAΦʔτϞʔςΟϒΞʔΩςΫ
νϟ
ݕࡧΩʔϫʔυʮ AWS IoT DeNA ʯ(ൃද Google ݕࡧ࣌)
6
Slide 7
Slide 7 text
Copyright (C) DeNA Co.,Ltd. All Rights Reserved.
ൃද෦ͷΞʔΩςΫνϟਤ
7
3. ੳใऩू
2. ं྆ใऩू
1. ੳγεςϜ౷߹
Slide 8
Slide 8 text
Copyright (C) DeNA Co.,Ltd. All Rights Reserved.
1. ੳγεςϜ౷߹
8
8
Slide 9
Slide 9 text
Copyright (C) DeNA Co.,Ltd. All Rights Reserved.
1. ੳγεςϜ౷߹
9
{
"topic": "pub/sub topic",
"data": {
"hoge": "fuga"
}
}
※ format ʹ͍ͭͯগ͠ lambda Ͱٵऩͯ͠Δ෦͋Γ
Slide 10
Slide 10 text
Copyright (C) DeNA Co.,Ltd. All Rights Reserved.
1. ੳγεςϜ౷߹
10
• όοϑΝϦϯά͞ΕͨใΛ Lambda Ͱऔಘ
• σʔλϑϩʔ্ Kinesis Data Streams → Lambda
࣮ࡍ Lambda → Kinesis Data Streams
Slide 11
Slide 11 text
Copyright (C) DeNA Co.,Ltd. All Rights Reserved.
1. ੳγεςϜ౷߹
11
• topic Ͱάϧʔϐϯά
• Cloud Pub/Sub
·ͱΊͯˍฒྻ Publish
[
{
"topic": "pub/sub topic",
"data": {
"hoge": "fuga"
}
},
……
]
Slide 12
Slide 12 text
Copyright (C) DeNA Co.,Ltd. All Rights Reserved.
1. ੳγεςϜ౷߹෦ʹ͍ͭͯ
•
• جຊతʹ Network ͷ४උ + I/O ͕࣌ؒͱ͔͔ͯΔ෦
• ୯ൃ࣮ߦͰͳͯ͘ɺόοϑΝϦϯά͢Δ͜ͱʹΑͬͯ Lambda ͷ࣮ߦճ +
૯࣮ߦ࣌ؒΛେ෯ʹݮΒ͢͜ͱ(=ίετݮ)͕Ͱ͖Δ (※ ं྆ rps͙Β͍͘Δ )
• ΄΅΄΅ϦΞϧλΠϜʹใΛૹΔ͜ͱ͕Ͱ͖Δ
• ߟྀ
• Kinesis Data Streams ͷγϟʔυ
• ผख๏
• ϦΞϧλΠϜੑΛ͏গ͠ଛͳ͍͍ͬͯͷͰ͋Ε S3 Λ༻͍ͭͭɺ
ఆظతʹ GCS ʹૹ৴͢Δ͜ͱՄ
• ͦ͏ͨ͠߹ɺͬͱίετΛݮΒ͢͜ͱ͕Ͱ͖Δ
12
Slide 13
Slide 13 text
Copyright (C) DeNA Co.,Ltd. All Rights Reserved.
2. ं྆ใऩू
13
Slide 14
Slide 14 text
Copyright (C) DeNA Co.,Ltd. All Rights Reserved.
ͷલͷɺࣄલใ…
• ं͔྆Βͷૹ৴ϑΥʔϚοτ bson (TechCon #33)
• ࣄલʹߦ͏ं྆ొ(TechCon #25)ʹΑΓҎԼͷΑ͏ʹͳΔ
• ThingName ূ໌ॻID
• ThingShadow ʹҎԼͷใؚ͕·Ε͍ͯΔ (TechCon #29)
14
\
TUBUF\
SFQPSUFE\
EFWJDF\
!JE999999
^
^
^
^
Slide 15
Slide 15 text
Copyright (C) DeNA Co.,Ltd. All Rights Reserved.
2. ं྆ใऩू
15
Slide 16
Slide 16 text
Copyright (C) DeNA Co.,Ltd. All Rights Reserved.
2. ं྆ใऩू
16
Topic p/@s.b
(providers/taxibell/@status.bson)
Payload ҎԼͷΑ͏ͳ json ͷ bson දݱ
{"@pos": { "lat": "35.4429108606794", "lon":
"139.642686919283" }, "@pos_ts": "1528437407",
"@ts": "1528437407"}
Slide 17
Slide 17 text
Copyright (C) DeNA Co.,Ltd. All Rights Reserved.
2. ं྆ใऩू
17
SQL SELECT aws_lambda(“${bson2json lambda arn}”,
{ “bson”: encode(*, “base64”)) as
state.reported.status FROM p/@s.b
Action ҎԼͷ Republish
$$aws/things/${principal()}/shadow/update
Slide 18
Slide 18 text
Copyright (C) DeNA Co.,Ltd. All Rights Reserved.
2. ं྆ใऩू
18
ݩͷσʔλ { "state": { "reported": { "device": { "@id": "XXXXXX" } }, "status":
{"hoge":"fuga" } }
ೖྗσʔλ { "state": { "reported": { "status": { "@pos": { "lat":
"35.4429108606794", "lon": "139.642686919283" }, "@pos_ts":
"1528437407", "@ts": "1528437407" } }
݁Ռσʔλ { "state": { "reported": { "device": { "@id": "XXXXXX" }, "status": {
"@pos": { "lat": "35.4429108606794", "lon":
"139.642686919283" }, "@pos_ts": "1528437407", "@ts":
“1528437407”, “hoge”: “fuga” } }
Slide 19
Slide 19 text
Copyright (C) DeNA Co.,Ltd. All Rights Reserved.
2. ं྆ใऩू
19
Topic $aws/things/+/shadow/update/documents
Payload { "current": { "state": { "reported": { "device": { "@id":
"XXXXXX" }, "status": { "@pos": { "lat": "35.4429108606794",
"lon": "139.642686919283" }, "@pos_ts": "1528437407", "@ts":
"1528437407", "hoge":"fuga" } } , "desired": {} } }, "previous":
{ུ} }
Slide 20
Slide 20 text
Copyright (C) DeNA Co.,Ltd. All Rights Reserved.
2. ं྆ใऩू
20
SQL SELECT {'data': {'device': current.state.reported.device,
'reported': current.state.reported.status}, 'topic': ‘${topicname}'}
FROM '$aws/things/+/shadow/update/documents'
Action Kinesis
Slide 21
Slide 21 text
Copyright (C) DeNA Co.,Ltd. All Rights Reserved.
2. ं྆ใऩू෦ʹ͍ͭͯ
•
• ใͷ౷߹
• ThingShadow ͷػೳΛ༗ޮ׆༻͢Δ͜ͱͰɺ͚ࠩͩͰͳ͘ɺͦͷ࣌ͷं྆
ͷͯ͢ͷঢ়ଶΛ͢͜ͱ͕Մೳ
• ΫϥΠΞϯτ͚ࠩͩͳͷͰ௨৴ྔతʹ༏͍͠
• ੳڥʹͯใͷิ͕ඞཁͳ͘ͳΔ
• ඞཁͳ෦ͷΈͷ Lambda ʹ͑Δ
• Lambda Ͱ ThingShadow ͷߋ৽·Ͱ͢Δ͜ͱՄೳ
• ҰํͰ ThingShadow ͷؾͰ࣮ߦ͕࣌ؒ૿͑ͯ͠·͏ʹίετ͕૿Ճ͢ΔՄೳ
ੑ͕͋Δ
21
Slide 22
Slide 22 text
Copyright (C) DeNA Co.,Ltd. All Rights Reserved.
3. ੳใऩू
22
Slide 23
Slide 23 text
Copyright (C) DeNA Co.,Ltd. All Rights Reserved.
3. ੳใऩू
23
Topic p/@a.b
(providers/taxibell/@analytics.bson)
Payload ҎԼͷΑ͏ͳ json ͷ bson දݱ
{ "@t": "${ࣝผࢠ}", "@d" { "accuracy": "100",
"raw": { "hoge": "huga" }, "res": { "hoge": "huga" } } }
※ ͜͜Ͱͷ @t type ͷུ
Slide 24
Slide 24 text
Copyright (C) DeNA Co.,Ltd. All Rights Reserved.
3. ੳใऩू
24
SQL SELECT “${topicname} as topic, aws_lambda(“${bson2json
lambda arn}”, { “bson”: encode(*, “base64”)) as data,
get_thing_shadow(principal(), “${role arn}”) as thing FROM p/
@a.b
Action Kinesis
Slide 25
Slide 25 text
Copyright (C) DeNA Co.,Ltd. All Rights Reserved.
3. ੳใऩूʹ͍ͭͯ
•
• ใͷิ
• ୯७ͳੳͷΈͰͳ͘ɺݱࡏͷं྆ͷใؚΊͯૹ৴
• ੳڥʹͯใͷิ͕ඞཁͳ͘ͳΔ
• ඞཁͳ෦ͷΈͷ Lambda
• Thing Shadow ͷऔಘͰ͢Β SQL
25
Slide 26
Slide 26 text
Copyright (C) DeNA Co.,Ltd. All Rights Reserved.
• Ͱ͖ΔݶΓϚωʔδϝϯτػೳΛ͏
• Lambda Ϛωʔδϝϯτ͕ͩɺͬͱ͍͍ͷͬͱ͋Δ
• ཪଆͰಈ͍͍ͯΔ༷ʑͳγεςϜΛ༗ޮ׆༻͢Δ
• ThingShadow ͕ߋ৽͞Εͨͱ͖ʹ৭ʑ Publish ͞ΕΔɻ
• ࠓճ update/documents ͷΈ. update/delta ৭ʑເ͕͕Δ
• ৽͍͠ػೳϝϦοτΛߟ͑ͯ͏
• SQL ͷؔͷҰͭͰ͋Δ aws_lambda ൺֱత৽͍͠ػೳɻ
• අ༻ݮʹେ͍ʹཱͬͯ͘ΕͯΔ (͡Ί͍Βͳ͍ͳʔͬͯࢥͬͯͨ)
26
Slide 27
Slide 27 text
Copyright (C) DeNA Co.,Ltd. All Rights Reserved.
ຊεϥΠυ
• ใूج൫γεςϜͷ
ใΛੳ͢Δ·Ͱͷ෦ͷൃදΛ͖ͤͯ͞·ͨ͠
• ͦͷଞ෦ʹڵຯ͋Γ·ͨ͠ΒҎԼΛࢀর͍ͩ͘͞
⁃ AWS Summit 2018 Tokyo - DeNA ΦʔτϞʔςΟϒʹ͓͚Δ AWS ׆༻ࣄྫ
⁃ DeNA TechCon 2018 – AWS IoTΛ༻͍ͨDeNAΦʔτϞʔςΟϒΞʔΩςΫ
νϟ
⁃ ݕࡧΩʔϫʔυʮAWS IoT DeNAʯ
※ ΞʔΩςΫνϟͷதʑਐԽ͓ͯ͠Γ·͢
27
Slide 28
Slide 28 text
Copyright (C) DeNA Co.,Ltd. All Rights Reserved.
Appendix. ࣦഊஊ
28
Slide 29
Slide 29 text
Copyright (C) DeNA Co.,Ltd. All Rights Reserved.
Appendix. ੲͷࣦഊ (1)
• Lambda ͍·͘Γ
• ੲ౷ҰԽΛؾʹͯ͠ɺશ෦ Lambda ͰॲཧΛͯͨ͠
• ं͔྆Βͷೖྗ͕ ઍ rps.
• தΛશ෦ lambda ʹ͢ΔͱඵؒສϨϕϧͷlambda͕࣮ߦ͞Ε͍ͯͨɻ
• ߴ͍ɻ
29
Slide 30
Slide 30 text
Copyright (C) DeNA Co.,Ltd. All Rights Reserved.
Appendix. ੲͷࣦഊ (2)
• ThingShadow ͷ index ͍·͘Γ
• ݕࡧͰ͖Δͷඇৗʹศརͩͬͨ (͜ͷ݅ͷं͚ͩநग़͍ͨ͠ͱ͔)
• ઍ rps ͷ index ͷߋ৽͕͔͔Δ
• ߴ͍ɻ
• ͘ͳΔʢͣʣ
30
Slide 31
Slide 31 text
Copyright (C) DeNA Co.,Ltd. All Rights Reserved.
Appendix. ੲͷࣦഊ (3)
• Admin API (ཧܥͷAPI) ͍·͘Γ
• εϧʔϓοτΛٻΊͨ API ͡Όͳ͍ͷʹɺઍ rps Ͱόϯόϯୟ͍ͯ·ͨ͠
• έʔε͕࡞͞ΕΔͱ͍͏ܦݧΛ͠·ͨ͠
31