20 minutes DeepLearning

re:Port 2016 での登壇資料です。

Transcript

1. 20 ෼ͰΘ͔Δ DeepLearning AWS re:Invent ೺ѲͷҰॿʹ re:Port 2016 @ 2016.12.07
2. தؙ ྑ @pottava SUPINF Inc.
3. ૣ଎Ͱ͕͢ΫΠζͰ͢
4. re:Invent 2016 ϒϨΠΫΞ΢τηογϣϯ਺͸ʁ
5. 393 ʢAWS re:Invent2016ʲอଘ൛ʳશηογϣϯΛ໢ཏʂඇެࣜ·ͱΊ #reinvent ʛ Developers.IOʣ
6. re:Invent 2015, 2014 ϒϨΠΫΞ΢τηογϣϯ਺͸ʁ
7. 298, 214 ʢAWS re:Invent2015ʲอଘ൛ʳશηογϣϯΛ໢ཏʂඇެࣜ·ͱΊ #reinvent ʛ Developers.IOʣ ʢ2014೥౓͸ฐࣾͷϒϩάΑΓงғؾͰूܭʣ
8. Ͱ͸
9. re:Invent 2017 ϒϨΠΫΞ΢τηογϣϯ਺͸ʁ
10. 214 → 298 → 393 → ?
11. ͜ΕΛػցʹ༧ଌͤ͞Δ ͦͷϓϩηε͕ػցֶश
12. ͜ΕΛػցʹ༧ଌͤ͞Δ ͦͷϓϩηε͕ػցֶश
13. ຊ୊
14. 20 ෼ͰΘ͔Δ DeepLearning
15. 20 ෼ͰΘ͔Δ DeepLearning ͞ΘΓ͕
16. ΰʔϧ ɾձࣾʹ re:Invent ͷ͔͍͍ͬ͜ϨϙʔτΛग़ͤΔ ɾࠓճͷ Deep Learning ܥαʔϏεͳΒԶʹฉ͚ ɾࣾ௕ɺ࣌୅͸ AI ͢Α
17. ΰʔϧ ɾձࣾʹ re:Invent ͷ͔͍͍ͬ͜ϨϙʔτΛग़ͤΔ ɾࠓճͷ Deep Learning ܥαʔϏεͳΒԶʹฉ͚ ɾࣾ௕ɺ࣌୅͸ AI ͢Α ɹ΄Μͱʹݴ͏ͱΠλ͍
18. ࠓ೔ͷྲྀΕ 1. Deep Learning ͬͯͳΜͳͷʁ 2. ͦͷ্Ͱ AWS ͷൃදͬͯͲ͏ͩͬͨͷʁ
19. Deep Learning ͱ͸
20. ͷ·͑ʹ
21. Machine Learning ͱ͸
22. ػցֶशͷେલఏ ػցֶशʹ͸ 2 ͭͷϑΣʔζ͕͋Γ·͢ɻ ͦΕ͸ ֶशɹͱɹ ਪ࿦
23. ֶशͱ͸ ΑΓ͏·͘໰୊ʹରॲͰ͖ΔΑ͏ʹͳΔաఔͷ͜ͱɻ
24. ͡Ό͋ਪ࿦͸ʁ ֶΜͩ͜ͱΛ΋ͬͯ໰୊Λղ͘͜ͱɻ
25. ͜Ε͸ֶश
26. ͜Ε͸ਪ࿦
27. ͜Ε͸ֶश
28. ͜Ε͸ਪ࿦ དྷ೥ re:Invent ߦ͖͍ͨΜ͚ͩͲ ձࣾʹԿΛใࠂ͢Δͷ͕ਖ਼ղʁ
29. େࣄͳ͜ͱͳͷͰ΋͏Ұ౓ ػցֶशͷ 2 ͭͷϑΣʔζɿ ֶशɹͱɹ ਪ࿦
30. ͳΔ΄Ͳ
31. ػցֶशʢMachine Learningʣͱ͸ ػցʹֶशͤ͞ɺਪ࿦ͤ͞Δ͜ͱɻ ղ͖͍ͨ໰୊࣍ୈͰɺֶशɾਪ࿦ͷํ๏Λม͑Δɻ ɾճؼ ɾΫϥε෼ྨ ɾΫϥελϦϯά ɾ..
32. Deep Learning ͱ͸
33. DeepLearningͱ͸
34. DeepLearningͱ͸ ͳΔ΄Ͳɺ͸͍͸͍
35. Կ૚΋ͷਂ͍ϨΠϠʔʢχϡʔϥϧωοτϫʔΫʣΛ ࢖ͬͯɺֶशɾਪ࿦͢Δػցֶशͷ͜ͱɻ ϨΠϠʔ͕ਂ͍͔ΒσΟʔϓɻ ೔ຊޠͳΒɺਂ૚ֶशɻਂ͍૚ɻ DeepLearningͱ͸
36. ػցֶशʢMLʣͱਂ૚ֶशʢDLʣ ML DL ɾ౷ܭత෼ੳʢճؼɺΫϥε෼ྨɾɾʣ ɾਐԽతܭࢉ ɾχϡʔϥϧωοτϫʔΫ ɾ… ɾ৞ΈࠐΈχϡʔϥϧωοτϫʔΫʢCNNʣ ɾ࠶ؼܕχϡʔϥϧωοτϫʔΫʢRNNʣ ɾਂ૚ Q ωοτϫʔΫʢDQNʣ ɾ…
37. ɾAlphaGo ɾ?? ɾ?? DeepLearning Կ͕͍͢͝ͷʁ
38. AlphaGo ਓؒͷੈքҰʹίϯϐϡʔλ͕উͬͯ͠·ͬͨɾɾʂ ͍ͭ࠷ۙ·ͰɺAI ͸ع࢜ʹউͯͳ͍ɺͦͯ͠ϒϨΠΫεϧʔʹ͸ 10 ೥଴ͨͶ͹ͳΒͳ͍ͱݴΘΕ͍ͯͨͷʹɺͩɻ
39. ʢ࿦จ: http://www.nature.com/nature/journal/v529/n7587/abs/nature16961.html ʣ • 4ͭͷσΟʔϓχϡʔϥϧωοτϫʔΫΛར༻ • ͦΕͧΕ ॳڃऀpπ / தڃऀpσ / ্ڃऀpρ / ৘੎൑அvθ ͱ͍ͬͨҐஔ෇͚ • pπ ͸ਓؒͷ800ສͷ൫໘σʔλΛݩʹֶशɻਫ਼౓͸௿͍͕ߴ଎ʹղΛಘΔɻ • pσ ͸13૚ͷCNNɻ3,000ສ൫໘Λ50GPUͰ3.4ԯεςοϓɺ3िֶؒशɻϓϩͷࢦ ͠खΛ57.0%ͷਫ਼౓Ͱ༧૝Ͱ͖Δɻ • pρ ͸50GPUͰ1೔͔͚128ສճࣗݾରઓɻطଘιϑτʹ85%ͷѹ౗తউ཰ɻ • vθ ͸ pσ ͰϥϯμϜʹ3,000ສ൫໘Λੜ੒͠ɺpρ Ͱ1ԯ6,000ສճϩʔϧΞ΢τͨ͠ উ཰Λڭࢣσʔλͱ͠ɺ50GPUͰҰिؒ 5,000ສճ֬཰ޯ഑߱Լ๏Λ࣮ࢪɻ • ࣮ରઓͰ͸1,202CPU+176GPU͕࢖ΘΕɺpσͰ࣍ͷखબ୒ɺvθͰ൫໘ධՁɻ • উ཰͸͍͍͕ཧ٧ΊͷpρΑΓɺਓؒͷบΛֶΜͩpσΛ࢖͔ͬͨɻ • উҼ͸ pρ ͷపఈతͳڧԽֶशʹՃ͑ɺϞϯςΧϧϩ໦୳ࡧͱCNNͷ૊߹͔ͤɻ AlphaGo
40. ɾAlphaGo ɾAmazon Go ɾ?? DeepLearning Կ͕͍͢͝ͷʁ
41. Amazon Go 1. ೖళ࣌ɺήʔτʹεϚϗΞϓϦΛ͔͟͢ 2. ΄͍͠΋ͷΛόοάʹೖΕΔ 3. ͓ళΛग़Δ Coming early 2017 !! 2131 7th Ave Seattle, Washington
42. Amazon Go
43. Amazon Go ళ಄Ͱ͸ɺਪ࿦͑͞ಈ͚͹͍͍ɻ ͍΍ɺͦΜͳ͜ͱΑΓ ͏ͪͷళฮʹ΋͜Εಋೖͯ͠Έ͍ͨΜͰ͚͢Ͳɾɾʂ
44. OK
45. ਂ૚ֶशϕʔεͷը૾ೝࣝ APIɻ ɾҰൠ෺ମ / ৘ܠݕग़ ɾද৘෼ੳ ɾإͷྨࣅ౓൑ఆ
46. Amazon Rekognition ଞࣾͰ΋੝Μͳ Computer vision API ͷҰछɻ
47. Amazon Rekognition ฐࣾ༐ऀͷ ྨࣅ౓൑ఆɻ
48. ଓ͖·ͯ͠
49. ɾAlphaGo ɾAmazon Go ɾAmazon Echo DeepLearning Կ͕͍͢͝ͷʁ
50. Amazon Echo Alexa ʹԻ੠Ͱ͓ئ͍ɾ࣭໰͢ΔͨΊͷσόΠεɻ ʢAlexa ͸ Amazon ͕։ൃͨ͠ AI ʣ ʮΞϨΫαɺిؾΛ͚ͭͯɺԻָ΋͔͚ͯʯ ʮΞϨΫαɺUber ΛݺΜͰɻࠓ೔ͷఱؾ͸ʁ ʯ
51. Amazon Echo
52. Amazon Echo 1. Ի੠Λฉ͖औΓ 2. ԿΒ͔ͷॲཧΛͯ͠ 3. Ի੠Λฦ͢
53. Amazon Echo ɾӡసதͷϋϯζϑϦʔΞϓϦ࡞Γ͍ͨ ɾԻ੠ग़ྗɺTwillio ʹ࢖͑ͦ͏ͳ ɾ..
54. OK
55. Amazon Polly ςΩετΛԻ੠ʹม׵͢Δ APIɻ ɾAlexa ͷԠ౴ػೳʮग़ൃ͸͍ͭͰ͔͢ʁʯ ɾ೔ຊޠʹ΋ରԠͯ͠Δʂ ɾXML Ͱ౉ͤ͹Ի੠ͷΧελϚΠζ΋͔ΜͨΜ
56. Amazon Lex ର࿩ΠϯλʔϑΣΠε + ࣗવݴޠղੳ APIɻ ɾϢʔβͱର࿩͠ͳ͕Β࣍ͷॲཧΛ൑அ ɾ࢒೦ͳ͕ΒɺݱࡏӳޠͷΈͷରԠ
57. Amazon Echo 1. Ի੠Λฉ͖औΓ 2. ԿΒ͔ͷॲཧΛͯ͠ 3. Ի੠Λฦ͢ Amazon Lex Amazon Polly
58. ͪͳΈʹଞࣾͷঢ়گ
59. ɾVision API ɹը૾ೝࣝ APIɻ෺ମ / จࣈ / إ / ϩΰ / ϥϯυϚʔΫͷݕ஌ɻ ɾSpeech API ɹಉࣾͷར༻͢ΔԻ੠ʹΑΔςΩετೖྗΛ REST API Խɻ ɾNatural Language API ɹจষΛॻ͍ͨਓͷҙݟ΍ײ৘ɺݻ༗໊ࢺ΍࣌ؒදݱΛநग़ɻ ɾTranslate API ɹ਺ઍ΋ͷݴޠؒͰϦΞϧλΠϜʹςΩετΛ຋༁ɻ https://cloud.google.com/#products_machine-learning
60. ɾVision ɹը૾ೝࣝɾՃ޻ɺײ৘෼ੳɺإݕग़ɾಉҰ൑ఆɾྨࣅݕࡧɺಈը෼ੳͳͲɻ ɾSpeech ɹจষͱԻ੠ͷ૬ޓม׵ɺԻ੠ʹΑΔϢʔβࣝผɾೝূɻ ɾLanguage ɹݴޠɾτϐοΫɾΩʔϑϨʔζநग़ɺωΨϙδ൑ఆɺεϖϧνΣοΫɺ༧ଌɻ ɾKnowledge ɹ஌ࣝσʔλϕʔεΛ༻͍ͨ෼ੳɺ༧ଌɻ ɾSearch ɹWebɾಈըɾը૾ɾχϡʔεɾؔ࿈ϫʔυͷݕࡧɾऩूͳͲɻ https://azure.microsoft.com/ja-jp/services/cognitive-services/
61. ɾLanguage ɹࣗવݴޠॲཧʹΑΔςΩετղੳɻಛఆ৘ใɾΩʔϫʔυɾίϯηϓτநग़ɺ ɹΧςΰϦ෼ྨɺײ৘෼ੳɺωΨϙδ൑ఆɺެจղੳɾҙຯ෇͚Ԡ౴ɻ ɾSpeech ɹจষͱԻ੠ͷ૬ޓม׵ɻ ɾVision ɹը૾ೝࣝɻ ɾData Insights ɹχϡʔε΍ϒϩάهࣄͷݕࡧɺτϨϯυ෼ੳɻ ɹա৒ͳબ୒ࢶͷআ֎ɺෳ਺ͷໃ६͢ΔΰʔϧΛؚΉΑ͏ͳෳࡶͳܾఆͷ෼ੳɻ https://www.ibm.com/watson/developercloud/services-catalog.html
62. ͳΔ΄ͲͰ͢Ͷɻ
63. ͯ͞ AWS ͷ 3 ͭͷ৽αʔϏε
64. Rekognition / Lex / Polly ͷڞ௨఺ શ෦ɺਪ࿦ API
65. ਪ࿦ͷαʔϏεͱ͍͏͜ͱ͸ ֶश͸ AWS ೚ͤɻ͜Μͳ͜ͱʹ͸޲͍͍ͯͳ͍ ɾࣗࣾͷ঎඼Λը૾ݕग़͢Δ ɾࣗࣾͷΩϟϥΫλʔޠʁΛղऍͤ͞Δ ɾࣗࣾήʔϜ಺ͷຐ๏Λࣗવݴޠղੳͤ͞Δ
66. ͑ʔ
67. ࣗࣾͷ΋ѻ͍͍ͨͳʔ
68. ࢓ํͳ͍ɺֶश͠Α͏
69. Α͠ɺֶशͩ 0. ͦΕɺDeepLearning Ͱղ͘ͷ͕࠷దͳͷʁ 1. σʔλ͕ඞཁɻʢ2016 ೥ݱࡏɺҰൠతʹ͸ʣͨ͘͞Μ 2. ֶशΞϧΰϦζϜͷબ୒ 3. ܭࢉ͠·͘Δίϯϐϡʔλࢿݯ͕ඞཁ
70. Α͠ɺֶशͩ 0. ͦΕɺDL Ͱղ͘ͷ͕࠷దͳͷʁ౷ܭత෼ੳ͸ʁ 1. σʔλ͕ඞཁɻͨ͘͞Μ 2. ֶशΞϧΰϦζϜͷબ୒ 3. ܭࢉ͠·͘Δίϯϐϡʔλࢿݯ͕ඞཁ
71. σʔλΛूΊΑ͏ ʢ͜ͷલʹ͢΂͖ɺେࣄͳॾݕ౼͸ AWS αʔϏεؔ܎ͳ͍ͷͰஔ͍ͱ͍ͯʣ σʔλΛूΊͳ͚Ε͹࢝·Βͳ͍ʂ ɾKinesis Streams ɾCloudWatch Logs ɾS3 / RDS / DynamoDB
72. ڭࢣσʔλΛ࡞Ζ͏ ·ͩಈը / εϥΠυͳ͔͚ͬͨͲɾɾ ϝΧχΧϧλʔΫΛ࢖͏࿩͕͋Γ·ͨ͠ɻ
73. ֶशϑϨʔϜϫʔΫΛબ΅͏ ͲΕ͕͍͍ΜͩΖ͏ɾɾʁ MXNet / TensorFlow / Caffe / Chainerɻ ɾͲͷχϡʔϥϧωοτ࢖͏ͷʁCNNʁRNNʁ ɾGPU ࢖͏ͷʁCPU ͚ͩʁෳ਺ϊʔυల։ඞཁʁ ɾࠃ࢈Ԡԉͪ͠Ό͏ʁ ɾ..
74. AWS ͸ MXNet Ұ୒ͩͦ͏Ͱ͢ ɾ͑ɺAmazon DSSTNE ɾɾ ɾଞͷ΋ͷ΋ݕ౼͍ͨ͠ํ͸ͪ͜Β ɹ re:Invent 2016 Bringing Deep Learning to the Cloud with Amazon EC2 (CMP314)
75. Deep Dive ͍ͨ͠ํ͸
76. ࠓ೔ͷ࿩ΛΑΓਂ͘ɺAI ؔ࿈৘ใ͚ͩͷ 120 ෼ʂʂ http://jawsug-ai.connpass.com/
77. ࠷ޙʹɺֶशΠϯϑϥબఆ
78. DL ޲͚ AWS ϚωʔδυαʔϏε దࡐదॴͰϐλΰϥεΠονɺࠓޙ͋Γ͑Δ ɾGlue ɾEMR ɾECS ɾBatch ɾ.. new! new!
79. ͑ɺAmazon ML ͸ʁ ML DL ͜͜ͷྖҬͰ໰୊Λղ͘ͳΒ΋ͪΖΜ࢖͑·͢ʂ Amazon ML
80. Amazon ECS ɾre:Invent Ͱͷ MXNet ϫʔΫγϣοϓָ͔ͬͨ͠ ɹhttps://github.com/awslabs/ecs-deep-learning-workshop/ ɾECS Ϋϥελ্Ͱ MXNet ͷֶशɾਪ࿦ ɾDocker ίϯςφલఏʹ͸ͳΔ͕ ɾDocker ͸༷ʑϝϦοτ͕͋Γͭͭ ɾίϯςφΫϥελͱͯ͠ಈ͔͢ͳΒ࠷ߴ
81. AWS Batch ɾECS ্ʹ HPC ۀքͷҙຯʹ͍ۙΫϥελΛߏஙɻ ɾδϣϒεέδϡʔϥ ≠ ίϯςφք۾ͷεέδϡʔϥ ɾECS ্ͳͷͰɺίϯςφϕʔε ɾGlue ΍ EFS ͱͷ૊Έ߹Θ͕ͤॏཁͦ͏
82. ECS ͱ Batch ɾֶशϑΣʔζ͸ɺେྔͷσʔλͱେྔͷܭࢉ - EFS / EBS / Batch ͳͲʹΑΔδϣϒ؅ཧ ɾਪ࿦ϑΣʔζ͸ɺେྔͷϦΫΤετΛࡹ͘ - Մ༻ੑߴ͘εέʔϧՄೳͳৗ࣌ىಈ API αʔό - ECS ্ʹαʔϏεσϓϩΠ
83. Deep Dive ͢ΔͳΒ
84. ECS Λத৺ʹɺίϯςφ·ΘΓͷ࠷৽৘ใΛ͓ಧ͚ʂ http://jawsug-container.connpass.com/
85. http://prtimes.jp/main/html/rd/p/000000007.000007768.html Comfy for Docker ϓϩδΣΫτ΁ͷ Docker ಋೖɾ։ൃࢧԉɾӡ༻؂ࢹ୅ߦΛ͍ͨ͠·͢ɻ https://www.supinf.co.jp/service/dockersupport/
86. ͪͳΈʹଞࣾͷঢ়گ
87. GPU Λ࢖ͬͨϑϧϚωʔδυͳ TensorFlowɻ Google ͷάϩʔόϧ༧ଌϓϥοτϑΥʔϜͰ਺ઍϢʔβɺTB ڃσʔλͰ΋ɻ ΋ͪΖΜɺCloud Storage ΍ BigQuery ͱͷ౷߹΋؆୯ɻ TensorFlow ͕ۤखͳॲཧ͸ɾɾ
88. GPU΍InfinibandΛؚΉϚϧνΫϥ΢υHPCϋʔυ΢ΣΞ͕࢖͑Δɻ ΦϯϓϨϛεͱϋΠϒϦουԽͰ͖ɺ౷߹͞Εͨ160Λ௒͑Διϑτ΢ΣΞ ύοέʔδ͕؆୯ʹ࢖͑ɺ ैྔ՝ۚܕͰ଴ͪ࣌ؒͳ͘ HPCϦιʔεΛ͙͢ʹɻ
89. AI ָ͍͠Ͱ͢Ͷʂʂ
90. ΈΜͳͰ AWS ʹϑΟʔυόοΫΛʂ
91. ͓ΘΓ
92. גࣜձࣾεϐϯϑ ΞΠσΟΞΛ͔ͨͪʹʂ +
93. ͝૬ஊ͸͓ؾܰʹͪ͜Β·Ͱ.. 93 <Thank you !! https://www.supinf.co.jp/service/dockersupport/