Share
Embed
カベを壊せ!「機械学習」×「グラフデータベース」×「チャット」で繋ぐヒューマンリレーションシップ!!
2018/12/15 Developers Boost A-10
https://event.shoeisha.jp/devboost/20181215/session/1891/
Shogo Ichinose
December 15, 2018
Transcript
78 slides
-
Χ ϕ Λ յ ͤ ʂ ʮ ػ ց ֶ
श ʯ × ʮ ά ϥ ϑ σ ʔ λϕʔε ʯ × ʮ ν ϟ ο τ ʯ Ͱ ܨ ͙ ώ ϡ ʔϚ ϯ Ϧ Ϩ ʔ γ ϣ ϯ γ οϓ ʂ ʂ # d e v b o o s t A - 1 0 # D re a m A r t s D re a m A r t s C o r p o r a t i o n S h o g o I c h i n o s e https://images.nasa.gov/details-PIA04921.html -
#devboostA-10 #DreamArts • Ұϊ ᠳޗ Shogo Ichinose • @rettar5 /
@[email protected] • Angular / Swift • Mastodon Meetup at Tokyo EjectίϚϯυϢʔβʔձ S E L F - I N T R O D U C T I O N -
#devboostA-10 #DreamArts S E L F - I N T
R O D U C T I O N -
#devboostA-10 #DreamArts גࣜձࣾυϦʔϜɾΞʔπ ౦ژຊࣾ ( ौ୩۠ܙൺण ) ɹɹɹɹɹɹɹɹɹɹɹɹ ౡຊࣾ (
ౡࢢத۠େखொ ) גࣜձࣾυϦʔϜɾΞʔπԭೄ ( ಹࢢ, ੴ֞ࢢ ) ເ৴ଉ(େ࿈)༗ݶެ࢘ ( தࠃେ࿈ ) දऔకࣾ ࢁຊত 199612݄ ઃཱ ελοϑ૯һ 270໊ • େ৫͚ITαʔϏεࣄۀ • ઌٕज़ɾϚʔέςΟϯάΛ༥߹ͤͨ͞ γεςϜ։ൃɾίϯαϧςΟϯάࣄۀ -
#devboostA-10 #DreamArts D A - > S E R V
I C E S & P R O D U C T S ͋ΒΏΔۀʹରԠ ίϛϡχέʔγϣϯΛϕʔεʹ ৫ɾਓɾࣾձ͕ ΑΓΑ͘ڠ͢ΔͨΊͷ αʔϏε & ϓϩμΫτ -
#devboostA-10 #DreamArts D A - > S E R V
I C E S & P R O D U C T S -
#devboostA-10 #DreamArts • Έͳ͞ΜɺීஈࣄΛ͍ͯͯ͜͠͏͍ͬͨ͜ͱ ى͖ͯ·ͤΜ͔ʁ C O M M U
N I C AT I O N B L O C K E R S -
#devboostA-10 #DreamArts H O W W I L L W
E B R E A K T H E “ WA L L ” ? • ࡞ͬͨͷɺʮࠓ·ͰؔΘͬͨ͜ͱ͕ͳ͍ ͔ͭɺΩʔϫʔυΛ͍ͬͯΔਓΛհ͢Δ νϟοτBOTʯ • ػցֶश × άϥϑσʔλϕʔε × νϟοτ ΛΈ߹Θ࣮ͤͯݱ -
#devboostA-10 #DreamArts Chiwawa Server Azure Cosmos DB (Graph Database) Chiwawa
Application Flask Server Trained Models Python Scripts Python Scripts νϟοτBOTͷ࣮ݱʹ͋ͨΓɺ 6ͭͷٕज़Λ͍·ͨ͠ɻ -
#devboostA-10 #DreamArts Cloud Services Local PC Chiwawa Server Azure Cosmos
DB (Graph Database) Chiwawa Application Flask Server Trained Models Python Scripts Python Scripts DBνϟοτͷใΫϥυ্Ͱɺ ػցֶशϨίϝϯυॲཧͳͲɺ ࣗͷPCͰॲཧΛߦ͍ͬͯ·͢ɻ -
#devboostA-10 #DreamArts O V E R V I E W
O F C H AT B O T • Step 1. σʔλೖɾֶशࡁΈϞσϧͷੜ • άϥϑDBͷσʔλΠϯϙʔτ • ߘσʔλΛֶͬͨशࡁΈϞσϧͷੜ • Step 2. νϟοτBOTͰͷϢʔβϨίϝϯυॲཧ • άϥϑDBͱֶशࡁΈϞσϧ͔ΒϢʔβͷऔಘ • νϟοτBOTΛ͍ɺϢʔβΛհ -
#devboostA-10 #DreamArts S t e p 1 . σ ʔ
λ ͷ ೖ ֶ श ࡁ Έ Ϟ σϧ ͷ ੜ -
#devboostA-10 #DreamArts S T E P 1 . P R
E P R O C E S S I N G • άϥϑσʔλϕʔεͱͳʹ͔ -
#devboostA-10 #DreamArts ಉظ ಉظ ্࢘ ෦Լ ্࢘ ෦Լ ্࢘ ෦Լ
্࢘ ෦Լ ্࢘ ෦Լ ޓ͍Λʮؔੑʯͱ͍͏ઢͰͭͳ͙͜ͱ͕Ͱ͖·͢ɻ ͜ͷϞσϧΛDBʹͨ͠ͷ͕άϥϑσʔλϕʔεͰ͢ɻ -
#devboostA-10 #DreamArts S T E P 1 . P R
E P R O C E S S I N G • άϥϑσʔλϕʔεͱ • ཁૉʢʣΛؔੑʢลʣͰܨ͍ͩϞσϧΛ ࣋ͭσʔλϕʔε • ΧʔφϏͷܦ࿏୳ࡧɺෆਖ਼ݕʢύφϚจॻ ͷղੳʣͳͲͰ׆༻ • Neo4jOrientDBɺAmazon NeptuneAzure Cosmos DB -
#devboostA-10 #DreamArts User Group Tag • Id • Name Message
• Id • Text • AttachmentTitle • AttachmentText • CreatedAt Reaction • Id • Name • Sentiment • CreatedAt • Id • Name • Id • Name Post Mention BelongsTo Mention Exists Exists AttachedTo Adds AttachedTo νϟοτͷσʔλΛ্ͷΑ͏ͳܗͰΠϯϙʔτ͠·ͨ͠ɻ -
#devboostA-10 #DreamArts User Group Tag • Id • Name Message
• Id • Text • AttachmentTitle • AttachmentText • CreatedAt Reaction • Id • Name • Sentiment • CreatedAt • Id • Name • Id • Name Post Mention BelongsTo Mention Exists Exists AttachedTo Adds AttachedTo ྫ͑ɺʮϝοηʔδϢʔβʹߘ͞Εͨʯͱ͍͏ؔΛɺ -
#devboostA-10 #DreamArts User Group Tag • Id • Name Message
• Id • Text • AttachmentTitle • AttachmentText • CreatedAt Reaction • Id • Name • Sentiment • CreatedAt • Id • Name • Id • Name Post Mention BelongsTo Mention Exists Exists AttachedTo Adds AttachedTo ʮϢʔβάϧʔϓʹॴଐ͢ΔʯͳͲͷؔΛ࣋ͪ·͢ɻ -
#devboostA-10 #DreamArts S T E P 1 . P R
E P R O C E S S I N G • Doc2Vec • ࣅ͍ͯΔจॻΛྨɾऔಘ͢Δ͜ͱ͕Ͱ͖Δػցֶश • e.g.: Wikipediaͷσʔλ͔ΒֶशࡁΈϞσϧΛੜ ͠ɺʮΩʔϫʔυʯ͔Βʮࣅ͍ͯΔهࣄʯΛऔಘ͢Δ • ͋Β͔͡Ίج४ͱͳΔจॻΛར༻ͯ͠ɺֶशࡁΈϞσ ϧΛੜ͢Δඞཁ͕͋Δ -
#devboostA-10 #DreamArts S T E P 1 . P R
E P R O C E S S I N G • Doc2Vec • จॻΛϕΫτϧͱͯ͠ѻ͍ɺ͍ۙϕΫτϧΛ࣋ͭจॻΛ ग़ྗ • จॻΛϕΫτϧͱͯ͠ѻ͏ͨΊʹɺWord2VecΛར༻ • Word2Vec • ୯ޠΛϕΫτϧͱͯ͠ѻ͍ɺ͍ۙϕΫτϧΛ࣋ͭ୯ޠΛ ग़ྗ • ʮ͋Δ୯ޠAͷपลʹผͷ୯ޠB͕ग़ݱ͢Δ֬ʯΛֶश -
#devboostA-10 #DreamArts S T E P 1 . P R
E P R O C E S S I N G Ͷ͜ɹ͕ɹʹΌʔΜɹͱɹͳ͘ ΤϯδχΞɹ͕ɹʹΌʔΜɹͱɹͳ͘ ʮ˓˓͕ʹΌʔΜͱͳ͘ʯͱ͍͏จষͰɺ ˓˓ʹ Ͷ͜ ΤϯδχΞ ؚ͕·ΕΔ֬Λֶश ΤϯδχΞ ≒ Ͷ͜ ͜ͷ߹ Ͷ͜ ͱ ΤϯδχΞ ಉ͡จ๏ͰΘΕΔ Word2VecͰ ͱֶश͞Ε·͢ɻ -
#devboostA-10 #DreamArts S T E P 1 . P R
E P R O C E S S I N G • User2Vec • Doc2Vecࣅ͍ͯΔจॻΛऔಘ͢ΔΈ • νϟοτͷߘσʔλΛจॻͱஔ͖͑Δͱɺ ͋ΔΩʔϫʔυΛߘͨ͜͠ͱ͕͋Δਓ ʢ˺ΩʔϫʔυΛ͍ͬͯΔਓʣ͕औಘͰ͖Δ • ୯ޠͷΏΒ͗Word2VecͰٵऩՄೳ -
#devboostA-10 #DreamArts S T E P 1 . P R
E P R O C E S S I N G େྔͷߘΛֶश ͋Δ༰Λೖྗ ࣅͨߘΛͨ͠ਓΛग़ྗ -
#devboostA-10 #DreamArts Train & Create Models Preprocessing for ML Doc2Vec
Doc2VecΛԠ༻ͨ͠User2VecΛ͍ɺ ࣄલʹֶशࡁΈϞσϧΛ࡞͓͖ͯ͠·͢ɻ -
#devboostA-10 #DreamArts S t e p 2 . ν ϟ
ο τ B O T Ͱ ͷ Ϣʔ β Ϩί ϝ ϯ υ ॲ ཧ -
#devboostA-10 #DreamArts S T E P 2 . U S
E R R E C O M M E N D AT I O N -
#devboostA-10 #DreamArts S T E P 2 . U S
E R R E C O M M E N D AT I O N 7VF Ұϊᠳޗ -
#devboostA-10 #DreamArts S T E P 2 . U S
E R R E C O M M E N D AT I O N • Webhook • νϟοτBOTʹϝοηʔδ͕ૹΒΕΔͱɺ༧Ίઃఆ͞Ε ͨURLϝοηʔδͷ༰Λసૹ͢ΔΈ • Flask • γϯϓϧͳPythonͷϚΠΫϩWebϑϨʔϜϫʔΫ • ࠓճWebhookΛड͚ͨࡍʹϝοηʔδຊจΛऔಘ ͠ɺޙଓͷϨίϝϯυॲཧΛݺͼग़͢ -
#devboostA-10 #DreamArts S T E P 2 . U S
E R R E C O M M E N D AT I O N • User2Vec • FlaskͰऔಘͨ͠ϝοηʔδΛܗଶૉղੳΛ ͔ͯͪ͠ॻ͖ʹ͠ɺStep 1.Ͱੜֶͨ͠ शࡁΈϞσϧ͔ΒϢʔβΛऔಘ • ͜ͷͱ͖ɺϕΫτϧͷྨࣅείΞʢίαΠϯ ྨࣅʣऔಘͰ͖Δ -
#devboostA-10 #DreamArts S T E P 2 . U S
E R R E C O M M E N D AT I O N • άϥϑσʔλϕʔε • ϝοηʔδͷߘऀͱɺػցֶशͰऔಘͨ͠ ϢʔβͱͷڑΛܭࢉ • ϓϩάϥϜ͔ΒσʔλϕʔεΛૢ࡞͢Δʹ Gremlinͱ͍͏ΠϯλʔϑΣΠεΛར༻ -
#devboostA-10 #DreamArts S T E P 2 . U S
E R R E C O M M E N D AT I O N • Apache TinkerPop Gremlin • ϑϨʔϜϫʔΫͰ͋ΔApache TinkerPopͷάϥϑ τϥόʔαϧݴޠʢDSLʣ • Neo4jɺOrientDBɺAmazon NeptuneɺAzure Cosmos DBͷଟ͘ͷάϥϑσʔλϕʔε͕αϙʔτ • Neo4jͷCypher Queryʹൺɺײతͳૢ࡞͕Մೳ -
#devboostA-10 #DreamArts User Reaction • Id • Name • Id
• Name • Sentiment • CreatedAt Message • Id • Text • AttachmentTitle • AttachmentText • CreatedAt >g.V().hasLabel(‘User’).has(‘Id’, ‘rettar5’) ࣗʢid = ‘rettar5’ʣͷใΛऔಘ͢Δͱ͖ʹ… -
#devboostA-10 #DreamArts User Reaction Post • Id • Name •
Id • Name • Sentiment • CreatedAt Message • Id • Text • AttachmentTitle • AttachmentText • CreatedAt >g.V().hasLabel(‘User’).has(‘Id’, ‘rettar5’) .outE(‘Post’).inV() ࣗʢid = ‘rettar5’ʣ͕ߘͨ͠ϝοηʔδΛऔಘ͢Δͱ͖ʹ… -
#devboostA-10 #DreamArts S T E P 2 . U S
E R R E C O M M E N D AT I O N • Ϣʔβಉ࢜ͷؔੑ • Ϣʔβಉ࢜ͷίϛϡχέʔγϣϯͷྔ ʹ Ϣʔβಉ࢜ͷؔείΞ • ίϛϡχέʔγϣϯ͕ଟ͚Εଟ͍΄Ͳɺ͕͍ ͍ؔͱఆ • ࠓճؔείΞΛଌΔͨΊʹ͏ίϛϡχέʔγϣ ϯύλʔϯ4छྨ -
#devboostA-10 #DreamArts S T E P 2 . U S
E R R E C O M M E N D AT I O N @all: 15ͷࢿྉΛߋ৽͠·ͨ͠ɺ ϨϏϡʔΛ͓ئ͍͠·͢ʂ άϧʔϓશһʹϝοηʔδΛߘ -
#devboostA-10 #DreamArts S T E P 2 . U S
E R R E C O M M E N D AT I O N @ੴా྄݈: 15ͷࢿྉΛ ߋ৽͠·ͨ͠ɺ ϨϏϡʔΛ͓ئ͍͠·͢ʂ ૬खͷ໊લΛ͚ͭͯϝοηʔδΛߘ -
#devboostA-10 #DreamArts S T E P 2 . U S
E R R E C O M M E N D AT I O N 15ͷࢿྉΛߋ৽͠·ͨ͠ɺ ϨϏϡʔΛ͓ئ͍͠·͢ʂ 1ର1ͰϝοηʔδΛߘ -
#devboostA-10 #DreamArts S T E P 2 . U S
E R R E C O M M E N D AT I O N 15ͷࢿྉΛߋ৽͠·ͨ͠ɺ ϨϏϡʔΛ͓ئ͍͠·͢ʂ ߘͨ͠ϝοηʔδϦΞΫγϣϯ -
#devboostA-10 #DreamArts S T E P 2 . U S
E R R E C O M M E N D AT I O N • ֤ύλʔϯʹॏΈ͚Λߦ͍ɺ߹ܭͷؔ είΞ͕͍ਓʢ㲈 ؔΘͬͨ͜ͱ͕ͳ͍ ਓʣΛݟ͚ͭग़͢ -
#devboostA-10 #DreamArts S T E P 2 . U S
E R R E C O M M E N D AT I O N • Ϩίϝϯσʔγϣϯϝοηʔδͷߘ • ؔείΞ͕͍͔ͭɺྨࣅείΞ͕ߴ͍ ॱʹฒͼସ͑ • ্Ґ3ਓͷใΛྠʢνϟοτʣαʔό ʹૹΓɺؔΘͬͨ͜ͱ͕ͳ͍ɺΩʔϫʔυ Λ͍ͬͯΔਓͱͯ͠ϨίϝϯυΛߘ -
#devboostA-10 #DreamArts S T E P 2 . U S
E R R E C O M M E N D AT I O N 7VF Ұϊᠳޗ ੴా͞ΜɺୌՖ͞Μɺ౻ຊ͞Μ͕ʮ7VFʯ ʹ͍ͭͯৄ͍͠Α͏Ͱ͢ɻ ϝοηʔδΛૹͬͯΈ·ͤΜ͔ʁ Ϣʔβհ#05 ࣗͷߘʹରͯ͠ɺνϟοτBOT͕ϢʔβΛհͯ͘͠ΕΔʂ -
#devboostA-10 #DreamArts ͬ ͱ ྑ ͘ ͠ Α ͏
ͱ ߟ ͑ͯ ͍ Δ ͜ ͱ -
#devboostA-10 #DreamArts I N F U T U R E
• νϟοτBOT͕ʹཱ͔ͬͨධՁ͢ΔͨΊͷ Έ • ΞΫςΟϒϥʔχϯάͷΈ • ϓϥΠόγʔɾηΩϡϦςΟͷΈ -
#devboostA-10 #DreamArts I N F U T U R E
• ΞΫςΟϒϥʔχϯά • νϟοτͷσʔλʑ૿͑ଓ͚Δ • ։ൃڥͷαΠϩԽɺܧଓతͳֶशࡁΈ Ϟσϧͷߋ৽ϋΠύʔύϥϝʔλͷௐ ʹ՝ -
#devboostA-10 #DreamArts I N F U T U R E
• Azure Machine Learning service • ػցֶश༻ͷϦιʔε֬อɺ࠷దͳΞϧΰϦζϜɾϋ Πύʔύϥϝʔλͷ୳ࡧɺσϓϩΠͳͲΛࣗಈԽ • ʮσʔλʯͱʮ΄͍݁͠ՌʯΛ༩͑Δͱɺͯࣗ͢ ಈͰػցֶशͯ͠Β͑Δະདྷԕ͘ͳ͍ • ղܾͷຊ࣭Ͱͳ͍ʮڥߏஙʯʮӡ༻ʯʹ ࣌ؒΛऔΒΕΔ͜ͱͳ͘ɺΔ͖͜ͱ͕ΕΔΑ ͏ʹͳΔ -
#devboostA-10 #DreamArts I N F U T U R E
• ϓϥΠόγʔɾηΩϡϦςΟ • ܦӦਓࣄʹؔΘΔใ͕ߘ͞Ε͍ͯΔ Մೳੑ͕͋Δ • ʮࣗͷϝοηʔδݟΒΕͨ͘ͳ͍ʯͱ ͍͏ਓ͕ग़ΔՄೳੑ͕͋Δ -
#devboostA-10 #DreamArts I N F U T U R E
• ϓϥΠόγʔɾηΩϡϦςΟ • ݟΒΕͨ͘ͳ͍ͷϝοηʔδͷ༰ • ϝοηʔδΛૹͬͨͱ͍͏ࣄ࣮Λ͏ͷͳ͍ • ؔείΞͷਫ਼ҡ࣋ͭͭ͠ɺ͍͚ͬͯͳ͍ ϝοηʔδϚεΩϯάͯ͠׆༻͢Δ • 1ର1ͷΓऔΓϒϥοΫϦετͰલॲཧ -
#devboostA-10 #DreamArts C O N C L U S I
O N • ۀ͕νϟοτϕʔεʹมΘͬͨ • ίϛϡχέʔγϣϯͷੳɾ׆༻͕ݱ࣮తʹ • ؾܰʹʮͪΐͬͱࢼͯ͠ΈΔʯ͜ͱͰ͖Δ࣌ • ػցֶशΫϥυج൫ͳͲखܰʹ͑ΔΑ͏ʹ • ͋ΓͷΛΈ߹ΘͤΔ͚ͩͰେ͖ͳՌ͕ग़ͤΔ • ৽ͨͳՁΛੜΉͨΊͷΞΠσΟΞ͕ॏཁ -
#devboostA-10 #DreamArts R E C R U I T M
E N T O F S TA F F AT T O K Y O / H I R O S H I M A / O K I N AWA υϦʔϜɾΞʔπ ࠾༻ https://recruit.dreamarts.co.jp