Share
Embed
Transcript
37 slides
-
ߨࢣհ • ٠ా ངฏʢ͖ͨ͘ Α͏͍ʣ • ത࢜ʢཧֶʣ • ݱࡏίϯαϧςΟϯάϑΝʔϜʹͯσʔλੳۀʹैࣄ •
ಘҙ ɾػցֶशͷཧతଆ໘ ɾਪનΞϧΰϦζϜ ɾը૾ੳʢDeep Learningʣ • ࿈བྷઌ Կ͔͋Γ·ͨ͠Β͓ؾܰʹ͝࿈བྷ͍ͩ͘͞ Email : [email protected] Facebook : https://www.facebook.com/yohei.kikuta.3 Linkedin : https://jp.linkedin.com/in/yohei-kikuta-983b29117 -
CGMͷོ Consumer Generated Media (CGM) ͕͘ΘΕ͍ͯΔ • ۩ମతͳྫ Amazon
ͷϨϏϡʔ, Twitter ͷπΠʔτ, ཱྀߦαΠτͷޱίϛ, ͳͲ • ಛ Ϣʔβ͕ࣗσʔλΛੜ αʔϏεʹΑͬͯඇৗʹେྔͷσʔλ • ༗༻ͳ ରʹର͢ΔҰൠফඅऀͷੜͷ͕நग़Ͱ͖Δ େྔͷσʔλ͔ΒੈશମΛஅՄೳ -
ධੳͰΓ͍ͨ͜ͱ • ۃੑͷྨ ͦͷςΩετ͕ positive ͳҙݟ͔ negative ͳҙݟ͔Λྨ •
ࣙॻͷࣗಈߏங ςΩετσʔλͷू߹ʹݱΕΔ୯ޠͷొ • ϢʔβͷϓϩϑΝΠϦϯά ςΩετͷ࡞ऀͷੑผผͳͲΛ࣮ࢪ • ༰ͷཁ ςΩετσʔλͷू߹͔Βੈͷͷநग़ͳͲΛ࣮ࢪ -
ධੳͰΓ͍ͨ͜ͱ • ۃੑͷྨ ͦͷςΩετ͕ positive ͳҙݟ͔ negative ͳҙݟ͔Λྨ ྨʹ͓͍ͯػցֶशΛ༻͍Δ͜ͱ͕Մೳ
ϨϏϡʔA ͜ͷͱ͍ͯ ͍͢ͷͰ͓͢͢Ίʂ ϨϏϡʔB ͜ͷஈͷׂʹ ੑೳ͕͍ɻ ϨϏϡʔC ͜ͷങͬͯଛ͢ ΔϨϕϧͰͳ͍ɻ positive negative positive (or neutral) Ԡ༻ྫʣ ͋Δʹରͯͦ͠Ε͕ੈ͔ؒΒྑ͍ධՁͳͷ͔൱͔Λஅ ʹର͢Δ negative ͳϨϏϡʔΛूΊͯվળΛચ͍ग़͠ -
ධੳͰΓ͍ͨ͜ͱ • ۃੑͷྨ ྨΛࡉ͔ͯ͘͠ޒஈ֊ͷධՁͳͲʹ͢Δ͜ͱଟ͍ ϥϯΫֶशճؼͷͱͯ͠ѻ͑Δ ϨϏϡʔA ͜ͷͱ͍ͯ ͍͢ͷͰ͓͢͢Ίʂ ϨϏϡʔB
͜ͷஈͷׂʹ ੑೳ͕͍ɻ ϨϏϡʔC ͜ͷങͬͯଛ͢ ΔϨϕϧͰͳ͍ɻ ˑˑˑˑˑ ˑˑ ˑˑˑ Ԡ༻ྫʣ ϢʔβͷଞใͱΈ߹Θͤͯɺ͋ΔϢʔβʹରͯ͠ߴධՁʹͳΓ ͦ͏ͳΛਪન -
ධੳͰΓ͍ͨ͜ͱ • ۃੑͷྨ ΑΓਐΜͩͷͱͯ͠؍ຖʹྨ͢Δͷ͋Δ ֤؍Λநग़͢Δͱ͜Ζػցֶश͕͑Δ ϨϏϡʔ ͜ͷϗςϧ෦͕ͱ͖ͯΕ͍Ͱྑ ͍ɻ͔͠͠ͳ͕Β৯ࣄ࣭͕͘վ ળͯ͠Β͍ͱ͜Ζɻैۀһͷ٬
ஸೡͰײ͕࣋ͯΔɻ ෦ͷ࣭ : positive Ԡ༻ྫʣ positive / negative ͕͍ࠞͬͯ͟ΔϨϏϡʔ͔Β؍ຖͷධՁΛऔΓग़ ͠ϢʔβͷҙݟΛѲ ৯ࣄͷ࣭ : negative ٬ͷ࣭ : positive -
ධੳͰΓ͍ͨ͜ͱ • ࣙॻͷࣗಈߏங ςΩετσʔλͷू߹ʹݱΕΔ୯ޠͷొ Ԡ༻ྫʣ େྔͷςΩετσʔλ͔Βग़ݱ୯ޠͷࢺ positive / negative
Λࣗ ಈతʹผͯ͠ొ͠ɺ͞Βʹදه༳Εੋਖ਼ͨ͠ DB Λ࡞ ϨϏϡʔA ͜ͷͱ͍ͯ ͍͢ͷͰ͓͢͢Ίʂ ϨϏϡʔB ͜ͷஈͷׂʹ ੑೳ͕͍ɻ ϨϏϡʔC ͜ͷങͬͯଛ͢ ΔϨϕϧͰͳ͍ɻ ࣙॻ DB ͍͍͢ : positive յΕ͍ͯΔ : negative Ϩϕϧ : neutral ɾ ɾ ɾ -
ධੳͰΓ͍ͨ͜ͱ • ϢʔβͷϓϩϑΝΠϦϯά ςΩετͷ࡞ऀͷੑผผͳͲΛ࣮ࢪ Ԡ༻ྫʣ ߘͨ͠ϨϏϡʔσʔλΛجʹੑผͳͲΛผ͠, Ϩίϝϯυ͢Δ ͷબఆʹཱͯΔ ϨϏϡʔ
͜ͷ༑ୡʹ ධͰΈΜͳͬͯ·͢ɻ ϨϏϡʔ ͜ͷͷܗঢ়~Ͱ ~ͰੑೳेͰ͢ɻ -
ධੳͰΓ͍ͨ͜ͱ • ༰ͷཁ ςΩετσʔλͷू߹͔Βੈͷͷநग़ͳͲΛ࣮ࢪ Ԡ༻ྫʣ େྔͷςΩετσʔλ͔Β͍·ྲྀߦΓͷΛநग़ͨ͠Γબڍͷ݁ ՌΛ༧ଌͨ͠Γ͢Δ ςΩετA બڍߥΓࣗຽ
ౘ͕͔ͬ͠Γ͍ͯ͠Δ ςΩετB ͜ͷঢ়گ͡Όࣗຽౘʹ ೖΕΔ͔͠ͳ͍ͩΖ ςΩετC ʓʓౘͷ֗಄ԋઆʹ~ ਓ͕ԡ͠دͤͨɻ ग़ॴ : http://japan.cnet.com/news/society/35034916/ -
ධੳͱػցֶश ػցֶशͱͷੑߴ͍ • େྔͷσʔλΛଈ͔࣌ͭߴʹॲཧ͢Δ͜ͱ͕Մೳ • CGMͷོʹΑΓిࢠใͱͯ͠େྔͷςΩετσʔλ͕ଘࡏ • ୯७ͳϧʔϧϕʔεͰ༧ଌͰ͖ͳ͍ʹରͯ͠ߴ͍ਫ਼Λൃش ͔͠͠ͳ͕Β͍͠ଟ͍
• ςΩετσʔλͦͷ··ͰϞσϧʹೖͰ͖ͳ͍ → ಛྔ࡞ͷݟ͕ඞཁ • ݴޠʹΑΔҧ͍͕େ͖͍ → ਂ͘ੳ͢ΔʹݴޠϞσϧͷཧղͳͲඞཁ -
ධੳͷྲྀΕ ୯७ͳྨ͔ΒෳࡶͳλεΫͱൃల͍ͯ͠·͢ • 1990 ܗ༰ࢺͷۃੑྨ (positive or negative) •
2000 લϨϏϡʔςΩετͷۃੑྨ (positive or negative) ޙ͔ΒτϐοΫϞσϧΛ༻͍ͨ༰ཁͳͲͷෳࡶͳλεΫ • 2010 Twitter ͳͲͷ SNS ͷੳ Word2vecΛ࢝Ίͱ͢Δ୯ޠͷࢄදݱͳͲ ςΩετͱը૾ͳͲͷଞͷσʔλΛෳ߹ͨ͠ੳ -
ςΩετੳ͍͠ ίϯϐϡʔλͰѻ͑Δͷσʔλ → ςΩετ୯ޠͷཏྻ → ҙຯߏΛؚΜͩσʔλʹ͢Δඞཁ͕͋Δ
→ ͔͠͠ςΩετσʔλେ͖͞ॱংͱ͍͏ईͰଌΓͮΒ͍ ɹ Ex.) ʮཧʯͱʮݱ࣮ʯʹେখͲͪΒ͕ઌͱ͔Ұൠʹͳ͍ → Ͳ͏͢ΕΑ͍ͷ͔ʂʁ → ຊߨ࠲ͰදతͳੳεςοϓΛ؆୯ʹհ -
දతͳੳεςοϓ • ςΩετσʔλΛ४උ • ܗଶૉղੳ • Γड͚ղੳ • ಛྔ࡞
• తͷੳΛ࣮ࢪ ڭࢣ༗ΓͳΒผճؼɺڭࢣແ͠ͳΒΫϥελϦϯάɺͳͲ ※͋͘·ͰදతͳεςοϓͳͷͰ༷ʑͳύλʔϯ͕ଘࡏ -
දతͳੳεςοϓ • ςΩετσʔλΛ४උ ੳͷରͱͳΔςΩετσʔλΛ४උ͢Δ จࣈίʔυʹҙʂ ɾຊޠͳͲͷϚϧνόΠτจࣈಛʹҙ͕ඞཁ ɾpython2ܥͱ3ܥͰ࣮͕ҟͳΔ(2ܥstrܕͱunicodeܕ͕͋Γ3ܥunicodeͰ౷Ұ)
ɹಛผͳཧ༝͕ͳ͍ݶΓ3ܥΛ༻͍Δͷ͕ྑ͍ σʔλιʔεͱͯ͠ԼهͷΑ͏ͳͷ͕͋Δ ɾTwitter API (https://dev.twitter.com/overview/documentation) Λ༻͍ͨ tweet ऩू ɾ੨ۭจݿ (http://www.aozora.gr.jp/) ɾӳޠͷөըϨϏϡʔσʔλ (http://www.cs.cornell.edu/people/pabo/movie-review-data/) -
දతͳੳεςοϓ • ܗଶૉղੳ ςΩετΛҙຯ୯ҐͰ࠷খͷཁૉʹղ͢Δ ӳޠͳͲεϖʔεͰ୯ޠ͕۠ΒΕΔݴޠ؆୯ ɹEx.) This is
a pen. → This / is / a / pen / . ຊޠ͍͠ ղੳ༻ϥΠϒϥϦ͕ඞཁͰ, MeCab (http://taku910.github.io/mecab/) ͕༗໊ ɹEx.) ͢ͷ͏ͪ → ͢ / / / / / ͷ / ͏ͪ ՄೳͳΒࣙॻΛ༻͍ͯදه༳ΕΛਖ਼ͨ͠ΓࢺΛ༩͑Δͱߋʹྑ͍ ɹEx.) ͓͜ͳ͏, ߦ͏, ߦͳ͏ → ߦ͏ ɹEx.) ඒ͍͠ → (ඒ͍͠, ܗ༰ࢺ) -
දతͳੳεςοϓ • Γड͚ղੳ ܗଶૉʹରͯ͠म০͢Δ͞ΕΔͷؔΛࢦఆ͢Δ ͜ΕݴޠಛੑଟٛੑͷͨΊͱ͍ͯ͠ ɹEx.) I think
that that that that boy used is wrong. ɹEx.) ࠇ͍ͷඒ͍͠ঁੑ͕͍Δɻ ϥΠϒϥϦͳͲΛ༻͢Δ͔Γड͚ղੳεΩοϓ͢ΔͷΞϦ ຊޠͷϥΠϒϥϦ Cabocha (https://taku910.github.io/cabocha/) ͕༗໊ -
දతͳੳεςοϓ • ಛྔ࡞ ୯ޠͷ༗ແΛ {0,1} Ͱදݱ͢Δ one-hot encoding ͕جຊ
ɹEx.) ࢲ → [1,0,0,0, …], → [0,1,0,0, …], ਓؒ → [0,0,1,0, …] ͜ΕΛ༻͍ͯจॻߦྻΛԼهͷΑ͏ʹ࡞Ͱ͖Δ จষ ࢲ ͋ͳͨ ਓؒ ͩ Ͱ ͳ͍ ɻ ʜ ࢲਓؒͩɻ ͋ͳͨਓؒͰͳ͍ɻ ʜ ͜ͷํ๏γϯϓϧͰѻ͍͍͢ ͔͠͠ҙͷೋ୯ޠؒͷྨࣅ͕ಉ͡ʹͳͬͯ͠·͍ҙຯফࣦ -
දతͳੳεςοϓ • ಛྔ࡞ɿࠓճͷੳͰ͏ͷ ςΩετؚ͕ΉҙຯΛөͤ͞ΔͨΊʹ༷ʑͳಛ͕ߟҊ͞Ε͍ͯΔ ɾN-gram ɹྡͯ͠ੜ͡Δ N ݸͷ୯ޠΛҰͭͷ୯Ґͱͯ͠ѻ͏ɻN =
1,2͕ଟ͍ ɹɹEx.) bi-gram ࢲਓؒͩɻ→ (ࢲ, ), (, ਓؒ), (ਓؒ, ͩ), (ͩ, ɻ) ɾBag of Words (BoW) ɹग़ݱ͢Δ୯ޠͷසΛΧϯτͯͦ͠ͷΛಛྔͱ͢Δ ɹɹEx.) ࢲࢲΛ৴͡Δɻ→ (ࢲ, 2), (, 1), (Λ, 1), (৴͡Δ, 1), (ɻ, 1) ɾtf-idf (term frequency and inverse document frequency) ɹ୯ޠͷසʹରͯͦ͠Ε͕ग़ݱ͢Δจॻͷׂ߹ͰॏΈ͚ ɹɹEx.) ʮࢲʯग़ݱසଟ͍͕ଟ͘ͷจষͰݱΕΔͨΊ͍είΞ -
දతͳੳεςοϓ • ಛྔ࡞ɿͦͷଞ ɾ࣍ݩѹॖ ɹจॻߦྻΛ࣍ݩʹѹॖͯ͠τϐοΫநग़ͳͲΛߦ͏ ɹಛҟղ֬తજࡏҙຯղੳLatent Dirichlet AllocationͳͲ ɾ
ɹ୯ޠࢺͷൺͳͲ ɾ୯ޠͷࢄදݱ ɹWord2Vec ʹද͞ΕΔϕΫτϧԋࢉ͕ҙຯΛ͢Α͏ͳදݱͷ֫ಘ ɹɹEx.) king - man ≒ queen - woman ɾetc… -
දతͳੳεςοϓ • తͷੳΛ࣮ࢪ ಛྔ͕࡞Ͱ͖ΕޙଞͷػցֶशΛ༻͍ͨੳͱಉ༷ ڭࢣ༗Γ → positive /
negative ผϨϏϡʔείΞ༧ଌ, ͳͲ ڭࢣແ͠ → ΫϥελϦϯάτϐοΫநग़, ͳͲ -
ࠓճ࣮ࢪ͢Δੳ • ςΩετσʔλΛ४උ ӳޠͰॻ͔ΕͨөըͷϨϏϡʔσʔλΛ༻ • ܗଶૉղੳ ୯७ͳεϖʔε۠Γ؆୯ͳࣙॻΛߏஙͯ͠ͷॲཧ࣮ߦ • Γड͚ղੳ
• ಛྔ࡞ uni-gram Ͱ Bag of Words ࡞, Ұ෦ͷ bi-gram ͷߏங tf-idf ར༻ • తͷੳΛ࣮ࢪ ରͷϨϏϡʔςΩετ͕ positive ͔ negative ͔Λผ -
࣮ࡍʹੳΛ࣮ࢪͯ͠Έ·͠ΐ͏ʂ • ઃఆ ༩͑ΒΕͨจষ͕ positive ͳҙݟ͔ negative ͳҙݟ͔Λผ ࢀߟจɿhttp://www.aclweb.org/anthology/W02-1011
• σʔλ https://www.cs.cornell.edu/people/pabo/movie-review-data/ ͔Βऩू positive, negative ͷλά͚͕ͳ͞Ε͍ͯΔ 700+700 ͷจষ 1ϑΝΠϧʹ͖ͭ1ϨϏϡʔςΩετ͕֨ೲ • ඪ ςΩετੳͷجຊతͳྲྀΕΛମݧ ࢀߟจͷਫ਼Λ্ճΔʂ -
Notebookͷ४උ 1. Githubͷ https://github.com/yosukekatada/python_ml_study Λ clone 2. 20160930_second_meeting ʹҠಈ
3. ධੳͰ༻͍ΔͷԼه - data/ - ML_2_2_normal.ipynb - ML_2_2_advanced.ipynb 4. jupyter notebook (or ipython notebook) Λ։͘ 5. ੳΛ࢝Ί·͠ΐ͏ʂ -
Ϟσϧ : Support Vector Machine ࢀߟ : https://en.wikipedia.org/wiki/Support_vector_machine
ෳࡶͳڥքͷσʔλΛઢܗՄೳͳಛྔۭؒʹࣹӨ Ͱ͖Δ͚ͩڥք͕σʔλ͔ΒΕΔΑ͏ʹ͢Δ (Ϛʔδϯ࠷େԽ) ߴ࣍ݩ (ແݶ࣍ݩʂ) ͷࣹӨͰܭࢉ͕Մೳ (ΧʔωϧτϦοΫ) original space feature space -
Ϟσϧ : Naive Bayes classifier ࢀߟ : https://en.wikipedia.org/wiki/Naive_Bayes_classifier
มͷಠཱੑͷԾఆͱϕΠζͷఆཧ͔ΒผثΛߏங ͜͜Ͱ C 1 (positive) ͘͠ 0 (negative) ͱ͍͏ΫϥεͰ͋Γ, ֤ x unigram Ͱߏஙͨ͠ Bag of Words ͱߟ͑ΕΑ͍ Ϋϥε C ʹґଘ͠ͳ͍ͷͰআ͍ͯ, ͖݅ಠཱΛ͏ͱҎԼ ΨεϕϧψʔΠΛԾఆͯ͠ σʔλ͔ΒύϥϝλΛֶश P ( C | X ) = P ( C | x1, x2, . . . , xn) = P ( x1, x2, . . . , xn | C ) P ( C ) P ( X ) P ( C | X ) / P ( C ) n Y 1 P ( xi | C ) -
Ϟσϧ : Random Forest ࢀߟ : https://en.wikipedia.org/wiki/Random_forest ܾఆΛෳΈ߹ΘͤͯଟܾͰ༧ଌ
ୈҰճษڧձࢿྉͰઆ໌ : http://www.slideshare.net/ssuserb5817c/python-66169435/1 ɾ ɾ ɾ ҰͭҰͭͷσʔλΛ͏·ׂ͘͢ΔΑ͏ʹࢬ͚͞Ε͍ͯ͘ ͦΕͧΕͷͷ༧ଌͷฏۉΛͱΔ͜ͱͰશମͷ༧ଌͱ͢Δ ͖ͱ͍͏୯ޠ͕ ؚ·ΕΔ͔൱͔ ବ࡞ͱ͍͏୯ޠ͕ ؚ·ΕΔ͔൱͔ ?͕5ճҎ্ ݱΕΔ͔൱͔ -
·ͱΊ • ධੳͱԿ͔ ςΩετσʔλ͔Β positive / negative ͷۃੑผநग़Λߦ͏ • ςΩετσʔλΛ༻͍ͨੳͷجຊ
ඇߏԽσʔλͰ͋Δ͜ͱݴޠʹΑΔҧ͍͕͋ΔͨΊߴ جຊ ܗଶૉղੳ→Γड͚ղੳ→ಛྔ࡞→ੳͷ࣮ࢪ • өըͷϨϏϡʔσʔλΛ༻͍ͨੳ ςΩετੳͷجຊతͳॲཧΛܦݧ ಛྔ࡞Λ͢Δ͜ͱͰաڈจΛ্ճΔਫ਼Λୡ