speee-kaigi-160629

SpeeeKaigi#1で会社の名寄せにGraphDB(Neo4j)を使ってみた話をした際のスライドです

Transcript

1. ձ໊ࣾͷ໊دͤʹάϥϑDBΛ ࢖ͬͯΈͨ࿩(wip) 2016.6.29(wed) Տٱอ ൟ࢙
2. ࣗݾ঺հ • Տٱอ ൟ࢙ (kawakubox) • ւ֎ࣄۀ෦ ਓࡐܥαʔϏεͷEng΍ͬͯ·͢ • ࠷ۙͷ͓΋ͳ୲౰͸ɺΫϩʔϥɺϚελ౷߹
3. ձࣾϚελͷ౷߹ΛλεΫͱ ๊͍ͯ͑ͯ͠ΔͷͰ͢ ͕ɺɺɺ
4. ௚໘͍ͯ͠Δ՝୊ • ձࣾϚελ͕೔ʑ௥Ճ͞Ε͍ͯΔ • ௥Ճ͞ΕΔձ໊ࣾͷදهʹϒϨ͕͋Δ • and more...
5. ಛఆͷϫʔυ͕ͳ͔ͬͨΓ • The Procter & Gamble Company • Procter & Gamble Company
6. ޠॱ͕ҧͬͨΓɺ()͍ͭͯͨΓ • LLC General Mortors Company • General Mortors Company, LLC (GM)
7. ͦ΋ͦ΋typoͩͬͨΓ • Business Development Company • Business Deveploment Company
8. ৽چͷձࣾϚελΛ౷߹͢Δࡍ͸ɺ୯७ͳ͕ͬͪ ΌΜ͜Ͱ͸ͳ͘ɺσʔλΛΩϨΠʹ͍ͨ͠ΑͶ by σΟϨΫλ
9. ໊د͕ͤඞཁͩɺɺɺ
10. ͜Ε·Ͱࢼͨ͜͠ͱ • HighεϖοΫWindows୺຤ͰɺExcel࢖ͬͯສ ݅ن໛ͷϑΝΠϧΛจࣈྻՃ޻Λͯ͠ಥ͖߹Θ ͤͨΓ͍ͯͨ͠ • খจࣈԽɺසग़ϫʔυ࡟আɺه߸౳࡟আ and more...
11. ·ͩ࢒͍ͬͯΔ໰୊ • ձ໊ࣾ typo ໰୊ • ୯ޠॱংͷલޙ
12. ͳΜ͔͍͍ํ๏ͳ͍͔ɺɺɺ
13. άϥϑDB(Neo4j)࢖ͬͯͳΜ ͔Ͱ͖Δ͔΋!! SpeeeKaigi ͷωλ࡞Γʹ΋ͳΔ͠ɺɺɺ
14. άϥϑDBͱ͸ɺɺɺ ϊʔυ(఺)ͱϦϨʔγϣϯ(ઢ)ͱ͍͏2ͭͷ֓೦Ͱ σʔλͷؔ܎ੑΛ֨ೲ͢Δσʔλϕʔε
15. ࠓճͷ໊دʹ༻͍ͨσʔλϞσϧ Node • CompanyName • ձ໊ࣾ • Word • ձ໊ࣾΛߏ੒͢Δ୯ޠ
16. ࠓճͷ໊دʹ༻͍ͨσʔλϞσϧ Relation • has [CompanyName -> Word] • ձ໊ࣾ ͕ ୯ޠ Λ͍࣋ͬͯΔؔ܎Λද͢ • similar [Word -> Word] • ୯ޠ ͱ ୯ޠ ͕ࣅ͍ͯΔؔ܎Λද͢ • ϨʔϕϯγϡλΠϯڑ཭͕͔ۙͬͨΓɺྨ ٛޠͩͬͨΓ
17. ࠓճͷ໊دʹ༻͍ͨσʔλϞσϧ
18. ࠓճͷ໊دʹ༻͍ͨσʔλϞσϧ
19. ຊ൪؀ڥͷσʔλΛ౤ೖ • Node • CompanyName … 25,947 • Word … 16,944 • Relation • has … 99,526 • similar … 11,546 • σʔλαΠζ … ͓Αͦ 90MB
20. GraphDBͰݕࡧͯ͠ΈΔ MATCH (base: CompanyName {text: LOWER('AKR Land Deveploment PT')}) MATCH p=(base)-[*1..2]->()<--(c) WHERE SIZE((base)-[*1..2]->()<--(c)) > base.word_count - 1 RETURN DISTINCT c AKR Land Deveploment PT ͱ͍͏typo͍ͯ͠Δ ձ໊ࣾͰݕࡧΛ͔͚Δͱɺɺɺ akr land development, pt akr land development pt ͕ݕࡧ݁Ռͱͯ͠දࣔ͞ΕΔɻ
21. ΍ͬͯΈͯ • Pros • RDBMSͰ͋Γ͕ͪͳςʔϒϧ࠶ؼ݁߹ͷί ετθϩ • ܦ࿏୳ࡧϥΫ • Cons • Cypher ͱ͍͏൚༻Ͱ͖ͳ͍ΫΤϦݴޠ • Wordϊʔυ͕ଟ͍ͷͰ Wordؒͷؔ܎
22. (wip) ͱ͍͏͜ͱͰ·ͩϩʔ Χϧ؀ڥͰಈ͍͍ͯΔ͚ͩͳ ͷͰ͕͢ɺಋೖͯ͠Έ͍ͨ ͬ!!