Tweet
Tweet

Slide 1

Slide 1 text

Java Ͱ౷ܭͱ͔ػցֶशͱ͔ ࣗવݴޠॲཧͱ͔Λ΍Γ͍ͨ ͱ͖ʹ໾ཱͭϥΠϒϥϦୡ 2014-10-24 at BizReach @komiya_atsushi / SmartNews, Inc.

Slide 2

Slide 2 text

τϐοΫ • ίϨΫγϣϯϥΠϒϥϦ • ܗଶૉղੳ • ਺ֶɾ౷ܭ • ػցֶश

Slide 3

Slide 3 text

ίϨΫγϣϯϥΠϒϥϦ

Slide 4

Slide 4 text

GNU Trove

Slide 5

Slide 5 text

GNU Trove net.sf.trove4j:trove4j:3.0.3 • ϓϦϛςΟϒܕΛޮ཰Α֨͘ೲɾΞΫηε͢ ΔͨΊͷίϨΫγϣϯΛఏڙ͢Δ • ϥΠηϯεɿLGPL

Slide 6

Slide 6 text

fastutil

Slide 7

Slide 7 text

fastutil it.unimi.dsi:fastutil:6.5.15 • GNU Trove ͱಉ͘͡ɺϓϦϛςΟϒܕΛޮ཰ Α֨͘ೲɾΞΫηε͢ΔͨΊͷίϨΫγϣϯ Λఏڙ͢Δ • ଟ༷ͳ Map ࣮૷Λఏڙͯ͘͠ΕΔ • AVL tree, RB tree, Open Hash, Linked Open Hash (?)

Slide 8

Slide 8 text

Koloboke

Slide 9

Slide 9 text

Koloboke • Trove / fastutil ͱಉ༷ • ࠷ۙͷϓϩμΫτʁ • ଎౓తʹ͸Ұ൪଎͍ͬΆ͍ʁ • ґଘϥΠϒϥϦΛ 2 ͭ௥Ճ͢Δඞཁ͕͋Δ • compile 'net.openhft:koloboke-api-jdk6-7:0.6.3' • runtime ‘net.openhft:koloboke-impl-jdk6-7:0.6.3' • ݱࡏ͸ Map ͷΈͷఏڙ

Slide 10

Slide 10 text

ܗଶૉղੳ

Slide 11

Slide 11 text

kuromoji

Slide 12

Slide 12 text

kuromoji org.atilika.kuromoji:kuromoji:0.7.7 • ೔ຊޠจʹରͯ͠Θ͔ͪॻ͖ˍ඼ࢺਪఆΛ͠ ͯ͘ΕΔ • ґଘϥΠϒϥϦʢͱΦϨΦϨϦϙδτϦʣΛ ௥Ճ͢Δ͚ͩͰ࢖ָ͑ͯͪΜ • Α͘ϦϙδτϦ͕མ͍ͪͯͯ͠ΐΜ΅Γ͢ Δ͜ͱ͕ଟ͍ͱ͔…

Slide 13

Slide 13 text

Stanford CoreNLP

Slide 14

Slide 14 text

Stanford CoreNLP edu.stanford.nlp:stanford-corenlp:3.4.1 • ϤʔϩούܥݴޠͷॲཧΛ͍ͨ͠ͱ͖͸͜Ε͕͓͢͢ Ί • ඼ࢺಉఆ΍ lemmatization ʢ׆༻ܗ → ݪܗʹ͢Δͳ ͲʣΛͯ͘͠ΕΔ • ϞσϧϑΝΠϧ΋ Maven Central Repo ʹ͋ΔͷͰɺ ηοτΞοϓָ͕ͪΜ • ͕͔ͩ͠͠਺ඦ MB…

Slide 15

Slide 15 text

਺ֶɾ౷ܭ

Slide 16

Slide 16 text

commons-math3

Slide 17

Slide 17 text

commons-math3 org.apache.commons:commons-math3:3.2 • ਺ֶɾ౷ܭํ໘ͷػೳ͕๛෋ • Ծઆݕఆ΍Β֬཰෼෍͕ѻ͑ΔͷͰݸਓత ʹͱͯ΋ॏๅͯ͠·͢ • ػցֶशΞϧΰϦζϜͷࣗલ࣮૷Λ͢Δࡍͷ ͓ڙʹ

Slide 18

Slide 18 text

ػցֶश

Slide 19

Slide 19 text

liblinear-java

Slide 20

Slide 20 text

liblinear-java de.bwaldvogel:liblinear:1.94 • ΈΜͳ͍͖ͩ͢ LIBSVM ͷઢܗ෼ྨಛԽ൛ LIBLINEAR Λ Java ʹϙʔςΟϯάͨ͠΋ͷ • ΞϠϝσʔλͩͬͨΓχϡʔεهࣄΛΧςΰ Ϧ෼ྨͱ͔͔ͨͬͨ͠Βɺ·ͣ͸͜ΕΛ࢖ͬ ͯΈΑ͏

Slide 21

Slide 21 text

MLlib

Slide 22

Slide 22 text

MLlib org.apache.spark:spark-mllib_2.10:1.1.0 • Apache Spark ্Ͱಈ͘ػցֶशϥΠϒϥϦ • 1.1.0 ΑΓ Word2Vec ࣮૷͞Ε·ͨ͠ʂ

Slide 23

Slide 23 text

σϞ

Slide 24

Slide 24 text

ίϨΫγϣϯϥΠϒϥϦͷ ൺֱ

Slide 25

Slide 25 text

No content

Slide 26

Slide 26 text

No content

Slide 27

Slide 27 text

No content

Slide 28

Slide 28 text

liblinear-java Ͱ ϩδεςΟοΫճؼ

Slide 29

Slide 29 text

No content

Slide 30

Slide 30 text

MLlib ͷ Word2Vec Λ ৮ͬͯΈΔ

Slide 31

Slide 31 text

No content