SMS Spam collection
ham Go until jurong point, crazy..
Available only in bugis n great world la e
buffet... Cine there got amore wat...
ham Ok lar... Joking wif u oni...
spam Free entry in 2 a wkly comp to win
FA Cup final tkts 21st May 2005. Text FA to
87121 to receive entry question(std txt
rate)T&C's apply 08452810075over18's
547ϑΝΠϧ
Slide 49
Slide 49 text
SMS Spam collection
ham Go until jurong point, crazy..
Available only in bugis n great world la e
buffet... Cine there got amore wat...
ham Ok lar... Joking wif u oni...
spam Free entry in 2 a wkly comp to win
FA Cup final tkts 21st May 2005. Text FA to
87121 to receive entry question(std txt
rate)T&C's apply 08452810075over18's
547ϑΝΠϧ
ϥϕϧ
IBNˠεύϜ͡Όͳ͍
TQBNˠεύϜ
Slide 50
Slide 50 text
ػցֶशڥ
Slide 51
Slide 51 text
Spark / MLlib
• Spark cluster Λߏஙͯ͠ར༻͢Δͷ͕Ұൠత
• ໘ͳͷͰࠓճ self-contained ͳΞϓϦͰ
͓Λ͠·͢
• https://spark.apache.org/docs/latest/quick-
start.html#self-contained-applications
• ࠓ෩ͷ Spark ΞϓϦέʔγϣϯΒ͘͠ʢʁʣɺ
ML Pipeline API ͱ DataFrame API ΛͬͯΈ·͢
Slide 52
Slide 52 text
ML Pipeline API
• ػցֶशϫʔΫϑϩʔΛͦͷλεΫͷྻڍͰදݱ͢Δ
• ※ ಛநग़ɺֶशɺύϥϝʔλνϡʔχϯάɺݕূ
ͳͲ
Slide 53
Slide 53 text
ML Pipeline API
• MLlib ͷ֤छΞϧΰϦζϜΛ͍͘͢͢ΔΈ
ʹա͗ͳ͍
• MLlib ͷΞϧΰϦζϜ͕͕ͯ͑͢ΔΘ͚Ͱ
ͳ͍͜ͱʹҙ
• “Developers should contribute new algorithms
to spark.mllib and can optionally contribute to
spark.ml.”
• K-Means ͳͲ͑ͳ͍
Slide 54
Slide 54 text
ML Pipeline API
• ·ͩ·ͩ։ൃ్্
• ύϥϝʔλνϡʔχϯά݁Ռͷϕετύϥ
ϝʔλΛऔಘͰ͖ͳ͍ͬΆ͍
• ϞσϧͷӬଓԽ͕Ͱ͖ͳ͍
• Production Ͱ͏ʹ·ͩݫ͍͠