Share
Embed
Data Science Summit 2012 レポート
Hadoop ソースコードリーディング第10回での発表資料です。2012年5月23日にラスベガスで開催された Data Science Summit 2012 の講演内容をレポートにまとめました。
草薙昭彦
June 25, 2012
Transcript
46 slides
-
Data Science Summit 2012 ͱ • 20125݄23։࠵ʢEMC World 2012ซઃʣ
• ࠓ2ճ • ΞΧσϛΞɺιʔγϟϧΤϯλʔϓϥΠζɺε λʔτΞοϓɺެڞηΫλͳͲ֤քͷϦʔμʔ ͕ωλΛ࣋ͪدΓʮData Drivenͳੈքʯͷಓ ےΛࣔ͢ू͍ • ΩʔϊʔτɺࣄྫհɺύωϧΛؚΉܭ9ͭͷ ηογϣϯ -
Opening Keynote: What We Can Predict About PredicJon
• ߨԋऀ – Nate Silver ౷ܭઐՈɾNY Timesͷ࣏ϒϩά ʮFiveThirtyEight.comʯઃཱऀɾϥΠλʔɻ 2008ถେ౷ྖબͷ༧ଌͰ༗໊ɻ2009 TimeࢽʮੈքͰ࠷Өڹྗͷ͋Δ100 ਓʯ • ݱ࣮ͷσʔλʹ༧ଌϞσϧΛద༻͢Δࡍͷ ͠͞ͱͦͷӨڹʹ͍ͭͯܯࠂ • ͍͔ͭ͘ͷੳࣄྫ -
Opening Keynote: What We Can Predict About PredicJon
• ݚڀऀෆ࣮֬ੑϦεΫΛแؚͨ͠ɺݱ࣮ తͳ༧ଌϞσϧΛ։ൃ͖͢ – ྫ: ࠷ۙͷϊʔεμίλभNorth ForksͷߑਫͰ ؾ༧ଌ51ϑΟʔτͷఅߴʹର͠49ϑΟʔτ ͷਫҐ্ঢΛ༧ଌ͕ͨ͠ɺ9ϑΟʔτͷޡࠩΛߟ ྀ͠ͳ͔ͬͨ – ྫ: Deep BlueͱGary KasparovͷνΣεରઓͰɺ KasparovDeep BlueͷόάΛ࡞ઓͱצҧ͍͠ɺ ࠷ޙ·ͰʮϊΠζʯΛऔΓআ͚ͳ͔ͬͨ -
Roundtable: Economic, PoliJcal, & Societal Roles of Social Data
• ύωϦετ – Jeffrey Davitz: SolariatઃཱऀɾCEO – Dan Neely: Networked Insightsઃཱऀ,ɾCEO – Andreas Weigend: ελϯϑΥʔυେSocial Data LabɾݩAmazon.com Chief ScienJst – Nathan Wolfe: Global Viral ForecasJngઃཱऀɾ CEOɾελϯϑΥʔυେ٬һڭत • ιʔγϟϧσʔλ͔ΒͲͷΑ͏ʹՁΛݟͭ ͚ग़͢͜ͱ͕Ͱ͖Δ͔ʁ৽͍͠ϧʔϧͱʁ -
Roundtable: Economic, PoliJcal, & Societal Roles of Social Data
• Ϣʔβʔͷʮquery-‐like intentʯΛࣗવݴޠղੳ ͱػցֶशͰଊ͑Δ • Solariatग़൛ۀքͱڠۀ͠ɺtwiberϢʔβʔͷ ڵຯͱҰக͢ΔίϯςϯπΛ৴͢ΔαʔϏεΛ ఏڙ – ΫϦοΫεϧʔ20%ɺεύϜѻ͍͞Εͳ͍ • ίϯςϯπ͔ΒίϯςΩετɺίϯόʔδϣϯ͔ ΒΧϯόηʔγϣϯɻΧϯόηʔγϣϯ͕Ϛʔ έοτΛܗ͢Δ -
Big Data TransformaJon • ߨԋऀ – John Brownstein:
HealthMapڞಉઃཱऀɾ Harvard Medical School।ڭत – Nora Denzel: Intuit Big DataϚʔέςΟϯά ιʔγϟϧSVP – Oren Etzioni: ϫγϯτϯେڭतɾDecide.com ڞಉઃཱऀ – Tarek Kamil: InfoMoJon Sports Technologies ΤάθΫςΟϒσΟϨΫλʔ – Nate Silver: ౷ܭઐՈɾFiveThirtyEight.com ϥΠλʔ -
Big Data TransformaJon – HealthMap • ιʔγϟϧωοτϫʔΫϞϊΛചΔϚʔέο τ͚ͩͰͳ͘ɺֶशɾτϨϯυͷऩूɾੈքΛ ࢧԉ͢ΔͰ͋Δ
• 1996ͰΠϧεͷΞτϒϨΠΫΛݕ ͢Δͷʹ160͔͔͕͍ͬͨ·Ͱ20 • HealthMapੈք5ສࢢ͔ΒͷใΛҰ 2000ճσʔλϕʔεͷߋ৽Λߦ͍ɺજࡏతͳ Πϧεͷݕʹඋ͍͑ͯΔ -
Big Data TransformaJon – Intuit • ʮBig Data for
The Lible Guyʯ: Big DataͷԸܙ εϞʔϧϏδωε͔ΒίϯγϡʔϚ·Ͱ౸ ୡ ––– ྫ: Mint.com – ݸਓେ͖ͳίϛϡχςΟͱൺֱ͍ͨ͠ – εϞʔϧϏδωεڝ߹ͱൺֱͯ͠ࢧग़Ͳ͏͔ɺ ޏ༻Λࠓ૿͖͔͢ɺച্͛Λ૿͖͔͢ ݮΒ͖͔͢ΛΓ͍ͨ • σʔλͷྗʹΑΓɺ͜Ε·Ͱʹͳ͍৽ͨͳ ࣭ͱ͕͑ੜ·Εɺݹ͍ͷΛۦஞ͢Δ -
Big Data TransformaJon – InfoMoJon Sports Technologies •
όεέοτϘʔϧʹࠐΜͩηϯαʔͰ͋Β ΏΔϘʔϧͷಈ͖ΛτϥοΫ – όϯυɺΠϯύΫτɺεϐϯϨʔτɺγϡʔτͷހɺ ͞ΒʹݸʑͷϓϨʔϠʔͷମೳྗ·Ͱ • ϢʔεϦʔάେֶͰߴ͍τϨʔχϯάޮՌ -
Big Data TransformaJon – Decide.com • Ձ֨ൺֱαΠτ&ΞϓϦ •
ιʔγϟϧσʔλΛجʹɺ5000ͷൢചۀ ऀ͕ܾͯ͠ఏڙͰ͖ͳ͍ΦϯϥΠϯγϣοϐϯ άͷങ͍࣌ɺͪ࣌Λڭ͑ͯ͘ΕΔ – ങ͍࣌: Ձ͕֨ఈʹ͍ۙ – ͪ࣌: Ձ͕֨Լ͕Γͦ͏ or ৽Ϟσϧ͕ग़ͦ͏ • ཧ༝ͷৄࡉങ͏͖Ձ֨·Ͱ໌Β͔ʹͯ͠ ͘ΕΔͨΊɺফඅऀߦಈΛͱΓ͍͢ -
AnalyJcs Maturity: Master or Novice? • ߨԋऀ – Michael
Chui ϚοΩϯθʔɾάϩʔόϧɾΠϯεςΟ ςϡʔτγχΞϑΣϩʔɻʮBig data: The next fronJer for innovaJon, compeJJon and producJvityʯϨϙʔτڞಉஶऀ • ࣍ੈͷ࿑ಇऀ͕ߴ͍ڝ૪ྗΛʹ͚ͭΔ ͨΊʹɺڭҭػؔ౷ܭੳΛΑΓॏࢹ͢Δ ඞཁ͕͋Δ -
AnalyJcs Maturity: Master or Novice? • ʮ2010 NaJonal Academies
studyʯʹΑΔͱɺ Science͓ΑͼEngineeringͷଔۀੜͷൺ 29ͷ༟ࠃͷதͰΞϝϦΧ27Ґ • ܭࢉ๏Ͱͳ͘ɺ౷ܭΛڭ͑Δ͖ɻϏδωε ͰඍੵͳΜ͔͏͔ʁ͖݅֬ɺ બόΠΞεɺͦͷଞσʔλαΠΤϯε͕ ͬͱඞཁ • ͜ͷΑ͏ͳٕज़తͳ՝Λղܾ͢Δ͜ͱ ৫Λ·͕ͨͬͯਓʑͷߟ͑ํΛม͑ͯߦ͘ -
AnalyJcs Maturity: Master or Novice? • MGIϨϙʔτʮBig data: The
next fronJer for innovaJon, compeJJon and producJvityʯ – ΞϝϦΧͷશ࢈ۀʹ͓͚Δैۀһ1,000ਓҎ্ ͷاۀͰɺগͳ͘ͱ200TBҎ্ͷσʔλΛ๊ ͑Δ(2009) • ඞཁͳͷϕετϓϥΫςΟεͰͳ͘ʮωΫε τϓϥΫςΟεʯ • ϏδωεϦʔμʔɺڭҭऀɺҰൠࢢຽBig DataͷՁͱ՝ʹ͍ͭͯҙࣝ͢͠ -
Keynote: NavigaJng the Road from Business Intelligence to Data
science: Trials and Triumphs • ߨԋऀ – Piyanka Jain AryngۀऀɾࣾɾCEOɻੳؔ࿈ͷϏδ ωεΧϯϑΝϨϯεͰͷߨԋଟɻAryng ϏδωεੳͷτϨʔχϯάΛఏڙ͢Δ اۀɻGoogleɺeBayɺPaypalͳͲސ٬ • BIͷݶքͱʁσʔλαΠΤϯεͷԸܙΛड ͚ΔͷʹඞཁͳͷʁσʔλαΠΤϯεΛ औΓೖΕΔ͜ͱͰݱͲ͏มΘΔ?ʁ -
Keynote: NavigaJng the Road from Business Intelligence to Data
science: Trials and Triumphs -
Keynote: NavigaJng the Road from Business Intelligence to Data
science: Trials and Triumphs • ʮHow do you navigate from B.I. to B.Iʯ – Business Intelligence͔ΒϏδωεΠϯύΫτ – Data Savvy͔ΒIntelligence Heavy • σʔλαΠΤϯςΟετ͚ͩͰͳ͘ɺͯ͢ ͷਓ͕σʔλΛجʹܾͨ͠அͷํ๏ʹ͍ͭͯ ཧղΛਂΊΔ͖ – ੈքมԽ͓ͯ͠ΓܾஅͷࠜڌͱͳΔσʔλΛ ͭ͜ͱnice-‐to-‐haveͰͳ͘ඞਢཁ݅ -
Keynote: NavigaJng the Road from Business Intelligence to Data
science: Trials and Triumphs -
Panel: From Raw Data to Value Data • ύωϦετ
– Michael Brown: comScore CTO – Bob Flores – Applicologyઃཱऀɾࣾɾݩ CIA CTO – Jeremy Howard: KaggleࣾɾChief ScienJst – Tony Jebara – Sense Networksڞಉઃཱ ऀɾίϩϯϏΞେ।ڭत • Big Dataΰϛɺ͔ͦ͠͠ͷதʹՁ͕͋Δ -
Panel: From Raw Data to Value Data • ϓϥΠόγʔͷ
– IntuitͰϕετϓϥΫςΟεͷίϯηϯαεΛ ৫ؒͰڞ༗ – ಗ໊σʔλʹաͷ৴པΛ͓͘͜ͱʹҙ––– ιʔγϟϧϝσΟΞͰใ͕ؔ࿈͚ͮΒΕͯݸ ਓͷಛఆՄೳ • σʔλ࣭ͷ – ҟৗΛআ֎͢Δ͜ͱෆཁɺ࣌ͱͯ͠࠷ڵຯ ਂ͍σʔλʹͳΓಘΔ -
Panel: From Raw Data to Value Data • “Data
exhaust”ͷ – Data exhaust: ݸਓ͕ʑΠϯλʔωοτ্Ͱߦ͏ ༷ʑͳΠϯλϥΫγϣϯʹؔ͢Δσʔλͷू߹ – ݱࡏͰٞͷ: Data exhaustಛ༗ͷόΠΞ εʹҙ – ૬ؔͱҼՌؔͷ۠ผେม͍͠ – อݥձࣾͰData exhaust͔Β࠷దͳอݥྉΛ୳ Δ࣮ݧΛߦ͕ͬͨɺ݁ՌతʹաڈͷτϥϯβΫ γϣϯσʔλΛ׆༻͢Δํ͕༗ޮͩͬͨ -
Panel: Tapping Into the Pulse of the Data Science
Movement • ύωϦετ – Joe Hellerstein: UCόʔΫϨʔڭत – Jure Leskovec: ελϯϑΥʔυେॿڭत – Hadley Wickham: ϥΠεେॿڭत – Chris Wiggins: ίϩϯϏΞେॿڭत • Big Dataʹؔ͢ΔେֶɾݚڀػؔͰͷऔΓ Έ -
Panel: Tapping Into the Pulse of the Data Science
Movement • UCόʔΫϨʔͱελϯϑΥʔυͷݚڀίϛϡχ ςΟͰ1999ΑΓΠϯλʔωοτɾSNSͷ׆ಈ ΛάϥϑϕʔεͰ؍͠ଓ͚͍ͯΔ • ϢʔβʔΤΫεϖϦΤϯε͕࣍ͷ2ͷνϟϨ ϯδɻ͍͔ʹਓʑͷੜ࢈ੑΛߴΊΔ͔͕ݤ • ҒେͳData ScienJst݁Ռ͚ͩͰͳ͘ε τʔϦʔͰޠΕΔɻΞΧσϛʔքͰಉ͡ɻϓϩ ύΨϯμ͡Όμϝ͚ͩͲɻίϛϡχέʔγϣϯ͕ ॏཁ -
Keynote: Data VisualizaJon at the Point of Influence
• ߨԋऀ – Adam Bly SeedۀऀɾCEOɻՊֶతͳΞϓϩʔνͰ ٕज़ίϯαϧςʔγϣϯΛఏڙ • σʔλ͔ΒಘΒΕͨݟΛ͍͔ʹύϫϑϧͳ ετʔϦʔʹม͢Δ͔ʁݟΛ໌Β͔ʹ͢ Δ͚ͩͰͳ͍͔͘ʹཧղΛܹ͢Δ͔ʁ -
Keynote: Data VisualizaJon at the Point of Influence
• ٿ্ͷ70ԯਓ͕ՊֶతڭཆΛʹ͚ͭΔ ʹͲ͏͢ΕΑ͍͔ʁ ੈքதͷෳࡶͳग़དྷࣄΛͲ͏ͬͯՊֶతɺ ܦݧతɺཧੑతʹߟ͑Δ͜ͱ͕Ͱ͖Δ͔ʁ →ܳɺೝϓϩηεɺσβΠϯπʔϧ͕ॏ ཁ • ϏδϡΞϥΠθʔγϣϯͷख๏৽͘͠ͳ͘ͱ ʮ৽͍͠Data৽͍͠InsightΛͨΒ͢ʯ -
Closing Keynote: The Promise and Peril in the Human/
Technology RelaJonship • ߨԋऀ – Jonathan Harris ϓϩάϥϚʔɾΞʔςΟετɾετʔϦʔς ϥʔɻੈքܦࡁϑΥʔϥϜ2009 Young Global Leadersɻ࡞NY MOMAৗઃల ࣔɻTEDΧϯϑΝϨϯεεϐʔΧʔ • ਓؒͱٕज़ͷΑΓྑ͍ؔɺσʔλαΠΤϯ ε͕࣋ͭྗͰࣾձΛܗ࡞Δͱ͖ɺϏδωεͩ ͚Ͱͳ͘ਓʑʹରͯ͠Α͍׆༻Λ -
Closing Keynote: The Promise and Peril in the Human/
Technology RelaJonship -
Closing Keynote: The Promise and Peril in the Human/
Technology RelaJonship • σʔλ͕ϢϏΩλεʹͳΓ༧ଌੳϏδϡ ΞϥΠθʔγϣϯ৽͍͠ݟϏδωεػ ցΛͨΒ͕͢ɺ՝ͱͯ͠Δͷͦͷετ ϦʔΛ͍͔ʹਓʑʹ͑Δ͔ • ਓؒݸʑͷܦݧͱσʔλͷೝΛଚॏ͠ɺݚ ڀऀऀ༷ʑͳπʔϧख๏Λ׆༻͢Δ͜ͱ ͕ॏཁ -
Closing Keynote: The Promise and Peril in the Human/
Technology RelaJonship -
·ͱΊ • ͕͢͞ʹΞϝϦΧɺ͜ͷͰͷࢿճΓ࢝ Ί͍ͯΔײ͋Γ·͢ • ੳϓϩηεϏδωε׆༻ɺاۀจԽ ৫ʹߦ͖͔ͭ͘ͱɻఈ্͛େࣄ
• ϏσΦͪ͜ΒͰݟΒΕ·͢ – hbp://www.greenplum.com/datasciencesummit/