Upgrade to Pro — share decks privately, control downloads, hide ads and more …

A Computer Called "Watson"

Dad87927739931f134c5b1242e3d04bc?s=47 James Thomas
September 17, 2012
Technology
1
240

A Computer Called "Watson"

LondonJS talk on the technology behind IBM Watson.

Dad87927739931f134c5b1242e3d04bc?s=128

James Thomas

September 17, 2012
Tweet

More Decks by James Thomas

See All by James Thomas
Dad87927739931f134c5b1242e3d04bc?s=48 jthomas
0
100
Dad87927739931f134c5b1242e3d04bc?s=48 jthomas
0
61
Dad87927739931f134c5b1242e3d04bc?s=48 jthomas
1
460
Dad87927739931f134c5b1242e3d04bc?s=48 jthomas
1
1.8k
Dad87927739931f134c5b1242e3d04bc?s=48 jthomas
0
180
Dad87927739931f134c5b1242e3d04bc?s=48 jthomas
0
45
Dad87927739931f134c5b1242e3d04bc?s=48 jthomas
0
95
Dad87927739931f134c5b1242e3d04bc?s=48 jthomas
0
2.5k
Dad87927739931f134c5b1242e3d04bc?s=48 jthomas
2
2.4k

Other Decks in Technology

See All in Technology
35f1e35d8c02c612e281c6c7a9d22341?s=48 hirosys
0
150
F593efb2c199100c8086dbf130c71ffa?s=48 helayoty
0
140
D683c1df0b6584c3f1e279ef6c8c04f9?s=48 layerx
1
1k
96de66872f54da75c05c881c7a3713ce?s=48 kenya888
1
140
A500dfe11c36aa2912eaf33176fe129f?s=48 oyakata2438
0
400
11d5350db3f389d0f5749b91ee11a916?s=48 indigo13love
2
620
1d1580fb0945b0ffadff18e28bead3c5?s=48 adarapata
2
480
3f848c0c0b9a6603894e157da93e4655?s=48 sadayoshitada0919
1
600
93c80c388fe9d8f9df7d030549a0ff0b?s=48 chaspy
1
470
6f8c7b050e551df51ac90c013eee164f?s=48 nozomiito
0
200
A645e7c3a6635ead8fa323c583769591?s=48 hololab
0
360
9e7a653ed313b3da4b263a772bfc5026?s=48 clustervr
0
210

Featured

See All Featured
766b9746b59e6f09e280cd33cf4ed419?s=48 skipperchong
7
670
8081b26e05bb4354f7d65ffc34cbbd67?s=48 chriscoyier
780
240k
245cee81a9c424266e5e401d844ea881?s=48 lara
16
2.6k
C1daf20e5c49ff910745198ef9869ac2?s=48 hatefulcrawdad
257
17k
Dafc4723e9a1c067796c0fec6f509774?s=48 lemiorhan
627
43k
F29327647a9cff5c69618bae420792ea?s=48 tenderlove
52
3.4k
7cbd3f5f922d798cc312eaf596de7ae6?s=48 iamctodd
17
1.9k
4394ceb8b277f35ee3da7030384efb5d?s=48 davidbonilla
70
3.5k
5b6a2bd86ef643786a381a212e0ef2f1?s=48 geoffreycrofte
19
820
1f74b13f1e5c6c69cb5d7fbaabb1e2cb?s=48 sferik
610
54k
64827b31aef81498662e8af4bd6d5157?s=48 jonrohan
1021
380k
20bfe76b3d6105641f879fe45cfc9272?s=48 bkeepers
52
4.2k

Transcript

  1. A Computer Called “Watson” James Thomas, IBM Emerging Tech COVER

    PHOTO Add cover photo Monday, 17 September 2012

  2. GARY KASPAROV VERSUS “DEEP BLUE” MAY 1997 Monday, 17 September

    2012

  3. BLUE GENE DECEMBER 1999 Monday, 17 September 2012

  4. “Fast forward to 2004...” Monday, 17 September 2012

  5. JEOPARDY QUIZ SHOW Monday, 17 September 2012

  6. KEN JENNINGS CHAMPION OF CHAMPIONS Monday, 17 September 2012

  7. KEN JENNINGS CHAMPION OF CHAMPIONS KEN’S PERFORMANCE Monday, 17 September

    2012

  8. What if we build a computer to play Jeopardy? Monday,

    17 September 2012

  9. What if we build a computer to play Jeopardy? It’s

    way too hard Monday, 17 September 2012

  10. Jeopardy! Finite, mathematically defined search space Limited number of moves

    and states Symbols completed grounded in mathematical rules of the games Chess Enormous problem domain and search space Source material is inherently unstructured information Advanced natural language processing Monday, 17 September 2012

  11. BASELINE PERFORMANCE INITIAL EXPERIMENT Monday, 17 September 2012

  12. “Fast forward to 2007...” Monday, 17 September 2012

  13. DR. DAVID FERRUCCI - “WATSON” TEAM DIRECTOR 2007 - 2011

    Monday, 17 September 2012

  14. SIMULATING JEOPARDY! MATCHES Monday, 17 September 2012

  15. BASELINE PERFORMANCE INITIAL EXPERIMENT Monday, 17 September 2012

  16. WATSON WAS READY FEBRUARY 2011 Monday, 17 September 2012

  17. Watson Jeopardy! Challenge February 14-16 2011. Ken Jennings Brad Rutter

    Monday, 17 September 2012

  18. WATSON 1 - HUMANS 0 FEBRUARY 16, 2011 Monday, 17

    September 2012

  19. “Its largest airport is named for a WWII hero; its

    second largest, for a WWII battle” Category: US Cities Monday, 17 September 2012

  20. “Its largest airport is named for a WWII hero; its

    second largest, for a WWII battle” Category: US Cities Watson: Toronto Monday, 17 September 2012

  21. How does it work? Monday, 17 September 2012

  22. WATSON ARCHITECTURE - DEEPQA MASSIVELY PARALLEL PROBABILISTIC EVIDENCE-BASED ARCHITECTURE Monday,

    17 September 2012

  23. DEEPQA ARCHITECTURE PHASES Question Analysis Primary Search Candidate Answer Generation

    Evidence Retrieval Evidence Scoring Merging and Ranking Monday, 17 September 2012

  24. DEEPQA ARCHITECTURAL PHASES QUESTION ANALYSIS CATEGORY: CAPITALS QUESTION: WHAT IS

    THE CAPITAL OF SAMOA? Monday, 17 September 2012

  25. DEEPQA ARCHITECTURAL PHASES QUESTION ANALYSIS CATEGORY: POETS & POETRY QUESTION:

    HE WAS A BANK CLERK IN THE YUKON BEFORE HE PUBLISHED “SONGS OF SOURDOUGH” IN 1907. Monday, 17 September 2012

  26. DEEPQA ARCHITECTURAL PHASES QUESTION ANALYSIS CATEGORY: POETS & POETRY QUESTION:

    HE WAS A BANK CLERK IN THE YUKON BEFORE HE PUBLISHED “SONGS OF SOURDOUGH” IN 1907. DISCOVER: FOCUS Monday, 17 September 2012

  27. DEEPQA ARCHITECTURAL PHASES QUESTION ANALYSIS CATEGORY: POETS & POETRY QUESTION:

    HE WAS A BANK CLERK IN THE YUKON BEFORE HE PUBLISHED “SONGS OF SOURDOUGH” IN 1907. DISCOVER: LEXICAL ANSWER TYPE Monday, 17 September 2012

  28. DEEPQA ARCHITECTURAL PHASES QUESTION ANALYSIS CATEGORY: POETS & POETRY QUESTION:

    HE WAS A BANK CLERK IN THE YUKON BEFORE HE PUBLISHED “SONGS OF SOURDOUGH” IN 1907. DISCOVER: RELATIONSHIPS Monday, 17 September 2012

  29. DEEPQA ARCHITECTURAL PHASES QUESTION ANALYSIS CATEGORY: POETS & POETRY QUESTION:

    HE WAS A BANK CLERK IN THE YUKON BEFORE HE PUBLISHED “SONGS OF SOURDOUGH” IN 1907. DISCOVER: QUESTION CLASS Monday, 17 September 2012

  30. DEEPQA ARCHITECTURAL PHASES HYPOTHESIS GENERATION Hypothesis generation consists of two

    phases... Monday, 17 September 2012

  31. DEEPQA ARCHITECTURAL PHASES HYPOTHESIS GENERATION Primary Search Monday, 17 September

    2012

  32. DEEPQA ARCHITECTURAL PHASES HYPOTHESIS GENERATION Data Sources - Unstructured Wikipedia

    IMDb Encyclopaedias Dictionaries Thesauri Literary Works Newswire Articles Monday, 17 September 2012

  33. DEEPQA ARCHITECTURAL PHASES HYPOTHESIS GENERATION Data Sources - Structured DBpedia

    Wordnet YAGO Monday, 17 September 2012

  34. DEEPQA ARCHITECTURAL PHASES HYPOTHESIS GENERATION Candidate Answer Generation Monday, 17

    September 2012

  35. DEEPQA ARCHITECTURAL PHASES EVIDENCE RETRIEVAL Watson then searches for additional

    evidence... Monday, 17 September 2012

  36. DEEPQA ARCHITECTURAL PHASES EVIDENCE SCORING Deep Scoring Monday, 17 September

    2012

  37. DEEPQA ARCHITECTURAL PHASES EVIDENCE SCORING 0 0.25 0.5 0.75 1

    Temporal Geospatial LAT Popularity Deep Scoring Christopher Columbus Vasco De Gamma Monday, 17 September 2012

  38. DEEPQA ARCHITECTURAL PHASES FINAL MERGING AND RANKING Answer Merging Monday,

    17 September 2012

  39. DEEPQA ARCHITECTURAL PHASES FINAL MERGING AND RANKING Answer Merging Monday,

    17 September 2012

  40. DEEPQA ARCHITECTURAL PHASES FINAL MERGING AND RANKING Answer Ranking ISAAC

    NEWTON [0.10, 0.45 ... 0.78, 0.12] ??? ANSWER SCORES RANK EDMOND HALLEY [0.31, 0.52 ... 0.08, 0.72] ??? WILHELM TEMPEL [0.21, 0.54 ... 0.18, 0.92] ??? PETER SELLERS [0.14, 0.04 ... 0.25, 0.41] ??? Monday, 17 September 2012

  41. DEEPQA ARCHITECTURAL PHASES FINAL MERGING AND RANKING Monday, 17 September

    2012

  42. DEEPQA ARCHITECTURAL PHASES FINAL MERGING AND RANKING Answer Ranking ISAAC

    NEWTON [0.10 ... 0.12] 3 ANSWER SCORES RANK EDMOND HALLEY [0.31 ... 0.72] 1 WILHELM TEMPEL [0.21 ... 0.92] 2 PETER SELLERS [0.14 ... 0.41] 4 0.14 CONFIDENCE 0.78 0.34 0.04 Monday, 17 September 2012

  43. DEEPQA PERFORMANCE SCALING CHALLENGES Need to answer within a few

    seconds.... Monday, 17 September 2012

  44. DEEPQA PERFORMANCE SCALING CHALLENGES Need to answer within a few

    seconds.... Early implementation took over two hours Monday, 17 September 2012

  45. SCALING WATSON Monday, 17 September 2012

  46. WATSON HARDWARE NINETY POWER 750 SERVERS 2880 POWER7 PROCESSOR CORES

    16 TERABYTES OF RAM Monday, 17 September 2012

  47. WATSON 1 - HUMANS 0 FEBRUARY 16, 2011 Monday, 17

    September 2012

  48. PUTTING WATSON TO WORK What’s next? Monday, 17 September 2012

  49. PUTTING WATSON TO WORK HEALTHCARE Monday, 17 September 2012

  50. QUESTIONS? Monday, 17 September 2012