Upgrade to Pro — share decks privately, control downloads, hide ads and more …

A Computer Called "Watson"

James Thomas
September 17, 2012

A Computer Called "Watson"

LondonJS talk on the technology behind IBM Watson.

James Thomas

September 17, 2012
Tweet

More Decks by James Thomas

Other Decks in Technology

Transcript

  1. A Computer Called “Watson” James Thomas, IBM Emerging Tech COVER

    PHOTO Add cover photo Monday, 17 September 2012
  2. What if we build a computer to play Jeopardy? It’s

    way too hard Monday, 17 September 2012
  3. Jeopardy! Finite, mathematically defined search space Limited number of moves

    and states Symbols completed grounded in mathematical rules of the games Chess Enormous problem domain and search space Source material is inherently unstructured information Advanced natural language processing Monday, 17 September 2012
  4. “Its largest airport is named for a WWII hero; its

    second largest, for a WWII battle” Category: US Cities Monday, 17 September 2012
  5. “Its largest airport is named for a WWII hero; its

    second largest, for a WWII battle” Category: US Cities Watson: Toronto Monday, 17 September 2012
  6. DEEPQA ARCHITECTURE PHASES Question Analysis Primary Search Candidate Answer Generation

    Evidence Retrieval Evidence Scoring Merging and Ranking Monday, 17 September 2012
  7. DEEPQA ARCHITECTURAL PHASES QUESTION ANALYSIS CATEGORY: POETS & POETRY QUESTION:

    HE WAS A BANK CLERK IN THE YUKON BEFORE HE PUBLISHED “SONGS OF SOURDOUGH” IN 1907. Monday, 17 September 2012
  8. DEEPQA ARCHITECTURAL PHASES QUESTION ANALYSIS CATEGORY: POETS & POETRY QUESTION:

    HE WAS A BANK CLERK IN THE YUKON BEFORE HE PUBLISHED “SONGS OF SOURDOUGH” IN 1907. DISCOVER: FOCUS Monday, 17 September 2012
  9. DEEPQA ARCHITECTURAL PHASES QUESTION ANALYSIS CATEGORY: POETS & POETRY QUESTION:

    HE WAS A BANK CLERK IN THE YUKON BEFORE HE PUBLISHED “SONGS OF SOURDOUGH” IN 1907. DISCOVER: LEXICAL ANSWER TYPE Monday, 17 September 2012
  10. DEEPQA ARCHITECTURAL PHASES QUESTION ANALYSIS CATEGORY: POETS & POETRY QUESTION:

    HE WAS A BANK CLERK IN THE YUKON BEFORE HE PUBLISHED “SONGS OF SOURDOUGH” IN 1907. DISCOVER: RELATIONSHIPS Monday, 17 September 2012
  11. DEEPQA ARCHITECTURAL PHASES QUESTION ANALYSIS CATEGORY: POETS & POETRY QUESTION:

    HE WAS A BANK CLERK IN THE YUKON BEFORE HE PUBLISHED “SONGS OF SOURDOUGH” IN 1907. DISCOVER: QUESTION CLASS Monday, 17 September 2012
  12. DEEPQA ARCHITECTURAL PHASES HYPOTHESIS GENERATION Data Sources - Unstructured Wikipedia

    IMDb Encyclopaedias Dictionaries Thesauri Literary Works Newswire Articles Monday, 17 September 2012
  13. DEEPQA ARCHITECTURAL PHASES EVIDENCE SCORING 0 0.25 0.5 0.75 1

    Temporal Geospatial LAT Popularity Deep Scoring Christopher Columbus Vasco De Gamma Monday, 17 September 2012
  14. DEEPQA ARCHITECTURAL PHASES FINAL MERGING AND RANKING Answer Ranking ISAAC

    NEWTON [0.10, 0.45 ... 0.78, 0.12] ??? ANSWER SCORES RANK EDMOND HALLEY [0.31, 0.52 ... 0.08, 0.72] ??? WILHELM TEMPEL [0.21, 0.54 ... 0.18, 0.92] ??? PETER SELLERS [0.14, 0.04 ... 0.25, 0.41] ??? Monday, 17 September 2012
  15. DEEPQA ARCHITECTURAL PHASES FINAL MERGING AND RANKING Answer Ranking ISAAC

    NEWTON [0.10 ... 0.12] 3 ANSWER SCORES RANK EDMOND HALLEY [0.31 ... 0.72] 1 WILHELM TEMPEL [0.21 ... 0.92] 2 PETER SELLERS [0.14 ... 0.41] 4 0.14 CONFIDENCE 0.78 0.34 0.04 Monday, 17 September 2012
  16. DEEPQA PERFORMANCE SCALING CHALLENGES Need to answer within a few

    seconds.... Early implementation took over two hours Monday, 17 September 2012
  17. WATSON HARDWARE NINETY POWER 750 SERVERS 2880 POWER7 PROCESSOR CORES

    16 TERABYTES OF RAM Monday, 17 September 2012