Upgrade to Pro — share decks privately, control downloads, hide ads and more …

A Computer Called "Watson"

Sponsored · Your Podcast. Everywhere. Effortlessly. Share. Educate. Inspire. Entertain. You do you. We'll handle the rest. →
Avatar for James Thomas James Thomas
September 17, 2012
Technology
1
470

A Computer Called "Watson"

LondonJS talk on the technology behind IBM Watson.

Avatar for James Thomas

James Thomas

September 17, 2012
Tweet

More Decks by James Thomas

See All by James Thomas
Apache OpenWhisk - Pluggable Event Providers
Avatar for James Thomas jthomas
0
440
Confessions of a (nervous) public speaker
Avatar for James Thomas jthomas
0
130
Serverless Machine Learning with TensorFlow.js
Avatar for James Thomas jthomas
1
780
Serverless: The Missing Manual
Avatar for James Thomas jthomas
1
2.3k
Serverless Swift with Apache OpenWhisk
Avatar for James Thomas jthomas
0
300
Serverless Backends and APIs using Swift and Apache OpenWhisk
Avatar for James Thomas jthomas
0
100
Predicting the impact of serverless computing, lessons from economic history
Avatar for James Thomas jthomas
0
130
Taming Serverless Dragons - Multi-Provider Serverless Apps
Avatar for James Thomas jthomas
0
3.2k
Microservices Without Servers
Avatar for James Thomas jthomas
2
2.9k

Other Decks in Technology

See All in Technology
超初心者からでも大丈夫！オープンソース半導体の楽しみ方〜今こそ！オレオレチップをつくろう〜
Avatar for Yamada3 keropiyo
0
110
セキュリティについて学ぶ会 / 2026 01 25 Takamatsu WordPress Meetup
Avatar for Rocket Martue rocketmartue
1
300
SREのプラクティスを用いた3領域同時 マネジメントへの挑戦 〜SRE・情シス・セキュリティを統合した チーム運営術〜
Avatar for coconala_engineer coconala_engineer
2
640
What happened to RubyGems and what can we learn?
Avatar for Mike McQuaid mikemcquaid
0
280
AIエージェントを開発しよう！-AgentCore活用の勘所-
Avatar for YukiOgawa yukiogawa
0
150
Claude_CodeでSEOを最適化する_AI_Ops_Community_Vol.2__マーケティングx_AIはここまで進化した.pdf
Avatar for 小笠原理久 riku_423
2
550
Cosmos World Foundation Model Platform for Physical AI
Avatar for Takuya MINAGAWA takmin
0
860
プロポーザルに込める段取り八分
Avatar for ShoheiMitani shoheimitani
1
220
配列に見る bash と zsh の違い
Avatar for kazzpapa3 kazzpapa3
1
140
Frontier Agents (Kiro autonomous agent / AWS Security Agent / AWS DevOps Agent) の紹介
Avatar for msysh msysh
3
170
Azure Durable Functions で作った NL2SQL Agent の精度向上に取り組んだ話/jat08
Avatar for TonyTonyKun thara0402
0
180
Webhook best practices for rock solid and resilient deployments
Avatar for Guillaume Laforge glaforge
1
280

Featured

See All Featured
End of SEO as We Know It (SMX Advanced Version)
Avatar for Michael King ipullrank
3
3.9k
Design in an AI World
Avatar for tapps tapps
0
140
Technical Leadership for Architectural Decision Making
Avatar for Kenny Baas-Schwegler baasie
1
240
It's Worth the Effort
Avatar for 3n 3n
188
29k
The AI Revolution Will Not Be Monopolized: How open-source beats economies of scale, even for LLMs
Avatar for Ines Montani inesmontani
PRO
3
3k
A better future with KSS
Avatar for Kyle Neath kneath
240
18k
jQuery: Nuts, Bolts and Bling
Avatar for Doug Neiner dougneiner
65
8.4k
Practical Orchestrator
Avatar for Shlomi Noach shlominoach
191
11k
Bridging the Design Gap: How Collaborative Modelling removes blockers to flow between stakeholders and teams @FastFlow conf
Avatar for Kenny Baas-Schwegler baasie
0
450
Jamie Indigo - Trashchat’s Guide to Black Boxes: Technical SEO Tactics for LLMs
Avatar for Tech SEO Connect techseoconnect
PRO
0
57
Helping Users Find Their Own Way: Creating Modern Search Experiences
Avatar for Dan Newman danielanewman
31
3.1k
RailsConf & Balkan Ruby 2019: The Past, Present, and Future of Rails at GitHub
Avatar for Eileen M. Uchitelle eileencodes
141
34k

Transcript

  1. A Computer Called “Watson” James Thomas, IBM Emerging Tech COVER

    PHOTO Add cover photo Monday, 17 September 2012

  2. GARY KASPAROV VERSUS “DEEP BLUE” MAY 1997 Monday, 17 September

    2012

  3. BLUE GENE DECEMBER 1999 Monday, 17 September 2012

  4. “Fast forward to 2004...” Monday, 17 September 2012

  5. JEOPARDY QUIZ SHOW Monday, 17 September 2012

  6. KEN JENNINGS CHAMPION OF CHAMPIONS Monday, 17 September 2012

  7. KEN JENNINGS CHAMPION OF CHAMPIONS KEN’S PERFORMANCE Monday, 17 September

    2012

  8. What if we build a computer to play Jeopardy? Monday,

    17 September 2012

  9. What if we build a computer to play Jeopardy? It’s

    way too hard Monday, 17 September 2012

  10. Jeopardy! Finite, mathematically defined search space Limited number of moves

    and states Symbols completed grounded in mathematical rules of the games Chess Enormous problem domain and search space Source material is inherently unstructured information Advanced natural language processing Monday, 17 September 2012

  11. BASELINE PERFORMANCE INITIAL EXPERIMENT Monday, 17 September 2012

  12. “Fast forward to 2007...” Monday, 17 September 2012

  13. DR. DAVID FERRUCCI - “WATSON” TEAM DIRECTOR 2007 - 2011

    Monday, 17 September 2012

  14. SIMULATING JEOPARDY! MATCHES Monday, 17 September 2012

  15. BASELINE PERFORMANCE INITIAL EXPERIMENT Monday, 17 September 2012

  16. WATSON WAS READY FEBRUARY 2011 Monday, 17 September 2012

  17. Watson Jeopardy! Challenge February 14-16 2011. Ken Jennings Brad Rutter

    Monday, 17 September 2012

  18. WATSON 1 - HUMANS 0 FEBRUARY 16, 2011 Monday, 17

    September 2012

  19. “Its largest airport is named for a WWII hero; its

    second largest, for a WWII battle” Category: US Cities Monday, 17 September 2012

  20. “Its largest airport is named for a WWII hero; its

    second largest, for a WWII battle” Category: US Cities Watson: Toronto Monday, 17 September 2012

  21. How does it work? Monday, 17 September 2012

  22. WATSON ARCHITECTURE - DEEPQA MASSIVELY PARALLEL PROBABILISTIC EVIDENCE-BASED ARCHITECTURE Monday,

    17 September 2012

  23. DEEPQA ARCHITECTURE PHASES Question Analysis Primary Search Candidate Answer Generation

    Evidence Retrieval Evidence Scoring Merging and Ranking Monday, 17 September 2012

  24. DEEPQA ARCHITECTURAL PHASES QUESTION ANALYSIS CATEGORY: CAPITALS QUESTION: WHAT IS

    THE CAPITAL OF SAMOA? Monday, 17 September 2012

  25. DEEPQA ARCHITECTURAL PHASES QUESTION ANALYSIS CATEGORY: POETS & POETRY QUESTION:

    HE WAS A BANK CLERK IN THE YUKON BEFORE HE PUBLISHED “SONGS OF SOURDOUGH” IN 1907. Monday, 17 September 2012

  26. DEEPQA ARCHITECTURAL PHASES QUESTION ANALYSIS CATEGORY: POETS & POETRY QUESTION:

    HE WAS A BANK CLERK IN THE YUKON BEFORE HE PUBLISHED “SONGS OF SOURDOUGH” IN 1907. DISCOVER: FOCUS Monday, 17 September 2012

  27. DEEPQA ARCHITECTURAL PHASES QUESTION ANALYSIS CATEGORY: POETS & POETRY QUESTION:

    HE WAS A BANK CLERK IN THE YUKON BEFORE HE PUBLISHED “SONGS OF SOURDOUGH” IN 1907. DISCOVER: LEXICAL ANSWER TYPE Monday, 17 September 2012

  28. DEEPQA ARCHITECTURAL PHASES QUESTION ANALYSIS CATEGORY: POETS & POETRY QUESTION:

    HE WAS A BANK CLERK IN THE YUKON BEFORE HE PUBLISHED “SONGS OF SOURDOUGH” IN 1907. DISCOVER: RELATIONSHIPS Monday, 17 September 2012

  29. DEEPQA ARCHITECTURAL PHASES QUESTION ANALYSIS CATEGORY: POETS & POETRY QUESTION:

    HE WAS A BANK CLERK IN THE YUKON BEFORE HE PUBLISHED “SONGS OF SOURDOUGH” IN 1907. DISCOVER: QUESTION CLASS Monday, 17 September 2012

  30. DEEPQA ARCHITECTURAL PHASES HYPOTHESIS GENERATION Hypothesis generation consists of two

    phases... Monday, 17 September 2012

  31. DEEPQA ARCHITECTURAL PHASES HYPOTHESIS GENERATION Primary Search Monday, 17 September

    2012

  32. DEEPQA ARCHITECTURAL PHASES HYPOTHESIS GENERATION Data Sources - Unstructured Wikipedia

    IMDb Encyclopaedias Dictionaries Thesauri Literary Works Newswire Articles Monday, 17 September 2012

  33. DEEPQA ARCHITECTURAL PHASES HYPOTHESIS GENERATION Data Sources - Structured DBpedia

    Wordnet YAGO Monday, 17 September 2012

  34. DEEPQA ARCHITECTURAL PHASES HYPOTHESIS GENERATION Candidate Answer Generation Monday, 17

    September 2012

  35. DEEPQA ARCHITECTURAL PHASES EVIDENCE RETRIEVAL Watson then searches for additional

    evidence... Monday, 17 September 2012

  36. DEEPQA ARCHITECTURAL PHASES EVIDENCE SCORING Deep Scoring Monday, 17 September

    2012

  37. DEEPQA ARCHITECTURAL PHASES EVIDENCE SCORING 0 0.25 0.5 0.75 1

    Temporal Geospatial LAT Popularity Deep Scoring Christopher Columbus Vasco De Gamma Monday, 17 September 2012

  38. DEEPQA ARCHITECTURAL PHASES FINAL MERGING AND RANKING Answer Merging Monday,

    17 September 2012

  39. DEEPQA ARCHITECTURAL PHASES FINAL MERGING AND RANKING Answer Merging Monday,

    17 September 2012

  40. DEEPQA ARCHITECTURAL PHASES FINAL MERGING AND RANKING Answer Ranking ISAAC

    NEWTON [0.10, 0.45 ... 0.78, 0.12] ??? ANSWER SCORES RANK EDMOND HALLEY [0.31, 0.52 ... 0.08, 0.72] ??? WILHELM TEMPEL [0.21, 0.54 ... 0.18, 0.92] ??? PETER SELLERS [0.14, 0.04 ... 0.25, 0.41] ??? Monday, 17 September 2012

  41. DEEPQA ARCHITECTURAL PHASES FINAL MERGING AND RANKING Monday, 17 September

    2012

  42. DEEPQA ARCHITECTURAL PHASES FINAL MERGING AND RANKING Answer Ranking ISAAC

    NEWTON [0.10 ... 0.12] 3 ANSWER SCORES RANK EDMOND HALLEY [0.31 ... 0.72] 1 WILHELM TEMPEL [0.21 ... 0.92] 2 PETER SELLERS [0.14 ... 0.41] 4 0.14 CONFIDENCE 0.78 0.34 0.04 Monday, 17 September 2012

  43. DEEPQA PERFORMANCE SCALING CHALLENGES Need to answer within a few

    seconds.... Monday, 17 September 2012

  44. DEEPQA PERFORMANCE SCALING CHALLENGES Need to answer within a few

    seconds.... Early implementation took over two hours Monday, 17 September 2012

  45. SCALING WATSON Monday, 17 September 2012

  46. WATSON HARDWARE NINETY POWER 750 SERVERS 2880 POWER7 PROCESSOR CORES

    16 TERABYTES OF RAM Monday, 17 September 2012

  47. WATSON 1 - HUMANS 0 FEBRUARY 16, 2011 Monday, 17

    September 2012

  48. PUTTING WATSON TO WORK What’s next? Monday, 17 September 2012

  49. PUTTING WATSON TO WORK HEALTHCARE Monday, 17 September 2012

  50. QUESTIONS? Monday, 17 September 2012