Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
A Computer Called "Watson"
Search
James Thomas
September 17, 2012
Technology
1
440
A Computer Called "Watson"
LondonJS talk on the technology behind IBM Watson.
James Thomas
September 17, 2012
Tweet
Share
More Decks by James Thomas
See All by James Thomas
Apache OpenWhisk - Pluggable Event Providers
jthomas
0
410
Confessions of a (nervous) public speaker
jthomas
0
120
Serverless Machine Learning with TensorFlow.js
jthomas
1
760
Serverless: The Missing Manual
jthomas
1
2.3k
Serverless Swift with Apache OpenWhisk
jthomas
0
290
Serverless Backends and APIs using Swift and Apache OpenWhisk
jthomas
0
94
Predicting the impact of serverless computing, lessons from economic history
jthomas
0
120
Taming Serverless Dragons - Multi-Provider Serverless Apps
jthomas
0
3.1k
Microservices Without Servers
jthomas
2
2.8k
Other Decks in Technology
See All in Technology
カミナシ社の『ID管理基盤』製品内製 - その意思決定背景と2年間の進化 #AWSUnicornDay / Kaminashi ID - The Big Whys
kaminashi
1
320
どこで動かすか、誰が動かすか 〜 kintoneのインフラ基盤刷新と運用体制のシフト 〜
ueokande
0
200
Figma + Storybook + PlaywrightのMCPを使ったフロントエンド開発
yug1224
10
3.3k
モダンフロントエンド 開発研修
recruitengineers
PRO
6
3.7k
Jaws-ug名古屋_LT資料_20250829
azoo2024
3
180
モダンな現場と従来型の組織——そこに生じる "不整合" を解消してこそチームがパフォーマンスを発揮できる / Team-oriented Organization Design 20250825
mtx2s
6
35k
フルカイテン株式会社 エンジニア向け採用資料
fullkaiten
0
8.6k
Vault meets Kubernetes
mochizuki875
0
130
衝突して強くなる! BLUE GIANTと アジャイルチームの共通点とは ― いきいきと活気に満ちたグルーヴあるチームを作るコツ ― / BLUE GIANT and Agile Teams
naitosatoshi
0
190
攻撃と防御で実践するプロダクトセキュリティ演習~導入パート~
recruitengineers
PRO
3
1.3k
JuniorからSeniorまで: DevOpsエンジニアの成長ロードマップ
yuriemori
2
310
Evolution on AI Agent and Beyond - AGI への道のりと、シンギュラリティの3つのシナリオ
masayamoriofficial
0
260
Featured
See All Featured
Save Time (by Creating Custom Rails Generators)
garrettdimon
PRO
32
1.4k
The Art of Programming - Codeland 2020
erikaheidi
55
13k
Making the Leap to Tech Lead
cromwellryan
134
9.5k
Chrome DevTools: State of the Union 2024 - Debugging React & Beyond
addyosmani
7
830
Large-scale JavaScript Application Architecture
addyosmani
512
110k
The Cost Of JavaScript in 2023
addyosmani
53
8.8k
How To Stay Up To Date on Web Technology
chriscoyier
790
250k
Music & Morning Musume
bryan
46
6.8k
Producing Creativity
orderedlist
PRO
347
40k
The MySQL Ecosystem @ GitHub 2015
samlambert
251
13k
Reflections from 52 weeks, 52 projects
jeffersonlam
351
21k
Imperfection Machines: The Place of Print at Facebook
scottboms
268
13k
Transcript
A Computer Called “Watson” James Thomas, IBM Emerging Tech COVER
PHOTO Add cover photo Monday, 17 September 2012
GARY KASPAROV VERSUS “DEEP BLUE” MAY 1997 Monday, 17 September
2012
BLUE GENE DECEMBER 1999 Monday, 17 September 2012
“Fast forward to 2004...” Monday, 17 September 2012
JEOPARDY QUIZ SHOW Monday, 17 September 2012
KEN JENNINGS CHAMPION OF CHAMPIONS Monday, 17 September 2012
KEN JENNINGS CHAMPION OF CHAMPIONS KEN’S PERFORMANCE Monday, 17 September
2012
What if we build a computer to play Jeopardy? Monday,
17 September 2012
What if we build a computer to play Jeopardy? It’s
way too hard Monday, 17 September 2012
Jeopardy! Finite, mathematically defined search space Limited number of moves
and states Symbols completed grounded in mathematical rules of the games Chess Enormous problem domain and search space Source material is inherently unstructured information Advanced natural language processing Monday, 17 September 2012
BASELINE PERFORMANCE INITIAL EXPERIMENT Monday, 17 September 2012
“Fast forward to 2007...” Monday, 17 September 2012
DR. DAVID FERRUCCI - “WATSON” TEAM DIRECTOR 2007 - 2011
Monday, 17 September 2012
SIMULATING JEOPARDY! MATCHES Monday, 17 September 2012
BASELINE PERFORMANCE INITIAL EXPERIMENT Monday, 17 September 2012
WATSON WAS READY FEBRUARY 2011 Monday, 17 September 2012
Watson Jeopardy! Challenge February 14-16 2011. Ken Jennings Brad Rutter
Monday, 17 September 2012
WATSON 1 - HUMANS 0 FEBRUARY 16, 2011 Monday, 17
September 2012
“Its largest airport is named for a WWII hero; its
second largest, for a WWII battle” Category: US Cities Monday, 17 September 2012
“Its largest airport is named for a WWII hero; its
second largest, for a WWII battle” Category: US Cities Watson: Toronto Monday, 17 September 2012
How does it work? Monday, 17 September 2012
WATSON ARCHITECTURE - DEEPQA MASSIVELY PARALLEL PROBABILISTIC EVIDENCE-BASED ARCHITECTURE Monday,
17 September 2012
DEEPQA ARCHITECTURE PHASES Question Analysis Primary Search Candidate Answer Generation
Evidence Retrieval Evidence Scoring Merging and Ranking Monday, 17 September 2012
DEEPQA ARCHITECTURAL PHASES QUESTION ANALYSIS CATEGORY: CAPITALS QUESTION: WHAT IS
THE CAPITAL OF SAMOA? Monday, 17 September 2012
DEEPQA ARCHITECTURAL PHASES QUESTION ANALYSIS CATEGORY: POETS & POETRY QUESTION:
HE WAS A BANK CLERK IN THE YUKON BEFORE HE PUBLISHED “SONGS OF SOURDOUGH” IN 1907. Monday, 17 September 2012
DEEPQA ARCHITECTURAL PHASES QUESTION ANALYSIS CATEGORY: POETS & POETRY QUESTION:
HE WAS A BANK CLERK IN THE YUKON BEFORE HE PUBLISHED “SONGS OF SOURDOUGH” IN 1907. DISCOVER: FOCUS Monday, 17 September 2012
DEEPQA ARCHITECTURAL PHASES QUESTION ANALYSIS CATEGORY: POETS & POETRY QUESTION:
HE WAS A BANK CLERK IN THE YUKON BEFORE HE PUBLISHED “SONGS OF SOURDOUGH” IN 1907. DISCOVER: LEXICAL ANSWER TYPE Monday, 17 September 2012
DEEPQA ARCHITECTURAL PHASES QUESTION ANALYSIS CATEGORY: POETS & POETRY QUESTION:
HE WAS A BANK CLERK IN THE YUKON BEFORE HE PUBLISHED “SONGS OF SOURDOUGH” IN 1907. DISCOVER: RELATIONSHIPS Monday, 17 September 2012
DEEPQA ARCHITECTURAL PHASES QUESTION ANALYSIS CATEGORY: POETS & POETRY QUESTION:
HE WAS A BANK CLERK IN THE YUKON BEFORE HE PUBLISHED “SONGS OF SOURDOUGH” IN 1907. DISCOVER: QUESTION CLASS Monday, 17 September 2012
DEEPQA ARCHITECTURAL PHASES HYPOTHESIS GENERATION Hypothesis generation consists of two
phases... Monday, 17 September 2012
DEEPQA ARCHITECTURAL PHASES HYPOTHESIS GENERATION Primary Search Monday, 17 September
2012
DEEPQA ARCHITECTURAL PHASES HYPOTHESIS GENERATION Data Sources - Unstructured Wikipedia
IMDb Encyclopaedias Dictionaries Thesauri Literary Works Newswire Articles Monday, 17 September 2012
DEEPQA ARCHITECTURAL PHASES HYPOTHESIS GENERATION Data Sources - Structured DBpedia
Wordnet YAGO Monday, 17 September 2012
DEEPQA ARCHITECTURAL PHASES HYPOTHESIS GENERATION Candidate Answer Generation Monday, 17
September 2012
DEEPQA ARCHITECTURAL PHASES EVIDENCE RETRIEVAL Watson then searches for additional
evidence... Monday, 17 September 2012
DEEPQA ARCHITECTURAL PHASES EVIDENCE SCORING Deep Scoring Monday, 17 September
2012
DEEPQA ARCHITECTURAL PHASES EVIDENCE SCORING 0 0.25 0.5 0.75 1
Temporal Geospatial LAT Popularity Deep Scoring Christopher Columbus Vasco De Gamma Monday, 17 September 2012
DEEPQA ARCHITECTURAL PHASES FINAL MERGING AND RANKING Answer Merging Monday,
17 September 2012
DEEPQA ARCHITECTURAL PHASES FINAL MERGING AND RANKING Answer Merging Monday,
17 September 2012
DEEPQA ARCHITECTURAL PHASES FINAL MERGING AND RANKING Answer Ranking ISAAC
NEWTON [0.10, 0.45 ... 0.78, 0.12] ??? ANSWER SCORES RANK EDMOND HALLEY [0.31, 0.52 ... 0.08, 0.72] ??? WILHELM TEMPEL [0.21, 0.54 ... 0.18, 0.92] ??? PETER SELLERS [0.14, 0.04 ... 0.25, 0.41] ??? Monday, 17 September 2012
DEEPQA ARCHITECTURAL PHASES FINAL MERGING AND RANKING Monday, 17 September
2012
DEEPQA ARCHITECTURAL PHASES FINAL MERGING AND RANKING Answer Ranking ISAAC
NEWTON [0.10 ... 0.12] 3 ANSWER SCORES RANK EDMOND HALLEY [0.31 ... 0.72] 1 WILHELM TEMPEL [0.21 ... 0.92] 2 PETER SELLERS [0.14 ... 0.41] 4 0.14 CONFIDENCE 0.78 0.34 0.04 Monday, 17 September 2012
DEEPQA PERFORMANCE SCALING CHALLENGES Need to answer within a few
seconds.... Monday, 17 September 2012
DEEPQA PERFORMANCE SCALING CHALLENGES Need to answer within a few
seconds.... Early implementation took over two hours Monday, 17 September 2012
SCALING WATSON Monday, 17 September 2012
WATSON HARDWARE NINETY POWER 750 SERVERS 2880 POWER7 PROCESSOR CORES
16 TERABYTES OF RAM Monday, 17 September 2012
WATSON 1 - HUMANS 0 FEBRUARY 16, 2011 Monday, 17
September 2012
PUTTING WATSON TO WORK What’s next? Monday, 17 September 2012
PUTTING WATSON TO WORK HEALTHCARE Monday, 17 September 2012
QUESTIONS? Monday, 17 September 2012