Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
A Computer Called "Watson"
Search
James Thomas
September 17, 2012
Technology
1
450
A Computer Called "Watson"
LondonJS talk on the technology behind IBM Watson.
James Thomas
September 17, 2012
Tweet
Share
More Decks by James Thomas
See All by James Thomas
Apache OpenWhisk - Pluggable Event Providers
jthomas
0
420
Confessions of a (nervous) public speaker
jthomas
0
120
Serverless Machine Learning with TensorFlow.js
jthomas
1
760
Serverless: The Missing Manual
jthomas
1
2.3k
Serverless Swift with Apache OpenWhisk
jthomas
0
290
Serverless Backends and APIs using Swift and Apache OpenWhisk
jthomas
0
94
Predicting the impact of serverless computing, lessons from economic history
jthomas
0
120
Taming Serverless Dragons - Multi-Provider Serverless Apps
jthomas
0
3.1k
Microservices Without Servers
jthomas
2
2.8k
Other Decks in Technology
See All in Technology
なぜスクラムはこうなったのか?歴史が教えてくれたこと/Shall we explore the roots of Scrum
sanogemaru
5
1.6k
react-callを使ってダイヤログをいろんなとこで再利用しよう!
shinaps
2
260
roppongirb_20250911
igaiga
1
240
Rustから学ぶ 非同期処理の仕組み
skanehira
1
150
なぜテストマネージャの視点が 必要なのか? 〜 一歩先へ進むために 〜
moritamasami
0
230
RSCの時代にReactとフレームワークの境界を探る
uhyo
10
3.5k
スマートファクトリーの第一歩 〜AWSマネージドサービスで 実現する予知保全と生成AI活用まで
ganota
2
280
企業の生成AIガバナンスにおけるエージェントとセキュリティ
lycorptech_jp
PRO
2
190
AIエージェントで90秒の広告動画を制作!台本・音声・映像・編集をつなぐAWS最新アーキテクチャの実践
nasuvitz
3
320
COVESA VSSによる車両データモデルの標準化とAWS IoT FleetWiseの活用
osawa
1
350
職種の壁を溶かして開発サイクルを高速に回す~情報透明性と職種越境から考えるAIフレンドリーな職種間連携~
daitasu
0
170
未経験者・初心者に贈る!40分でわかるAndroidアプリ開発の今と大事なポイント
operando
5
730
Featured
See All Featured
VelocityConf: Rendering Performance Case Studies
addyosmani
332
24k
Six Lessons from altMBA
skipperchong
28
4k
A designer walks into a library…
pauljervisheath
207
24k
Code Review Best Practice
trishagee
71
19k
実際に使うSQLの書き方 徹底解説 / pgcon21j-tutorial
soudai
PRO
188
55k
The Art of Delivering Value - GDevCon NA Keynote
reverentgeek
15
1.7k
Typedesign – Prime Four
hannesfritz
42
2.8k
The Straight Up "How To Draw Better" Workshop
denniskardys
236
140k
The Web Performance Landscape in 2024 [PerfNow 2024]
tammyeverts
9
810
No one is an island. Learnings from fostering a developers community.
thoeni
21
3.4k
Optimizing for Happiness
mojombo
379
70k
Fireside Chat
paigeccino
39
3.6k
Transcript
A Computer Called “Watson” James Thomas, IBM Emerging Tech COVER
PHOTO Add cover photo Monday, 17 September 2012
GARY KASPAROV VERSUS “DEEP BLUE” MAY 1997 Monday, 17 September
2012
BLUE GENE DECEMBER 1999 Monday, 17 September 2012
“Fast forward to 2004...” Monday, 17 September 2012
JEOPARDY QUIZ SHOW Monday, 17 September 2012
KEN JENNINGS CHAMPION OF CHAMPIONS Monday, 17 September 2012
KEN JENNINGS CHAMPION OF CHAMPIONS KEN’S PERFORMANCE Monday, 17 September
2012
What if we build a computer to play Jeopardy? Monday,
17 September 2012
What if we build a computer to play Jeopardy? It’s
way too hard Monday, 17 September 2012
Jeopardy! Finite, mathematically defined search space Limited number of moves
and states Symbols completed grounded in mathematical rules of the games Chess Enormous problem domain and search space Source material is inherently unstructured information Advanced natural language processing Monday, 17 September 2012
BASELINE PERFORMANCE INITIAL EXPERIMENT Monday, 17 September 2012
“Fast forward to 2007...” Monday, 17 September 2012
DR. DAVID FERRUCCI - “WATSON” TEAM DIRECTOR 2007 - 2011
Monday, 17 September 2012
SIMULATING JEOPARDY! MATCHES Monday, 17 September 2012
BASELINE PERFORMANCE INITIAL EXPERIMENT Monday, 17 September 2012
WATSON WAS READY FEBRUARY 2011 Monday, 17 September 2012
Watson Jeopardy! Challenge February 14-16 2011. Ken Jennings Brad Rutter
Monday, 17 September 2012
WATSON 1 - HUMANS 0 FEBRUARY 16, 2011 Monday, 17
September 2012
“Its largest airport is named for a WWII hero; its
second largest, for a WWII battle” Category: US Cities Monday, 17 September 2012
“Its largest airport is named for a WWII hero; its
second largest, for a WWII battle” Category: US Cities Watson: Toronto Monday, 17 September 2012
How does it work? Monday, 17 September 2012
WATSON ARCHITECTURE - DEEPQA MASSIVELY PARALLEL PROBABILISTIC EVIDENCE-BASED ARCHITECTURE Monday,
17 September 2012
DEEPQA ARCHITECTURE PHASES Question Analysis Primary Search Candidate Answer Generation
Evidence Retrieval Evidence Scoring Merging and Ranking Monday, 17 September 2012
DEEPQA ARCHITECTURAL PHASES QUESTION ANALYSIS CATEGORY: CAPITALS QUESTION: WHAT IS
THE CAPITAL OF SAMOA? Monday, 17 September 2012
DEEPQA ARCHITECTURAL PHASES QUESTION ANALYSIS CATEGORY: POETS & POETRY QUESTION:
HE WAS A BANK CLERK IN THE YUKON BEFORE HE PUBLISHED “SONGS OF SOURDOUGH” IN 1907. Monday, 17 September 2012
DEEPQA ARCHITECTURAL PHASES QUESTION ANALYSIS CATEGORY: POETS & POETRY QUESTION:
HE WAS A BANK CLERK IN THE YUKON BEFORE HE PUBLISHED “SONGS OF SOURDOUGH” IN 1907. DISCOVER: FOCUS Monday, 17 September 2012
DEEPQA ARCHITECTURAL PHASES QUESTION ANALYSIS CATEGORY: POETS & POETRY QUESTION:
HE WAS A BANK CLERK IN THE YUKON BEFORE HE PUBLISHED “SONGS OF SOURDOUGH” IN 1907. DISCOVER: LEXICAL ANSWER TYPE Monday, 17 September 2012
DEEPQA ARCHITECTURAL PHASES QUESTION ANALYSIS CATEGORY: POETS & POETRY QUESTION:
HE WAS A BANK CLERK IN THE YUKON BEFORE HE PUBLISHED “SONGS OF SOURDOUGH” IN 1907. DISCOVER: RELATIONSHIPS Monday, 17 September 2012
DEEPQA ARCHITECTURAL PHASES QUESTION ANALYSIS CATEGORY: POETS & POETRY QUESTION:
HE WAS A BANK CLERK IN THE YUKON BEFORE HE PUBLISHED “SONGS OF SOURDOUGH” IN 1907. DISCOVER: QUESTION CLASS Monday, 17 September 2012
DEEPQA ARCHITECTURAL PHASES HYPOTHESIS GENERATION Hypothesis generation consists of two
phases... Monday, 17 September 2012
DEEPQA ARCHITECTURAL PHASES HYPOTHESIS GENERATION Primary Search Monday, 17 September
2012
DEEPQA ARCHITECTURAL PHASES HYPOTHESIS GENERATION Data Sources - Unstructured Wikipedia
IMDb Encyclopaedias Dictionaries Thesauri Literary Works Newswire Articles Monday, 17 September 2012
DEEPQA ARCHITECTURAL PHASES HYPOTHESIS GENERATION Data Sources - Structured DBpedia
Wordnet YAGO Monday, 17 September 2012
DEEPQA ARCHITECTURAL PHASES HYPOTHESIS GENERATION Candidate Answer Generation Monday, 17
September 2012
DEEPQA ARCHITECTURAL PHASES EVIDENCE RETRIEVAL Watson then searches for additional
evidence... Monday, 17 September 2012
DEEPQA ARCHITECTURAL PHASES EVIDENCE SCORING Deep Scoring Monday, 17 September
2012
DEEPQA ARCHITECTURAL PHASES EVIDENCE SCORING 0 0.25 0.5 0.75 1
Temporal Geospatial LAT Popularity Deep Scoring Christopher Columbus Vasco De Gamma Monday, 17 September 2012
DEEPQA ARCHITECTURAL PHASES FINAL MERGING AND RANKING Answer Merging Monday,
17 September 2012
DEEPQA ARCHITECTURAL PHASES FINAL MERGING AND RANKING Answer Merging Monday,
17 September 2012
DEEPQA ARCHITECTURAL PHASES FINAL MERGING AND RANKING Answer Ranking ISAAC
NEWTON [0.10, 0.45 ... 0.78, 0.12] ??? ANSWER SCORES RANK EDMOND HALLEY [0.31, 0.52 ... 0.08, 0.72] ??? WILHELM TEMPEL [0.21, 0.54 ... 0.18, 0.92] ??? PETER SELLERS [0.14, 0.04 ... 0.25, 0.41] ??? Monday, 17 September 2012
DEEPQA ARCHITECTURAL PHASES FINAL MERGING AND RANKING Monday, 17 September
2012
DEEPQA ARCHITECTURAL PHASES FINAL MERGING AND RANKING Answer Ranking ISAAC
NEWTON [0.10 ... 0.12] 3 ANSWER SCORES RANK EDMOND HALLEY [0.31 ... 0.72] 1 WILHELM TEMPEL [0.21 ... 0.92] 2 PETER SELLERS [0.14 ... 0.41] 4 0.14 CONFIDENCE 0.78 0.34 0.04 Monday, 17 September 2012
DEEPQA PERFORMANCE SCALING CHALLENGES Need to answer within a few
seconds.... Monday, 17 September 2012
DEEPQA PERFORMANCE SCALING CHALLENGES Need to answer within a few
seconds.... Early implementation took over two hours Monday, 17 September 2012
SCALING WATSON Monday, 17 September 2012
WATSON HARDWARE NINETY POWER 750 SERVERS 2880 POWER7 PROCESSOR CORES
16 TERABYTES OF RAM Monday, 17 September 2012
WATSON 1 - HUMANS 0 FEBRUARY 16, 2011 Monday, 17
September 2012
PUTTING WATSON TO WORK What’s next? Monday, 17 September 2012
PUTTING WATSON TO WORK HEALTHCARE Monday, 17 September 2012
QUESTIONS? Monday, 17 September 2012