Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
A Computer Called "Watson"
Search
James Thomas
September 17, 2012
Technology
1
390
A Computer Called "Watson"
LondonJS talk on the technology behind IBM Watson.
James Thomas
September 17, 2012
Tweet
Share
More Decks by James Thomas
See All by James Thomas
Apache OpenWhisk - Pluggable Event Providers
jthomas
0
320
Confessions of a (nervous) public speaker
jthomas
0
94
Serverless Machine Learning with TensorFlow.js
jthomas
1
630
Serverless: The Missing Manual
jthomas
1
2.2k
Serverless Swift with Apache OpenWhisk
jthomas
0
230
Serverless Backends and APIs using Swift and Apache OpenWhisk
jthomas
0
69
Predicting the impact of serverless computing, lessons from economic history
jthomas
0
110
Taming Serverless Dragons - Multi-Provider Serverless Apps
jthomas
0
3k
Microservices Without Servers
jthomas
2
2.7k
Other Decks in Technology
See All in Technology
20240725 LLMによるDXのビジョンと、今何からやるべきか @Azure OpenAI Service Dev Day
nrryuya
3
1.2k
サービスの持続的な成長と技術負債について
siva_official
PRO
10
4.4k
ACRiルーム最新情報とAMD GPUサーバーのご紹介
anjn
0
160
サービス開発を前に進めるために 新米リードエンジニアが 取り組んだこと / Steps Taken by a Novice Lead Engineer to Advance Service Development
nologyance
0
180
LINE WORKSへ簡単通知!Incoming Webhookアプリの紹介
mmclsntr
0
110
Azure Pipelinesを使用したCICDベースラインアーキテクチャ実践
yuriemori
0
190
技術負債による事業の失敗はなぜ起こるのか / Why do business failures due to technical debt occur?
i35_267
0
190
セキュリティ研修 Day1【MIXI 24新卒技術研修】
mixi_engineers
PRO
0
160
AWSでRAGを作る法方
sonoda_mj
1
140
エンジニアの生存戦略 〜クラウド潮流の経験から紐解く技術トレンドのメカニズムと乗りこなし方〜
shimy
9
1.9k
Classmethod Odyssey 登壇資料
yamahiro
0
390
20240724_cm_odyssey_hibiyatech
hiashisan
0
110
Featured
See All Featured
GraphQLの誤解/rethinking-graphql
sonatard
59
9.6k
Building Your Own Lightsaber
phodgson
101
5.9k
Distributed Sagas: A Protocol for Coordinating Microservices
caitiem20
325
21k
ReactJS: Keep Simple. Everything can be a component!
pedronauck
662
120k
Large-scale JavaScript Application Architecture
addyosmani
506
110k
How to Ace a Technical Interview
jacobian
274
23k
What the flash - Photography Introduction
edds
65
11k
Teambox: Starting and Learning
jrom
130
8.6k
Become a Pro
speakerdeck
PRO
15
4.8k
WebSockets: Embracing the real-time Web
robhawkes
59
7.2k
Designing for humans not robots
tammielis
247
25k
jQuery: Nuts, Bolts and Bling
dougneiner
61
7.4k
Transcript
A Computer Called “Watson” James Thomas, IBM Emerging Tech COVER
PHOTO Add cover photo Monday, 17 September 2012
GARY KASPAROV VERSUS “DEEP BLUE” MAY 1997 Monday, 17 September
2012
BLUE GENE DECEMBER 1999 Monday, 17 September 2012
“Fast forward to 2004...” Monday, 17 September 2012
JEOPARDY QUIZ SHOW Monday, 17 September 2012
KEN JENNINGS CHAMPION OF CHAMPIONS Monday, 17 September 2012
KEN JENNINGS CHAMPION OF CHAMPIONS KEN’S PERFORMANCE Monday, 17 September
2012
What if we build a computer to play Jeopardy? Monday,
17 September 2012
What if we build a computer to play Jeopardy? It’s
way too hard Monday, 17 September 2012
Jeopardy! Finite, mathematically defined search space Limited number of moves
and states Symbols completed grounded in mathematical rules of the games Chess Enormous problem domain and search space Source material is inherently unstructured information Advanced natural language processing Monday, 17 September 2012
BASELINE PERFORMANCE INITIAL EXPERIMENT Monday, 17 September 2012
“Fast forward to 2007...” Monday, 17 September 2012
DR. DAVID FERRUCCI - “WATSON” TEAM DIRECTOR 2007 - 2011
Monday, 17 September 2012
SIMULATING JEOPARDY! MATCHES Monday, 17 September 2012
BASELINE PERFORMANCE INITIAL EXPERIMENT Monday, 17 September 2012
WATSON WAS READY FEBRUARY 2011 Monday, 17 September 2012
Watson Jeopardy! Challenge February 14-16 2011. Ken Jennings Brad Rutter
Monday, 17 September 2012
WATSON 1 - HUMANS 0 FEBRUARY 16, 2011 Monday, 17
September 2012
“Its largest airport is named for a WWII hero; its
second largest, for a WWII battle” Category: US Cities Monday, 17 September 2012
“Its largest airport is named for a WWII hero; its
second largest, for a WWII battle” Category: US Cities Watson: Toronto Monday, 17 September 2012
How does it work? Monday, 17 September 2012
WATSON ARCHITECTURE - DEEPQA MASSIVELY PARALLEL PROBABILISTIC EVIDENCE-BASED ARCHITECTURE Monday,
17 September 2012
DEEPQA ARCHITECTURE PHASES Question Analysis Primary Search Candidate Answer Generation
Evidence Retrieval Evidence Scoring Merging and Ranking Monday, 17 September 2012
DEEPQA ARCHITECTURAL PHASES QUESTION ANALYSIS CATEGORY: CAPITALS QUESTION: WHAT IS
THE CAPITAL OF SAMOA? Monday, 17 September 2012
DEEPQA ARCHITECTURAL PHASES QUESTION ANALYSIS CATEGORY: POETS & POETRY QUESTION:
HE WAS A BANK CLERK IN THE YUKON BEFORE HE PUBLISHED “SONGS OF SOURDOUGH” IN 1907. Monday, 17 September 2012
DEEPQA ARCHITECTURAL PHASES QUESTION ANALYSIS CATEGORY: POETS & POETRY QUESTION:
HE WAS A BANK CLERK IN THE YUKON BEFORE HE PUBLISHED “SONGS OF SOURDOUGH” IN 1907. DISCOVER: FOCUS Monday, 17 September 2012
DEEPQA ARCHITECTURAL PHASES QUESTION ANALYSIS CATEGORY: POETS & POETRY QUESTION:
HE WAS A BANK CLERK IN THE YUKON BEFORE HE PUBLISHED “SONGS OF SOURDOUGH” IN 1907. DISCOVER: LEXICAL ANSWER TYPE Monday, 17 September 2012
DEEPQA ARCHITECTURAL PHASES QUESTION ANALYSIS CATEGORY: POETS & POETRY QUESTION:
HE WAS A BANK CLERK IN THE YUKON BEFORE HE PUBLISHED “SONGS OF SOURDOUGH” IN 1907. DISCOVER: RELATIONSHIPS Monday, 17 September 2012
DEEPQA ARCHITECTURAL PHASES QUESTION ANALYSIS CATEGORY: POETS & POETRY QUESTION:
HE WAS A BANK CLERK IN THE YUKON BEFORE HE PUBLISHED “SONGS OF SOURDOUGH” IN 1907. DISCOVER: QUESTION CLASS Monday, 17 September 2012
DEEPQA ARCHITECTURAL PHASES HYPOTHESIS GENERATION Hypothesis generation consists of two
phases... Monday, 17 September 2012
DEEPQA ARCHITECTURAL PHASES HYPOTHESIS GENERATION Primary Search Monday, 17 September
2012
DEEPQA ARCHITECTURAL PHASES HYPOTHESIS GENERATION Data Sources - Unstructured Wikipedia
IMDb Encyclopaedias Dictionaries Thesauri Literary Works Newswire Articles Monday, 17 September 2012
DEEPQA ARCHITECTURAL PHASES HYPOTHESIS GENERATION Data Sources - Structured DBpedia
Wordnet YAGO Monday, 17 September 2012
DEEPQA ARCHITECTURAL PHASES HYPOTHESIS GENERATION Candidate Answer Generation Monday, 17
September 2012
DEEPQA ARCHITECTURAL PHASES EVIDENCE RETRIEVAL Watson then searches for additional
evidence... Monday, 17 September 2012
DEEPQA ARCHITECTURAL PHASES EVIDENCE SCORING Deep Scoring Monday, 17 September
2012
DEEPQA ARCHITECTURAL PHASES EVIDENCE SCORING 0 0.25 0.5 0.75 1
Temporal Geospatial LAT Popularity Deep Scoring Christopher Columbus Vasco De Gamma Monday, 17 September 2012
DEEPQA ARCHITECTURAL PHASES FINAL MERGING AND RANKING Answer Merging Monday,
17 September 2012
DEEPQA ARCHITECTURAL PHASES FINAL MERGING AND RANKING Answer Merging Monday,
17 September 2012
DEEPQA ARCHITECTURAL PHASES FINAL MERGING AND RANKING Answer Ranking ISAAC
NEWTON [0.10, 0.45 ... 0.78, 0.12] ??? ANSWER SCORES RANK EDMOND HALLEY [0.31, 0.52 ... 0.08, 0.72] ??? WILHELM TEMPEL [0.21, 0.54 ... 0.18, 0.92] ??? PETER SELLERS [0.14, 0.04 ... 0.25, 0.41] ??? Monday, 17 September 2012
DEEPQA ARCHITECTURAL PHASES FINAL MERGING AND RANKING Monday, 17 September
2012
DEEPQA ARCHITECTURAL PHASES FINAL MERGING AND RANKING Answer Ranking ISAAC
NEWTON [0.10 ... 0.12] 3 ANSWER SCORES RANK EDMOND HALLEY [0.31 ... 0.72] 1 WILHELM TEMPEL [0.21 ... 0.92] 2 PETER SELLERS [0.14 ... 0.41] 4 0.14 CONFIDENCE 0.78 0.34 0.04 Monday, 17 September 2012
DEEPQA PERFORMANCE SCALING CHALLENGES Need to answer within a few
seconds.... Monday, 17 September 2012
DEEPQA PERFORMANCE SCALING CHALLENGES Need to answer within a few
seconds.... Early implementation took over two hours Monday, 17 September 2012
SCALING WATSON Monday, 17 September 2012
WATSON HARDWARE NINETY POWER 750 SERVERS 2880 POWER7 PROCESSOR CORES
16 TERABYTES OF RAM Monday, 17 September 2012
WATSON 1 - HUMANS 0 FEBRUARY 16, 2011 Monday, 17
September 2012
PUTTING WATSON TO WORK What’s next? Monday, 17 September 2012
PUTTING WATSON TO WORK HEALTHCARE Monday, 17 September 2012
QUESTIONS? Monday, 17 September 2012