Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
A Computer Called "Watson"
Search
James Thomas
September 17, 2012
Technology
1
440
A Computer Called "Watson"
LondonJS talk on the technology behind IBM Watson.
James Thomas
September 17, 2012
Tweet
Share
More Decks by James Thomas
See All by James Thomas
Apache OpenWhisk - Pluggable Event Providers
jthomas
0
410
Confessions of a (nervous) public speaker
jthomas
0
110
Serverless Machine Learning with TensorFlow.js
jthomas
1
740
Serverless: The Missing Manual
jthomas
1
2.3k
Serverless Swift with Apache OpenWhisk
jthomas
0
280
Serverless Backends and APIs using Swift and Apache OpenWhisk
jthomas
0
90
Predicting the impact of serverless computing, lessons from economic history
jthomas
0
120
Taming Serverless Dragons - Multi-Provider Serverless Apps
jthomas
0
3.1k
Microservices Without Servers
jthomas
2
2.8k
Other Decks in Technology
See All in Technology
ロールが細分化された組織でSREは何をするか?
tgidgd
1
200
Lakebaseを使ったAIエージェントを実装してみる
kameitomohiro
0
180
伴走から自律へ: 形式知へと導くSREイネーブリングによる プロダクトチームの信頼性オーナーシップ向上 / SRE NEXT 2025
visional_engineering_and_design
3
230
united airlines ™®️ USA Contact Numbers: Complete 2025 Support Guide
flyunitedhelp
1
470
全部AI、全員Cursor、ドキュメント駆動開発 〜DevinやGeminiも添えて〜
rinchsan
2
2.2k
CDKTFについてざっくり理解する!!~CloudFormationからCDKTFへ変換するツールも作ってみた~
masakiokuda
1
200
cdk initで生成されるあのファイル達は何なのか/cdk-init-generated-files
tomoki10
1
540
Delegating the chores of authenticating users to Keycloak
ahus1
0
180
SREのためのeBPF活用ステップアップガイド
egmc
2
900
いつの間にか入れ替わってる!?新しいAWS Security Hubとは?
cmusudakeisuke
0
160
【LT会登壇資料】TROCCO新コネクタ「スマレジ」を活用した直営店データの分析
kazari0425
1
170
United airlines®️ USA Contact Numbers: Complete 2025 Support Guide
unitedflyhelp
0
340
Featured
See All Featured
Let's Do A Bunch of Simple Stuff to Make Websites Faster
chriscoyier
507
140k
ピンチをチャンスに:未来をつくるプロダクトロードマップ #pmconf2020
aki_iinuma
126
53k
How GitHub (no longer) Works
holman
314
140k
Exploring the Power of Turbo Streams & Action Cable | RailsConf2023
kevinliebholz
34
5.9k
For a Future-Friendly Web
brad_frost
179
9.8k
Facilitating Awesome Meetings
lara
54
6.5k
It's Worth the Effort
3n
185
28k
Refactoring Trust on Your Teams (GOTO; Chicago 2020)
rmw
34
3.1k
Designing Dashboards & Data Visualisations in Web Apps
destraynor
231
53k
Creating an realtime collaboration tool: Agile Flush - .NET Oxford
marcduiker
30
2.1k
The Illustrated Children's Guide to Kubernetes
chrisshort
48
50k
Building a Modern Day E-commerce SEO Strategy
aleyda
42
7.4k
Transcript
A Computer Called “Watson” James Thomas, IBM Emerging Tech COVER
PHOTO Add cover photo Monday, 17 September 2012
GARY KASPAROV VERSUS “DEEP BLUE” MAY 1997 Monday, 17 September
2012
BLUE GENE DECEMBER 1999 Monday, 17 September 2012
“Fast forward to 2004...” Monday, 17 September 2012
JEOPARDY QUIZ SHOW Monday, 17 September 2012
KEN JENNINGS CHAMPION OF CHAMPIONS Monday, 17 September 2012
KEN JENNINGS CHAMPION OF CHAMPIONS KEN’S PERFORMANCE Monday, 17 September
2012
What if we build a computer to play Jeopardy? Monday,
17 September 2012
What if we build a computer to play Jeopardy? It’s
way too hard Monday, 17 September 2012
Jeopardy! Finite, mathematically defined search space Limited number of moves
and states Symbols completed grounded in mathematical rules of the games Chess Enormous problem domain and search space Source material is inherently unstructured information Advanced natural language processing Monday, 17 September 2012
BASELINE PERFORMANCE INITIAL EXPERIMENT Monday, 17 September 2012
“Fast forward to 2007...” Monday, 17 September 2012
DR. DAVID FERRUCCI - “WATSON” TEAM DIRECTOR 2007 - 2011
Monday, 17 September 2012
SIMULATING JEOPARDY! MATCHES Monday, 17 September 2012
BASELINE PERFORMANCE INITIAL EXPERIMENT Monday, 17 September 2012
WATSON WAS READY FEBRUARY 2011 Monday, 17 September 2012
Watson Jeopardy! Challenge February 14-16 2011. Ken Jennings Brad Rutter
Monday, 17 September 2012
WATSON 1 - HUMANS 0 FEBRUARY 16, 2011 Monday, 17
September 2012
“Its largest airport is named for a WWII hero; its
second largest, for a WWII battle” Category: US Cities Monday, 17 September 2012
“Its largest airport is named for a WWII hero; its
second largest, for a WWII battle” Category: US Cities Watson: Toronto Monday, 17 September 2012
How does it work? Monday, 17 September 2012
WATSON ARCHITECTURE - DEEPQA MASSIVELY PARALLEL PROBABILISTIC EVIDENCE-BASED ARCHITECTURE Monday,
17 September 2012
DEEPQA ARCHITECTURE PHASES Question Analysis Primary Search Candidate Answer Generation
Evidence Retrieval Evidence Scoring Merging and Ranking Monday, 17 September 2012
DEEPQA ARCHITECTURAL PHASES QUESTION ANALYSIS CATEGORY: CAPITALS QUESTION: WHAT IS
THE CAPITAL OF SAMOA? Monday, 17 September 2012
DEEPQA ARCHITECTURAL PHASES QUESTION ANALYSIS CATEGORY: POETS & POETRY QUESTION:
HE WAS A BANK CLERK IN THE YUKON BEFORE HE PUBLISHED “SONGS OF SOURDOUGH” IN 1907. Monday, 17 September 2012
DEEPQA ARCHITECTURAL PHASES QUESTION ANALYSIS CATEGORY: POETS & POETRY QUESTION:
HE WAS A BANK CLERK IN THE YUKON BEFORE HE PUBLISHED “SONGS OF SOURDOUGH” IN 1907. DISCOVER: FOCUS Monday, 17 September 2012
DEEPQA ARCHITECTURAL PHASES QUESTION ANALYSIS CATEGORY: POETS & POETRY QUESTION:
HE WAS A BANK CLERK IN THE YUKON BEFORE HE PUBLISHED “SONGS OF SOURDOUGH” IN 1907. DISCOVER: LEXICAL ANSWER TYPE Monday, 17 September 2012
DEEPQA ARCHITECTURAL PHASES QUESTION ANALYSIS CATEGORY: POETS & POETRY QUESTION:
HE WAS A BANK CLERK IN THE YUKON BEFORE HE PUBLISHED “SONGS OF SOURDOUGH” IN 1907. DISCOVER: RELATIONSHIPS Monday, 17 September 2012
DEEPQA ARCHITECTURAL PHASES QUESTION ANALYSIS CATEGORY: POETS & POETRY QUESTION:
HE WAS A BANK CLERK IN THE YUKON BEFORE HE PUBLISHED “SONGS OF SOURDOUGH” IN 1907. DISCOVER: QUESTION CLASS Monday, 17 September 2012
DEEPQA ARCHITECTURAL PHASES HYPOTHESIS GENERATION Hypothesis generation consists of two
phases... Monday, 17 September 2012
DEEPQA ARCHITECTURAL PHASES HYPOTHESIS GENERATION Primary Search Monday, 17 September
2012
DEEPQA ARCHITECTURAL PHASES HYPOTHESIS GENERATION Data Sources - Unstructured Wikipedia
IMDb Encyclopaedias Dictionaries Thesauri Literary Works Newswire Articles Monday, 17 September 2012
DEEPQA ARCHITECTURAL PHASES HYPOTHESIS GENERATION Data Sources - Structured DBpedia
Wordnet YAGO Monday, 17 September 2012
DEEPQA ARCHITECTURAL PHASES HYPOTHESIS GENERATION Candidate Answer Generation Monday, 17
September 2012
DEEPQA ARCHITECTURAL PHASES EVIDENCE RETRIEVAL Watson then searches for additional
evidence... Monday, 17 September 2012
DEEPQA ARCHITECTURAL PHASES EVIDENCE SCORING Deep Scoring Monday, 17 September
2012
DEEPQA ARCHITECTURAL PHASES EVIDENCE SCORING 0 0.25 0.5 0.75 1
Temporal Geospatial LAT Popularity Deep Scoring Christopher Columbus Vasco De Gamma Monday, 17 September 2012
DEEPQA ARCHITECTURAL PHASES FINAL MERGING AND RANKING Answer Merging Monday,
17 September 2012
DEEPQA ARCHITECTURAL PHASES FINAL MERGING AND RANKING Answer Merging Monday,
17 September 2012
DEEPQA ARCHITECTURAL PHASES FINAL MERGING AND RANKING Answer Ranking ISAAC
NEWTON [0.10, 0.45 ... 0.78, 0.12] ??? ANSWER SCORES RANK EDMOND HALLEY [0.31, 0.52 ... 0.08, 0.72] ??? WILHELM TEMPEL [0.21, 0.54 ... 0.18, 0.92] ??? PETER SELLERS [0.14, 0.04 ... 0.25, 0.41] ??? Monday, 17 September 2012
DEEPQA ARCHITECTURAL PHASES FINAL MERGING AND RANKING Monday, 17 September
2012
DEEPQA ARCHITECTURAL PHASES FINAL MERGING AND RANKING Answer Ranking ISAAC
NEWTON [0.10 ... 0.12] 3 ANSWER SCORES RANK EDMOND HALLEY [0.31 ... 0.72] 1 WILHELM TEMPEL [0.21 ... 0.92] 2 PETER SELLERS [0.14 ... 0.41] 4 0.14 CONFIDENCE 0.78 0.34 0.04 Monday, 17 September 2012
DEEPQA PERFORMANCE SCALING CHALLENGES Need to answer within a few
seconds.... Monday, 17 September 2012
DEEPQA PERFORMANCE SCALING CHALLENGES Need to answer within a few
seconds.... Early implementation took over two hours Monday, 17 September 2012
SCALING WATSON Monday, 17 September 2012
WATSON HARDWARE NINETY POWER 750 SERVERS 2880 POWER7 PROCESSOR CORES
16 TERABYTES OF RAM Monday, 17 September 2012
WATSON 1 - HUMANS 0 FEBRUARY 16, 2011 Monday, 17
September 2012
PUTTING WATSON TO WORK What’s next? Monday, 17 September 2012
PUTTING WATSON TO WORK HEALTHCARE Monday, 17 September 2012
QUESTIONS? Monday, 17 September 2012