Share
Embed
OpenTalks.AI - Сапунов Григорий, Ландшафт облачных когнитивных сервисов
OpenTalks.AI
February 14, 2019
Transcript
32 slides
-
Сloud cognitive services landscape Grigory Sapunov / CTO, Intento ©
Intento, Inc. February 2019 -
INTENTO 2 © Intento, Inc. / February 2019 A simple
API to third-party AI models from many vendors https://inten.to -
AI SUPPLY SIDE STACK 3 Hardware and infrastructure Deep Learning
Frameworks Neural Network Architectures Training Inference Data Processing Data Data Collection API Management Domain Adaptation © Intento, Inc. / February 2019 -
4 Hardware and infrastructure Deep Learning Frameworks Neural Network Architectures
Training Inference Data Processing Data Data Collection API Management Domain Adaptation ON THE SHOULDERS OF GIANTS http://www.shivonzilis.com/machineintelligence © Intento, Inc. / February 2019 -
A PLENTY OF SUPPLY 5 APIs 200+ intents 100+ AI
models 20,000+ © Intento, Inc. / February 2019 -
6 23 intents 60+ APIs © Intento, Inc. / Confidential
/ June 2018 EXAMPLE: NLP APIS © Intento, Inc. / February 2019 6 -
7 © Intento, Inc. / Confidential / June 2018 EXAMPLE:
MT APIS 7 Based on Jan 2019 report on MT: https://bit.ly/stock_mt_jan2019 -
DOES IT WORK? SOMETIMES 8 of companies using AI get
ROI >30% 83% Deloitte State of Cognitive Survey 2017 -
DOES IT WORK? SOMETIMES 9 of them use third-party AI
80% of companies using AI get ROI >30% 83% Deloitte State of Cognitive Survey 2017 -
DOES IT WORK? NOT QUITE 10 of them use third-party
AI 80% of companies using AI get ROI >30% 83% Deloitte State of Cognitive Survey 2017 of all companies ever tried to use AI 20% -
LEGACY (SAAS) BUYING PROCESS 11 Good brand — Set of
features — Price — Pilot Integration “AI IS NOT THERE YET!” Six months later: © Intento, Inc. / February 2019 -
WHAT MAKES THE AI DIFFERENT? 12 trained on vast amount
of unknown data — performance varies up to 4x case by case — constantly updated (not always improving) — has its own quirks — decisions often made by non engineers © Intento, Inc. / February 2019 -
QUALITY DIFFERS SIGNIFICANTLY (MACHINE TRANSLATION EXAMPLE) 14 Based on July
2018 report on MT: https://bit.ly/mt_jul2018 -
QUALITY CONSTANTLY CHANGES (MACHINE TRANSLATION EXAMPLE) 15 Based on July
2018 report on MT: https://bit.ly/mt_jul2018 -
ANOTHER RED FLAG: PRICE 16 up to 300x difference for
similar services — Machine Translation: $3 to $960 per 1M symbols — Sentiment Analysis: $1 to $99 per 10K API calls https://bit.ly/stock_mt_jan2019 https://bit.ly/sa_overview © Intento, Inc. / February 2019 -
NO SINGLE BEST/OPTIMAL VENDOR 18 Based on Jan 2019 report
on MT: https://bit.ly/stock_mt_jan2019 -
YOU CAN COMBINE SEVERAL VENDORS 19 Based on custom NMT
report: https://bit.ly/custom_nmt_nov2018 -
IT’S MORE LIKE HIRING HUMANS 21 evaluate source onboard ©
Intento, Inc. / February 2019 -
WITH ITS OWN PROBLEMS 22 different APIs and data formats
— hard to evaluate — hard to use multiple vendors concurrently — hard to source © Intento, Inc. / February 2019 -
Programmable Web AI MODELS: SOURCING 23 Major AI Vendors AI
API Marketplaces Indie AI Vendors Deprecated AI APIs © Intento, Inc. / February 2019 -
AI MODELS: EVALUATION 24 lots of vendor reports and marketing
— web demos — … <the tools chasm> … — API integrations NOTHING! © Intento, Inc. / February 2019 -
AI MODELS: ONBOARDING 25 different APIs, SDKs, CLIs (changed and
deprecated from time to time) — connectors and plugins to client systems — domain adaptation © Intento, Inc. / February 2019 -
HOW INTENTO CHANGES THAT? 1. CORE TECHNOLOGY 26 we build
and maintain many AI API integrations — intent-based vendor-agnostic API — high-performance AI middleware solution — the same convenience tools for every API: SDK, CLI, developer console evaluate source onboard © Intento, Inc. / February 2019 -
HOW INTENTO CHANGES THAT? 2. SOURCING 27 Intento Service Catalog
https://inten.to/api-platform — monitoring changes in API specs, documentation and behavior — regular public evaluation reports (performance, price and feature comparison) evaluate source onboard © Intento, Inc. / February 2019 -
HOW INTENTO CHANGES THAT? 3. EVALUATION 28 Single API https://github.com/intento/intento-api
— human-friendly evaluation tools (command-line interface) and evaluation API — API request smart-routing, optimizing performance, price or latency evaluate source onboard © Intento, Inc. / February 2019 -
HOW INTENTO CHANGES THAT? 4. ONBOARDING 29 Single API, Vendor-agnostic
SDK and developer tools https://console.inten.to — Re-usable plugins and connectors to internal systems — No vendor-lock, can use multiple vendors simultaneously evaluate source onboard © Intento, Inc. / February 2019 -
ACCESS TO MANY MODELS EASY TO PICK THE RIGHT ONE
30 API MARKETPLACES INDIE VENDORS MAJOR VENDORS EASY TO CHOOSE HARD TO CHOOSE FEW MODELS MANY MODELS © Intento, Inc. / February 2019 -
CONCLUSIONS 31 lots of niche AI models with APIs —
complex performance / price landscape — AI users: choose AI portfolio, not a single vendor — AI vendors: - avoid inventing new APIs - make tools for humans as well © Intento, Inc. / February 2019 -
THANK YOU! 32 Grigory Sapunov [email protected] 2150 Shattuck Ave Berkeley
CA 94705 https://inten.to [email protected]