OpenTalks.AI - Сапунов Григорий, Ландшафт облачных когнитивных сервисов

Transcript

1. Сloud cognitive services landscape Grigory Sapunov / CTO, Intento © Intento, Inc. February 2019
2. INTENTO 2 © Intento, Inc. / February 2019 A simple API to third-party AI models from many vendors https://inten.to
3. AI SUPPLY SIDE STACK 3 Hardware and infrastructure Deep Learning Frameworks Neural Network Architectures Training Inference Data Processing Data Data Collection API Management Domain Adaptation © Intento, Inc. / February 2019
4. 4 Hardware and infrastructure Deep Learning Frameworks Neural Network Architectures Training Inference Data Processing Data Data Collection API Management Domain Adaptation ON THE SHOULDERS OF GIANTS http://www.shivonzilis.com/machineintelligence © Intento, Inc. / February 2019
5. A PLENTY OF SUPPLY 5 APIs 200+ intents 100+ AI models 20,000+ © Intento, Inc. / February 2019
6. 6 23 intents 60+ APIs © Intento, Inc. / Confidential / June 2018 EXAMPLE: NLP APIS © Intento, Inc. / February 2019 6
7. 7 © Intento, Inc. / Confidential / June 2018 EXAMPLE: MT APIS 7 Based on Jan 2019 report on MT: https://bit.ly/stock_mt_jan2019
8. DOES IT WORK? SOMETIMES 8 of companies using AI get ROI >30% 83% Deloitte State of Cognitive Survey 2017
9. DOES IT WORK? SOMETIMES 9 of them use third-party AI 80% of companies using AI get ROI >30% 83% Deloitte State of Cognitive Survey 2017
10. DOES IT WORK? NOT QUITE 10 of them use third-party AI 80% of companies using AI get ROI >30% 83% Deloitte State of Cognitive Survey 2017 of all companies ever tried to use AI 20%
11. LEGACY (SAAS) BUYING PROCESS 11 Good brand — Set of features — Price — Pilot Integration “AI IS NOT THERE YET!” Six months later: © Intento, Inc. / February 2019
12. WHAT MAKES THE AI DIFFERENT? 12 trained on vast amount of unknown data — performance varies up to 4x case by case — constantly updated (not always improving) — has its own quirks — decisions often made by non engineers © Intento, Inc. / February 2019
13. FEATURES DIFFER SIGNIFICANTLY (SENTIMENT ANALYSIS EXAMPLE) 13 © Intento, Inc. / February 2019 13
14. QUALITY DIFFERS SIGNIFICANTLY (MACHINE TRANSLATION EXAMPLE) 14 Based on July 2018 report on MT: https://bit.ly/mt_jul2018
15. QUALITY CONSTANTLY CHANGES (MACHINE TRANSLATION EXAMPLE) 15 Based on July 2018 report on MT: https://bit.ly/mt_jul2018
16. ANOTHER RED FLAG: PRICE 16 up to 300x difference for similar services — Machine Translation: $3 to $960 per 1M symbols — Sentiment Analysis: $1 to $99 per 10K API calls https://bit.ly/stock_mt_jan2019 https://bit.ly/sa_overview © Intento, Inc. / February 2019
17. EXAMPLE: SENTIMENT ANALYSIS PRICES 17 © Intento, Inc. / February 2019
18. NO SINGLE BEST/OPTIMAL VENDOR 18 Based on Jan 2019 report on MT: https://bit.ly/stock_mt_jan2019
19. YOU CAN COMBINE SEVERAL VENDORS 19 Based on custom NMT report: https://bit.ly/custom_nmt_nov2018
20. DEVELOPER EXPERIENCE (DX) 20 More info at https://bit.ly/intento_dx 20
21. IT’S MORE LIKE HIRING HUMANS 21 evaluate source onboard © Intento, Inc. / February 2019
22. WITH ITS OWN PROBLEMS 22 different APIs and data formats — hard to evaluate — hard to use multiple vendors concurrently — hard to source © Intento, Inc. / February 2019
23. Programmable Web AI MODELS: SOURCING 23 Major AI Vendors AI API Marketplaces Indie AI Vendors Deprecated AI APIs © Intento, Inc. / February 2019
24. AI MODELS: EVALUATION 24 lots of vendor reports and marketing — web demos — … <the tools chasm> … — API integrations NOTHING! © Intento, Inc. / February 2019
25. AI MODELS: ONBOARDING 25 different APIs, SDKs, CLIs (changed and deprecated from time to time) — connectors and plugins to client systems — domain adaptation © Intento, Inc. / February 2019
26. HOW INTENTO CHANGES THAT? 1. CORE TECHNOLOGY 26 we build and maintain many AI API integrations — intent-based vendor-agnostic API — high-performance AI middleware solution — the same convenience tools for every API: SDK, CLI, developer console evaluate source onboard © Intento, Inc. / February 2019
27. HOW INTENTO CHANGES THAT? 2. SOURCING 27 Intento Service Catalog https://inten.to/api-platform — monitoring changes in API specs, documentation and behavior — regular public evaluation reports (performance, price and feature comparison) evaluate source onboard © Intento, Inc. / February 2019
28. HOW INTENTO CHANGES THAT? 3. EVALUATION 28 Single API https://github.com/intento/intento-api — human-friendly evaluation tools (command-line interface) and evaluation API — API request smart-routing, optimizing performance, price or latency evaluate source onboard © Intento, Inc. / February 2019
29. HOW INTENTO CHANGES THAT? 4. ONBOARDING 29 Single API, Vendor-agnostic SDK and developer tools https://console.inten.to — Re-usable plugins and connectors to internal systems — No vendor-lock, can use multiple vendors simultaneously evaluate source onboard © Intento, Inc. / February 2019
30. ACCESS TO MANY MODELS EASY TO PICK THE RIGHT ONE 30 API MARKETPLACES INDIE VENDORS MAJOR VENDORS EASY TO CHOOSE HARD TO CHOOSE FEW MODELS MANY MODELS © Intento, Inc. / February 2019
31. CONCLUSIONS 31 lots of niche AI models with APIs — complex performance / price landscape — AI users: choose AI portfolio, not a single vendor — AI vendors: - avoid inventing new APIs - make tools for humans as well © Intento, Inc. / February 2019
32. THANK YOU! 32 Grigory Sapunov gs@inten.to 2150 Shattuck Ave Berkeley CA 94705 https://inten.to gs@inten.to