Generative Conversational AI Diego Gosmar Standardization & Ethics Diego Gosmar © 2024

Diego Gosmar W HAT’S ARTIFICIAL INTELLIGENCE?

Diego Gosmar

Diego Gosmar AI is the new electricity (cit. Andrew Ng) General purpose concept

Diego Gosmar 1. Functional Definition: AI is the study and design of “intelligent” agents, where an intelligent agent is a system with some autonomous capabilities, that perceives its environment and takes actions that maximize its chances of success. What’s Artificial Intelligence?

Diego Gosmar Diego Gosmar Chief AI Officer Start-up Mentor & Advisor Ambassador Member

Diego Gosmar Conversational AI Standardization & Ethical Guidelines

Diego Gosmar

Diego Gosmar Intents à Responses LLM, LMM (GPT,…) Generative AI à Prompt Engineering LMM + Vector DB + API (LangChain, LlamaIndex,…) Retrieval Augmented Generation (RAG) Dialogflow, Lex,… 2017 2022 2024 t Conversation Naturalness Conversational AI Evolution Timeline CONTEXT AWARENESS

Diego Gosmar

Diego Gosmar https://openvoicenetwork.org/trustmark-initiative/ Speech or Voice technology not only conveys what we say, but also how we say it, revealing aspects of our identity, personality, emotions, health and more. While Voice AI can use this information to provide personalized responses, it can also misuse it for purposes that may harm or exploit users.

Diego Gosmar https://openvoicenetwork.org/trustmark-initiative/

Diego Gosmar Why Standards are important? • INTEROPERABILITY • SCALABILITY • Users are rapidly adopting Conversational assistants which they use to conduct transactions, obtain information, or to control devices • No single assistant can do everything that a user might need • When an assistant reaches the limits of its expertise, the user can only try to find another assistant and start over • Interoperable assistants collaborate so that one agent can pass on a task to a second agent • This requires that assistants share a common STANDARD for sending information about tasks

Diego Gosmar user agent agent assistant A dialog envelopes delegation dialog envelopes Agent A: 1st level dialog agent assistant Agent B/C: usually with specific knowledge, and resource connections (i.e. CRM, specific KB etc…) agent assistant B agent assistant C user proxy channeling/mediation dialog envelops Dialog Agent Message Envelopes Universal JSON structure

Diego Gosmar

Diego Gosmar Primary conversational assistant (Bürokratt) Smart Library conversational assistant OVON Messages SMART LIBRARY OVON POST Request Utterance + Whisper, OVON POST Response BOOK information utterance: Can I have some info about Harry Potter and the and the philosopher's stone? whisper: In particular can I get some info about the second edition of the book? The second edition of the book was published in 1999 by Bloomsbury Publishing in the UK and Scholastic Inc. In the US. The main difference between the first and second editions is the cover design. The first edition featured a simple design with the title and author's name in gold letters against a black background. The second edition, on the other hand,… SMART Library

Diego Gosmar conversational AI worthy of user trust Example OVON REQUEST UTTERANCE & WHISPER To be sent as part of the body of an HTTPS POST request to the endpoint: https://ovon.xcally.com/smartlibrary Replace values with your desired questions about books: utterance: main request whisper: additional infos you’d like to send/request { "ovon": { "schema": { "version": ”0.9.0", … { "eventType": "invite", "parameters": { "to": { "url": "https://ovon.xcally.com" } … { "eventType": "utterance", "parameters": { … "mimeType": "text/plain", "tokens": [ { "value": "Can I have some info about Harry Potter and the and the philosopher's stone?" } ] } … }, { "eventType": "whisper", "parameters": { … "features": { "text": { "mimeType": "text/plain", "tokens": [ { "value": "In particular can I get some info about the second edition of the book?" } ] … } Formatted according to the: Conversational Envelope and Dialog Event specs

Diego Gosmar

Diego Gosmar https://github.com/open-voice-interoperability/docs

Diego Gosmar “It’s a Wrap-up” Thank you! www.gosmar.eu Diego Gosmar