Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Integration of AI services. 5 steps to identify...

Integration of AI services. 5 steps to identify and implement integration with AIaaS

In this talk, I describe 5 steps to integrate AiaaS in your projects.

Here I'm considering architecture implementations, automatic tests, business rules, cost, good practices and the main possibilities on Google, OpenAi and Microsoft.

Avatar for Leticia coelho

Leticia coelho

October 20, 2023

Other Decks in Technology

Transcript

  1. engenheira.coelho LETICIA COELHO Software Engineer na @ArcTouch Telecommunications Engineer -

    IFSC. Internet of things consultant. Mentor Speaker Writer Community administrator (Women and PwD) CONTENT CREATOR @ENGENHEIRA.COELHO
  2. Artificial neuron Human neuron ENGENHEIRA.COELHO We cannot confuse these aspects,

    artificial neurons do not work as human neurons. This is just a comparison. input processing output processing input output The first concept considers just the electricity model.
  3. Ai What is this animal? I was trained with animals.

    It's a rabbit. ENGENHEIRA.COELHO
  4. Ai And this animal? What it is? I was trained

    with animals. But I do not know. ENGENHEIRA.COELHO
  5. But AI is not a new topic! So why did

    it become a topic? AiaaS OpenAi demystified AI recently with ChatGPT In the 1940s, when Walter Pitts and Warren McCulloch developed the concept of artificial neurons. And in 1950, when Turing published a paper called "Computing Machinery and Intelligence." Revista Exame. ENGENHEIRA.COELHO
  6. Research Markets - Global Opportunity Analysis and Industry Forecast, 2017-2025

    The global artificial intelligence as a service (AIaaS) market size is expected to reach US$77,047.7 million in 2025. ENGENHEIRA.COELHO
  7. ENGENHEIRA.COELHO AIaaS incorporates a range of services that offer AI

    tools through of cloud computing services. Google, IBM, Intel, Microsoft, and Apple Inc. are some of the major players in the global AIaaS market. Research Markets - Global Opportunity Analysis and Industry Forecast, 2017-2025
  8. When exploring potential AI use cases, it's important to not

    only focus on scenarios that don't have existing solutions, but also those that do. By looking for optimization opportunities and service quality improvements, we can maximize the value of AI in our solutions. STEP 1 Understand the problem ENGENHEIRA.COELHO
  9. Understanding the problem is not just a job for the

    product or UX team, as a software engineer you need to understand how each part works and communicates in the system. STEP 1 Understand the problem ENGENHEIRA.COELHO
  10. STEP 1 Understand the problem Analyze business rules to identify

    improvements. Talk to customers and understand their main difficulties and pain points. Identify any recurring issues or errors. Use data analytics to identify where users tend to abandon the process or web page. ENGENHEIRA.COELHO
  11. In this step, you must identify the data that needs

    to be sent to the AI ​ ​ services and define the expected format of the response data. Additionally, determine how the response data will be used in your project, such as for decision making or generating insights. STEP 2 Understand the data
  12. STEP 3 - INTEGRATION Technology definition Type of solution available.

    (text, image, sound) Graph Service availability Possibility of use cases Investment Technical compatibility Here we defines the best platform or service, considering:
  13. STEP 3 - TECHNOLOGY DEFINITION OpenAi /moderations - Acts as

    a filter for inappropriate content. /fine-tunes - Allows you to train an existing model. /files - import files and use them in training with end-point fine- tuning. /audio - Used to transform audio into text. /embeddings - Creates numeric representations for words, sentences, and documents. /images - Processes images, including capture, generation, background removal, and adaptations. /completions - Sequential conversation
  14. 0 1 STEP 3 - TECHNOLOGY DEFINITION OpenAi - Characteristics

    Temperature Response time Abstract pricing prompt description $0.0001 / 1K tokens $0.12 / 1K tokens
  15. STEP 3 - TECHNOLOGY DEFINITION Google Natural Language AI: Classifies

    and detects feelings. Speech-to-Text: Automatic recognition, real-time transcription and audio call enhancement. Text-to-Speech: Convert text to speech. Voice user interface on devices and applications. Carry out personalized communication. Translate: Real-time translation that can be used to internationalize products. AI Vision (image): Vision API to detect objects, understand texts, celebrities, brands, faces, writing and others. AI Vision (video): Extract rich metadata at the video, scene, or frame level.
  16. STEP 3 - TECHNOLOGY DEFINITION Microsoft Azure openAi service: Connects

    openAi services Search: Service that an AI-powered information retrieval platform. Vision: Identifies and analyzes images, making it possible to train the model Speech: Audio to text, text to audio, speech transcription and speaker recognition. Language: Text analysis for mood and sentiment. Bots: Robots that can assist in customer service tasks. Metrics advisor: Metrics extraction monitoring and problem diagnosis.
  17. STEP 3 - TECHNOLOGY DEFINITION Microsoft Azure openAi Specific voice

    training Own libraries Facilitates infrastructure Dev need onbording
  18. STEP 3 - INTEGRATION Technical compatibility SDK + SSML (Speech

    Synthesis Markup Language is an XML-based markup language) API Library Language
  19. Certify observability STEP 3 - INTEGRATION Architecture definition Latency Ease

    contracts maintenance Additional resource for maintenance
  20. STEP 4 Test Testing the AI ​ ​ service response

    using automatic tests is not an easy task, data is always changing, and providing different response possibilities. In this case, a good way to test whether actions are performed correctly is to consider just immutable data.
  21. STEP 4 Test One proposal for testing really important services

    is to use a new request to AIaaS, which will guarantee that the response has the same type of text requested previously. Conducting this type of testing can be risky if you are using an AI service that charges per request. Therefore, it is important to use this test only when it is really necessary.
  22. STEP 4 Test The definition of technology can consider several

    aspects: Timestamp Response code Specific attributes The existence of an answer Response size Response type
  23. STEP 5 Refinement i.e if you are working with a

    text model, the model receives and responds in natural language. To get your response in a specific model, you need to explicitly request it. As in this entry, which specifically determines the correct answer: const textType = "sci-fy" const textRecommendation = "A blue house with birds" const orientations = "Do not do comments about your response, do not write any different orientation, just return a " + textType + "text considering the recommendation. The recommendation are:" // Considering we have the fetch encapsuled inside a method const response = fetchPost("/completions", "text-davinci-003", orientations + textRecommendation)
  24. Understand the problem Understand data Integration Test Refinement Refinement Here

    is the time to verify all steps, looking for any improvement.
  25. Cisco estimates that 70% of all enterprise workflow in 2021

    will happen in the cloud, using enterprise SaaS platforms. AIaas now looks set to become part of standard operating procedure CISCO ANNUAL INTERNET REPORT (2018–2023) WHITE PAPER
  26. How AI works Course - Code.org Como surgiu a inteligencia

    artificial (Exame) OpenAi documentation OpenAi - GPT - best practices OpenAi - Pricing Microsoft - Pricing ENGENHEIRA.COELHO Referências Anti-Corruption layer - Microsoft Adapter - Refactoring Guru speech.microsoft.com