Piotr Kurzynoga - APEX and AI

Transcript

1. Manage Offensive Behavior Using AI Language, Speech, and Video with Oracle APEX Piotr Kurzynoga Data Development Specialist, Oracle Copyright © 2023, Oracle and/or its affiliates | Confidential 1
2. Let’s start with an introduction! Bob Peulen Data Science and ML Specialist Oracle 2 Copyright © 2023, Oracle and/or its affiliates | Confidential
3. • Introduction 30 min • Use Cases • Platforms used • Showcase End Result 20 min • Q&A 10 min Copyright © 2023, Oracle and/or its affiliates | Confidential 4 Agenda
4. 5 Copyright © 2023, Oracle and/or its affiliates | Confidential Introduction to the Use Cases
5. Why do we care about Offensive Behaviour? Examples of offensive behaviour: • Hooligans • Comedians bad language • Hate speech by public personas • Fraudulent behaviour in casinos • ... Many more! Copyright © 2023, Oracle and/or its affiliates | Confidential 6
6. Two Use Cases Copyright © 2023, Oracle and/or its affiliates | Confidential 7 Use Case 1 THE GOAL Detect a particular Person in a YouTube Video EXAMPLE Detect a hooligan in a large crowd!
7. Two Use Cases Copyright © 2023, Oracle and/or its affiliates | Confidential 8 Use Case 2 THE GOAL Detect offensive language in a YouTube Video EXAMPLE Detect degree of e.g. anti-Semitism in a YouTube video
8. Copyright © 2023, Oracle and/or its affiliates | Confidential 9 Use Case 2 Example: Jimmy Carr WHY? Many YouTube Videos & Shorts Often use offensive language
9. Copyright © 2023, Oracle and/or its affiliates | Confidential 10 YouTube Videos Profile Image DeepFace Algorithm Results • Was the person in the video? • How many seconds was the person in the video? Use Case 1 Detect a particular Person in a YouTube Video
10. Copyright © 2023, Oracle and/or its affiliates | Confidential 11 YouTube Shorts Run Multiple Algorithms Results • Was there any offensive or hateful language in the video? • What are the key words used in the video? • How many negative key words are in the video? Use Case 2 Detect offensive language in a YouTube Video OCI Speech Speech to Text OCI Language Key Phrase Extraction & Sentiment Analysis Hugging Face Offensive Language Detection
11. 12 Copyright © 2023, Oracle and/or its affiliates | Confidential Introduction to the Services Used
12. Power of ADB = Built-in Dev Tech New development methodology simplify dev However, they complicate data architecture This complexity can be eliminated by pairing a synergistic data technology with each new development methodology Copyright © 2023, Oracle and/or its affiliates | Confidential 13 Distributed Data - Sharding API Driven – REST Data Services API CI/CD – SQLcl Liquibase SaaS – Multitenant DB Microservices – DB Containers Low Code - APEX Defense in Depth – Declarative Security
13. APEX unleashed on Autonomous Digital-Assistant Copyright © 2023, Oracle and/or its affiliates | Confidential 14 Machine Learning Spatial Analysis SaaS Applications Data Insights Oracle Analytics Cloud DevOps { JSON } < / > XML Object Storage Data Loading
14. Copyright © 2023, Oracle and/or its affiliates | Confidential 15 The Oracle AI Stack … Machine learning services Data AI services OCI Data Science ML in Oracle Database MySQL Heatwave AutoML Digital Assistant Speech Language Vision Document Understanding Anomaly Detection Forecasting Data Labeling OCI Generative AI + Business applications, Oracle SaaS portfolio AI infrastructure Compute bare metal instances and VMs Cluster networking Block, object, and file storage; HPC filesystems
15. Copyright © 2023, Oracle and/or its affiliates | Confidential 16 Infrastructure CPU – GPU – Storage – Network • Accelerate and automate the entire end- to-end data science lifecycle • Use favorite open-source Python tools and frameworks • Gain enterprise-grade MLOps with flexible interfaces and unlimited scale • Collaborate with teammates on shareable and reproducible data science assets • Run large-scale workloads with access to bare metal NVIDIA GPUs and distributed data processing and model training OCI Data Science Oracle Cloud Infrastructure Data Science Operationalize with MLOps Develop & Experiment Manage, Share, & Reproduce Integrate Notebook Sessions Pipelines Model Deployments ML Applications1 Model Monitoring1 Data Management Database – Data Lake – Access – Integration – Preparation Local and OCI Code Editors Conda Environments Jobs Model Catalog Feature Store2 1 In preview 2 Coming soon
16. YouTube Profile Image DeepFace Algorithm Results • Was the person in the video? • How many seconds was the person in the video? Use Case 1 – Mapping Across Services Detect a particular Person in a YouTube Video Oracle APEX • Building an APEX application • Creating fields for the YouTube URL and Uploading the Profile Image to Object Storage Input Layer Processing Layer – one Job Output Layer OCI Data Science • Notebook: Creating a Job • Job: serverless processing of YouTube Video Oracle APEX • Invoke the OCI Data Science - Job • View results in APEX Copyright © 2023, Oracle and/or its affiliates | Confidential 17
17. Copyright © 2023, Oracle and/or its affiliates | Confidential 18 YouTube Run Multiple Algorithms Results • Was there any offensive or hatefull language in the video? • What are the key words used in the video? • How many negative key words are in the video? Use Case 2 – Mapping Across Services Detect offensive language in a YouTube Video Oracle APEX • Building an APEX application • Creating fields for the YouTube URL Input Layer Processing Layer – one Job Output Layer OCI Data Science • Notebook: Creating a Job • Job: serverless processing of YouTube Video Oracle APEX • Invoke the OCI Data Science - Job • View results in APEX OCI Speech – Speech to Text OCI Language Key Phrase Extraction & Sentiment Analysis Hugging Face Offensive Language Detection
18. Architecture Diagram Copyright © 2023, Oracle and/or its affiliates | Confidential 19 OCI Data Science - Jobs AI Oracle-REST Data-Services OCI Data Science- Notebook APEX Object Storage Video Source End User Autonomous Database Log in APEX YouTube URL Store Profile Image Trigger a built OCI Data Science - Job Built an OCI Data Science - Job Store results in Autonomous Database Fetch Profile Image Store Procedures Visualize Output OCI Language OCI Speech Transcribe the video Analyze the text
19. 20 Copyright © 2023, Oracle and/or its affiliates | Confidential Showcasing the End Result
20. Showcasing the End Results – Three Steps Copyright © 2023, Oracle and/or its affiliates | Confidential 21 Demo End Result Demo Data Science Use Case 2 - Audio Demo APEX Use Case 1 - Video
21. Showcasing the End Results – Full Video Copyright © 2023, Oracle and/or its affiliates | Confidential 22 Add video
22. Thank you Piotr Kurzynoga Data Development Specialist, Oracle piotr.kurzynoga@oracle.com 30 Copyright © 2023, Oracle and/or its affiliates | Confidential