Have you met Ada? Word Embeddings with Open AI and Laravel

@ Laravel Live UK, London 2024
https://dianaweb.dev/talk/ada

Transcript

1. Diana Scharf Laravel Live UK • June 19th, 2024 Have you met Ada? Word Embeddings with Open AI and Laravel
2. DIANA SCHARF LARAVEL LIVE UK 2024 🐕 Full-Stack Code Witch at Beyond Code dianaweb.dev pinkary.com/@dianawebdev Diana Scharf 🥨 🐘
3. DIANA SCHARF LARAVEL LIVE UK 2024 Word Theory
4. DIANA SCHARF LARAVEL LIVE UK 2024 What is a Word Embedding?
5. DIANA SCHARF LARAVEL LIVE UK 2024 What is a Word Embedding?
6. DIANA SCHARF LARAVEL LIVE UK 2024 A word embedding is a vector- based representation of a word.
7. DIANA SCHARF LARAVEL LIVE UK 2024 Embeddings help computers to work with human semantics.
8. DIANA SCHARF LARAVEL LIVE UK 2024 Usage of Embeddings Semantic Search Content Moderation Text Classi fi cation Clustering Text Similarity
9. DIANA SCHARF LARAVEL LIVE UK 2024 A word embedding is a vector- based representation of a word.
10. DIANA SCHARF LARAVEL LIVE UK 2024 What’s a vector?
11. DIANA SCHARF LARAVEL LIVE UK 2024 A vector is a quantity with magnitude and direction in an n-dimensional space.
12. DIANA SCHARF LARAVEL LIVE UK 2024 cat
13. DIANA SCHARF LARAVEL LIVE UK 2024 Creating an embedding model DIANA SCHARF LARAVEL LIVE UK 2024
14. DIANA SCHARF LARAVEL LIVE UK 2024 Flying objects in context (wings, engine, altitude) Helicopter: ( 0 , 2 , 3 ) 0 2 3
15. DIANA SCHARF LARAVEL LIVE UK 2024 wings engine altitude Helicopter 0 2 3 Bird 3 0 2 Airplane 2 3 4 Bumblebee 3 0 1 Rocket 0 4 5 Flying objects in context
16. DIANA SCHARF LARAVEL LIVE UK 2024 Flying objects in context
17. DIANA SCHARF LARAVEL LIVE UK 2024 Are cats pets? DIANA SCHARF DIANA SCHARF LARAVEL LIVE UK 2024
18. DIANA SCHARF LARAVEL LIVE UK 2024 King = Queen - Man + Woman Math fun with vectors
19. DIANA SCHARF LARAVEL LIVE UK 2024 Dang, that’s a lot of math.
20. DIANA SCHARF LARAVEL LIVE UK 2024 🐈 🐕 🚗
21. DIANA SCHARF LARAVEL LIVE UK 2024 How can we use embeddings with Laravel?
22. DIANA SCHARF LARAVEL LIVE UK 2024 Let’s meet Ada /v1/embeddings Price per 1M tokens MTEB text-embedding-3-small $0.02 62.3% text-embedding-3-large $0.13 64.6% text-embedding-ada-002 $0.10 61.0%
23. DIANA SCHARF LARAVEL LIVE UK 2024 Let’s meet Ada /v1/embeddings Price per 1M tokens MTEB text-embedding-3-small $0.02 62.3% text-embedding-3-large $0.13 64.6% text-embedding-ada-002 $0.10 61.0% Ada Lovelace
24. DIANA SCHARF LARAVEL LIVE UK 2024 A token is a sequence of characters converted into a numerical format.
25. DIANA SCHARF LARAVEL LIVE UK 2024 Semantic Search 1. Embed the query or question 2. Perform nearest neighbor vector search to fi nd matching context 3. Send question with context to a chat endpoint to get a custom answer (optional)
26. DIANA SCHARF LARAVEL LIVE UK 2024 Thank you! dianaweb.dev/talk/ada github.com/5am-code/ada-laravel