Slide 1
Slide 1 text
The Future of LINE
Retail Chatbot using
Gemini and Vertex AI
Bangkok
Punsiri Boonyakiat
Senior Data Engineer @ CJ Express
Slide 2
Slide 2 text
About CJ MORE
1,432
Branches in Thailand
Slide 3
Slide 3 text
About CJ MORE
3.2M LINE OA Users
Slide 4
Slide 4 text
Enhance LINE User Experience
with AI Shopping Assistance with in LINE OA
Chat about
Product
Semantic and
Image Search
Add to Basket
Search for Store
or Payment
Slide 5
Slide 5 text
Challenge in Building LLM Chatbot
Hallucination
Speci
fi
c Knowledge Domain
Dynamic Answer from External Data
Clear Response Style
Slide 6
Slide 6 text
Challenge in Building LLM Chatbot
Hallucination
Speci
fi
c Knowledge Domain
Dynamic Answer from External Data
Clear Response Style
Slide 7
Slide 7 text
Challenge in Building LLM Chatbot
Hallucination
Speci
fi
c Knowledge Domain
Dynamic Answer from External Data
Clear Response Style
Slide 8
Slide 8 text
Challenge in Building LLM Chatbot
Speci
fi
c Knowledge Domain
Dynamic Answer from External Data
Clear Response Style
Hallucination
Slide 9
Slide 9 text
Challenge in Building LLM Chatbot
Speci
fi
c Knowledge Domain
Dynamic Answer from External Data
Clear Response Style
Hallucination
Slide 10
Slide 10 text
Retrieval Augmented Generation (RAG)
Data Store
Retrieval Augmented Generation
Search
Related Data
(Document or Embedding Vector)
+
Slide 11
Slide 11 text
Retrieval Augmented Generation (RAG)
Data Store
Retrieval Augmented Generation
Search
Related Data
(Document or Embedding Vector)
+
Slide 12
Slide 12 text
Retrieval Augmented Generation (RAG)
Data Store
Retrieval Augmented Generation
Search
Related Data
(Document or Embedding Vector)
+
Slide 13
Slide 13 text
Retrieval Augmented Generation (RAG)
Data Store
Augmented Generation
Search
Related Data
(Document or Embedding Vector)
+
Retrieval
Slide 14
Slide 14 text
Tools Building to LLM Chatbot
+
+
Slide 15
Slide 15 text
Google AI Solution
Slide 16
Slide 16 text
Vertex AI
Vertex AI Agent Builder
Vertex AI Search
Vertex AI Vector Search
Slide 17
Slide 17 text
Vertex AI
Vertex AI Agent Builder
Vertex AI Search
Vertex AI Vector Search
Slide 18
Slide 18 text
Vertex AI Agent Builder
Build natural language Agent
Slide 19
Slide 19 text
Vertex AI Agent Builder
Build natural language Agent
Create Data Store
Create Agent De
fi
ne PlayBook Integration
Slide 20
Slide 20 text
Vertex AI Agent Builder
Build natural language Agent
Create Data Store
Create Agent De
fi
ne PlayBook Integration
Slide 21
Slide 21 text
Vertex AI Agent Builder
Build natural language Agent
Create Data Store
Create Agent De
fi
ne PlayBook Integration
Slide 22
Slide 22 text
Vertex AI Agent Builder
Build natural language Agent
Create Data Store
Create Agent De
fi
ne PlayBook Integration
Slide 23
Slide 23 text
Vertex AI Agent Builder
Build natural language Agent
Create Data Store
Create Agent De
fi
ne PlayBook Integration
Slide 24
Slide 24 text
Vertex AI
Vertex AI Agent Builder
Vertex AI Search
Vertex AI Vector Search
Slide 25
Slide 25 text
Vertex AI Search
Empower Retrieval with Google Search Engine for Enterprise data
Build Collect Serve
Slide 26
Slide 26 text
Vertex AI Search
Empower Retrieval with Google Search Engine for Enterprise data
Create
Data Store
Create
Search Agent
Import
Documents
Search Results
In both Widget and API
Select
LLM Model
Slide 27
Slide 27 text
Vertex AI Search
Empower Retrieval with Google Search Engine for Enterprise data
Create
Data Store
Create
Search Agent
Import
Documents
Search Results
In both Widget and API
Select
LLM Model
Slide 28
Slide 28 text
Vertex AI Search
Empower Retrieval with Kind of Google Search Engine
Create
Data Store
Create
Search Agent
Import
Documents
Search Results
In both Widget and API
Select
LLM Model
Slide 29
Slide 29 text
Vertex AI Search
Empower Retrieval with Google Search Engine for Enterprise data
Create
Data Store
Create
Search Agent
Import
Documents
Search Results
In both Widget and API
Select
LLM Model
Slide 30
Slide 30 text
Vertex AI Search
Empower Retrieval with Google Search Engine for Enterprise data
Create
Data Store
Create
Search Agent
Import
Documents
Search Results
In both Widget and API
Select
LLM Model
Slide 31
Slide 31 text
Vertex AI
Vertex AI Agent Builder
Vertex AI Search
Vertex AI Vector Search
Slide 32
Slide 32 text
Vertex AI Vector Search
Convert Image to Embedding
Create
Embedding index
Embedding search
Slide 33
Slide 33 text
Building Retail Agent Solution
Slide 34
Slide 34 text
Building Retail Agent Solution
Chat with CJ Product
Slide 35
Slide 35 text
Building Retail Agent Solution
Text-based Semantic Search
Slide 36
Slide 36 text
Building Retail Agent Solution
Image to Embedding with
Vector Search
Slide 37
Slide 37 text
LINE Messaging Architecture
Slide 38
Slide 38 text
Integration LINE Messaging API
With Python Line Bot SDK
LINE Platform Handling Webhook
Slide 39
Slide 39 text
With Python Line Bot SDK
Develop LINE Messaging API
Callback Function
Validate LINE Signature
Image Handler
Event
Text
Text Handler
Image
Slide 40
Slide 40 text
Semantic Search
Vertex AI Search
Summary
Product List
Conversational Agent
Chat with Product
Text Event
Text Answers
Keyword : #ค้นหา
Slide 41
Slide 41 text
Semantic Search
Vertex AI Search
Summary
Product List
Conversational Agent
Chat with Product
Text Event
Text Answers
Keyword : #ค้นหา
Slide 42
Slide 42 text
Chat with CJ Product
Create Agent
Slide 43
Slide 43 text
Semantic Search
Vertex AI Search
Summary
Product List
Conversational Agent
Chat with Product
Text Event
Text Answers
Keyword : #ค้นหา
Slide 44
Slide 44 text
Call Discovery Engine - Vertex AI Search
Create Flex Carousel
Related Products
Vertex AI Search
Slide 45
Slide 45 text
Call Discovery Engine - Vertex AI Search
Slide 46
Slide 46 text
Call Discovery Engine - Vertex AI Search
Pre-de
fi
ne Prompt
Slide 47
Slide 47 text
Call Discovery Engine - Vertex AI Search
Slide 48
Slide 48 text
Gemini Image Understanding Search
Image Event - Solution 1
Image Description Vertex AI Search
+
Gemini Multimodal
Image Event
Slide 49
Slide 49 text
Gemini Image Understanding Search
Multimodal
One-Shot Prompt
Response Control
Slide 50
Slide 50 text
Gemini Image Understanding Search
Multimodal
One-Shot Prompt
Response Control
Both Image and Text pre-de
fi
ned prompt
Slide 51
Slide 51 text
Gemini Image Understanding Search
One Example for output
Multimodal
One-Shot Prompt
Response Control
Slide 52
Slide 52 text
Gemini Image Understanding Search
Multimodal
Recipe output
Response Control
One-Shot Prompt
Slide 53
Slide 53 text
Gemini Image Understanding Search
Related Products
Vertex AI Search Return Flex Carousel
Slide 54
Slide 54 text
Image to Embedding Vector Search
Image Event - Solution 2
Vertex AI Vector Search
Image Event
Convert to
Embedding Vector Similar Items
Slide 55
Slide 55 text
Generate Multimodal Embedding
Convert to
Embedding Vector
Slide 56
Slide 56 text
Create Vertex AI Vector Index
Vertex AI Vector
Search
Slide 57
Slide 57 text
Vertex AI Search for Embedding
Related Products
Vector Search Create Flex Carousel
Slide 58
Slide 58 text
Enhance Retail User Experience in LINE Platform
• Customer Support Agent
• Document Search Agent
• Operational Service Agent
Slide 59
Slide 59 text
Summary
Vertex AI Agent Builder
Chat with Product
Vertex AI Vector Search
Image Vector Search
Vertex AI Search
Text Semantic Search
Gemini + Vertex AI Search
Image Understanding
Slide 60
Slide 60 text
Deep Dive into Vertex AI
Slide 61
Slide 61 text
CJ MORE, AI MORE