Slide 1
Slide 1 text
Shinichi Hashitani, Solutions Engineer @Kong
Kong
AI Gateway
Slide 2
Slide 2 text
bit.ly/3yy1ZWk
Slide 3
Slide 3 text
The World Leading API Company
● hashi (Shinichi Hashitani)
● Staff Solutions Engineer
● Kong <- Confluent <- Pivotal (VMware
Tanzu)
● Modernization, Kafka, stream
processing, cloud data analytics.
bit.ly/3yy1ZWk
Slide 4
Slide 4 text
PLUGINS
(e.g. Authentication, Authorization, Rate Limiting, logging,Analytics, etc)
TARGET1
TARGET2
API CLIENT
LOAD
BALANCER
ROUTE SERVICE
CONSUMER
KONG ADMIN
UPSTREAM
TARGETS
What is API Gateway?
Slide 5
Slide 5 text
INTERACTING
REAL WORLD
USING AI TRAINING AI
Slide 6
Slide 6 text
The more AI the more API
INTERACTING
REAL WORLD
USING AI TRAINING AI
API API
API
Slide 7
Slide 7 text
No content
Slide 8
Slide 8 text
Cloud
Self-Hosted
Specialized
Slide 9
Slide 9 text
Cloud
Self-Hosted
Specialized
✅ ✅
✅ ✅
✅ ✅
Slide 10
Slide 10 text
No content
Slide 11
Slide 11 text
One API to
rule them all
{ }
Slide 12
Slide 12 text
One API to
rule them all
{ }
AI Credentials
AI Traffic Control
AI Logging
And more
AI Security &
AI Observability
Slide 13
Slide 13 text
One API to
rule them all
{ }
AI Credentials
AI Traffic Control
AI Logging
And more
AI Security &
AI Observability
AI Prompt Guard
AI Prompt Decorator
AI Prompt Templator
AI Compliance &
AI Abuse prevention
Slide 14
Slide 14 text
One API to
rule them all
{ }
AI Credentials
AI Traffic Control
AI Logging
And more
AI Security &
AI Observability
AI Prompt Guard
AI Prompt Decorator
AI Prompt Templator
AI Compliance &
AI Abuse prevention
AI Request
Transformer
AI Response
Transformer
Slide 15
Slide 15 text
One API to
rule them all
{ }
AI Credentials
AI Traffic Control
AI Logging
And more
AI Security &
AI Observability
Prompt Guard
Prompt Decorator
Prompt Templator
AI Compliance &
AI Abuse prevention
AI Request
Transformer
AI Response
Transformer
Use AI without
coding
Slide 16
Slide 16 text
One API to
rule them all
{ }
AI Credentials
AI Traffic Control
AI Logging
And more
AI Security &
AI Observability
Prompt Guard
Prompt Decorator
Prompt Templator
AI Compliance &
AI Abuse prevention
AI Request
Transformer
AI Response
Transformer
Use AI without
coding
Slide 17
Slide 17 text
AI productivity and
scalability
1
Automating AI
Governance
2
Implementing AI
Security
3
Slide 18
Slide 18 text
DEMO
Slide 19
Slide 19 text
No content
Slide 20
Slide 20 text
No content
Slide 21
Slide 21 text
No content
Slide 22
Slide 22 text
No content
Slide 23
Slide 23 text
No content
Slide 24
Slide 24 text
Future
Kong Gateway v3.7 and v3.8
AI Train
AI Sanitize
AI Rate Limiting
LLMs
Apps
And more
Semantic Caching
AI Azure Services
AWS Bedrock
Slide 25
Slide 25 text
r
konghq.com
Q&A Kong AI Gateway
bit.ly/3yy1ZWk