Introducing Kong AI Gateway

ChatGTP Meetup Osaka #2の登壇資料です。

Transcript

1. Shinichi Hashitani, Solutions Engineer @Kong Kong AI Gateway
2. bit.ly/3yy1ZWk
3. The World Leading API Company • hashi (Shinichi Hashitani) • Staff Solutions Engineer • Kong <- Confluent <- Pivotal (VMware Tanzu) • Modernization, Kafka, stream processing, cloud data analytics. bit.ly/3yy1ZWk
4. PLUGINS (e.g. Authentication, Authorization, Rate Limiting, logging,Analytics, etc) TARGET1 TARGET2 API CLIENT LOAD BALANCER ROUTE SERVICE CONSUMER KONG ADMIN UPSTREAM TARGETS What is API Gateway?
5. INTERACTING REAL WORLD USING AI TRAINING AI
6. The more AI the more API INTERACTING REAL WORLD USING AI TRAINING AI API API API
8. Cloud Self-Hosted Specialized
9. Cloud Self-Hosted Specialized ✅ ✅ ✅ ✅ ✅ ✅
11. One API to rule them all { }
12. One API to rule them all { } AI Credentials AI Traffic Control AI Logging And more AI Security & AI Observability
13. One API to rule them all { } AI Credentials AI Traffic Control AI Logging And more AI Security & AI Observability AI Prompt Guard AI Prompt Decorator AI Prompt Templator AI Compliance & AI Abuse prevention
14. One API to rule them all { } AI Credentials AI Traffic Control AI Logging And more AI Security & AI Observability AI Prompt Guard AI Prompt Decorator AI Prompt Templator AI Compliance & AI Abuse prevention AI Request Transformer AI Response Transformer
15. One API to rule them all { } AI Credentials AI Traffic Control AI Logging And more AI Security & AI Observability Prompt Guard Prompt Decorator Prompt Templator AI Compliance & AI Abuse prevention AI Request Transformer AI Response Transformer Use AI without coding
16. One API to rule them all { } AI Credentials AI Traffic Control AI Logging And more AI Security & AI Observability Prompt Guard Prompt Decorator Prompt Templator AI Compliance & AI Abuse prevention AI Request Transformer AI Response Transformer Use AI without coding
17. AI productivity and scalability 1 Automating AI Governance 2 Implementing AI Security 3
18. DEMO
24. Future Kong Gateway v3.7 and v3.8 AI Train AI Sanitize AI Rate Limiting LLMs Apps And more Semantic Caching AI Azure Services AWS Bedrock
25. r konghq.com Q&A Kong AI Gateway bit.ly/3yy1ZWk