apidays Paris 2024 - APIs and GenAI, Rafik Ferroukh, Groupe HARVEST

APIs and GenAI: Your Perfect Combo with LLM-Powered Frameworks
Rafik Ferroukh, Solutions Architect at Groupe HARVEST

apidays Paris 2024 - The Future API Stack for Mass Innovation
December 3 - 5, 2024

------

Check out our conferences at https://www.apidays.global/

Do you want to sponsor or talk at one of our conferences?
https://apidays.typeform.com/to/ILJeAaV8

Learn more on APIscene, the global media made by the community for the community:
https://www.apiscene.io

Explore the API ecosystem with the API Landscape:
https://apilandscape.apiscene.io/

Transcript

1. 1 C2 - Document externe restreint ǀ APIs and GenAI : Your Perfect Combo with LLM Powered Frameworks R A F I K F E R R O U K H S o l u t i o n s A r c h i t e c t
2. 2 C2 - Document externe restreint ǀ
3. 3 C2 - Document externe restreint ǀ
4. 4 C2 - Document externe restreint ǀ 4 C3 - Document interne ǀ Rafik FERROUKH Solutions Architect @TheUnBullshIT @raf_cooking @rafikFerroukh @airFerroukh “NO BULLSHIT” SUPPORTER INTERNATIONAL SPEAKER JAVA/API/GenAI/CLOUD ENABLERS ENTHUSIAST Paris “Tech” since 2004 “TECH FOR ALL” FAN ‘DARE TO SIMPLIFY TECH FOR EVERYONE !’ MY TALKS' WEBSITE
5. 5 C2 - Document externe restreint ǀ Presentation of the Group
6. 6 C2 - Document externe restreint ǀ Our DNA: liberating advisory A solid and innovative techforfin 35 YEARS Mid-size company with 500 passionate and committed employees including 300 dev. or tech FTEs 5 sites across France and Italy No outsourcing Recognised expertise TRAINING 1 200 training sessions in 2023 17,000 professionals trained 20,000 logins to our e-learning platform Qualiopi training organisation Customer intimacy ATTENTIVENESS & PROXIMITY Retail banking, private banking, insurers Financial advisory, family office, management company, etc. Process digitisation SOFTWARE SUITE & API Big | O2S | MoneyPitch | Fidnet | Feefty Quantalys | Business Link | Quantix | VIC | Wealth Platform | Breeqs | Prisme | Haumeal A creator of interconnected sales paths drawing on our API Store BUSINESS TECH & EXPERTISE Anticipation of regulatory developments Continuous improvements Security and availability DAY TO DAY Over 70,000 issues addressed by the assistance by e-mail and telephone support 15 tool and asset experts at your service Customer Success Team for customised and personalised support BUSINESS HOTLINE Over 10,000 wealth issued adressed 18 experienced wealth management consultants helping you use our solutions THE GOAL Grow your business through innovative digital customer journeys that drive sales opportunities Increase proactivity and time spent on sales and advisory
7. 7 C2 - Document externe restreint ǀ F o r w e a l t h a n d f i n a n c e p r o f e s s i o n a l s INVESTMENT STRATEGY DATA DIGITAL DISTRIBUTION PLATFORM Optimal solutions for the analysis and construction of your financial offers The solution to simplify your subscription process and management of your products, contracts and loans, and to shorten processing times between the front and back office Comprehensive data on a wide variety of financial products Our digital solutions CUSTOMER RELATIONSHIP MANAGEMENT ASSET MANAGEMENT Your daily tool for powerful customer relationship and asset management The reference solution in wealth management to strengthen your expertise and enrich your client advice O2S - Workstation CRM - Aggregation - Regulation and compliance - Investment path Commissions - Follow-up of retrocessions Monitoring and control of commissions on outstanding assets and payments MoneyPitch - Client Portal Relationship entry - Communication - Portfolio visualization - External aggregation Big - Asset analysis Global and thematic approach - Projection and modelling Fidnet - Pedagogical knowledge Development of consultancy services - Know- how and knowledge sharing Quantix - Simulations Savings, retirement, pension, tax, etc. more than 40 simulators Harvest API - API store Complete store displaying all our Business APIs Data - File format or API VL - Regulatory data - Model portfolios - ESG - Regulatory reporting (EPT, KIID, EET, etc) Easypack - Scripting your data Which funds for which products? – Funds staging and profiling Concentrator - Flow aggregation Multi-depository aggregation - Penelop flow - Quality control Regulatory Edition Platform Editing and autonomous management of regulatory documents: financial and non- financial appendices, appendix transparency of charges Wealth platform - Digital pathway - Asset saving Life insurance, real-estate investment trust, retirement account - Subscription - Deeds management - Middle office VIC - Sale and instruction of credits Complete front to middle solution - Customer Selfcare Feefty - Structured products Platform for building, launching and monitoring structured products Breeqs - Structured products Referencing - Workflow tool to simplify and digitizing the referencing of structured products in insurance wrappers Pro + / multi - Financial analysis Portfolio construction and optimisation - Fund and portfolio analysis - Model portfolios, robo advisor - ESG analysis Global International coverage European benchmark Multilingual and multicurrency Trainings
8. 8 C2 - Document externe restreint ǀ 8 C3 - Document interne ǀ Our key figures 2023 Founded 1989 500 employees 10 sur 10 top french banks and insurers served +3 700 independent financial advisors served 5 european countries Leader market share France +4 600 clients c.70 M€ revenues
9. 9 C2 - Document externe restreint ǀ RESTONS EN CONTACT harvest.fr +33 (0)1 53 30 28 00 5 rue de la Baume - 75008 Paris 9 ǀ Joins us #TECHFORFIN Discover all our offers on  harvest.fr/carrieres/
10. 10 C2 - Document externe restreint ǀ Our challenge
11. 11 C2 - Document externe restreint ǀ From GUIs.. API DATABASE MAINFRAME ALGORITHMS DOCUMENTS RESOURCE INTENSIVE REDUCED EFFICIENCY FOR COMPLEX TASKS LIMITED FLEXIBILITY STEEPER LEARNING CURVE
12. 12 C2 - Document externe restreint ǀ To Chatbots… API DATABASE MAINFRAME ALGORITHMS DOCUMENTS OUTIL CHAT Q/R
13. 13 C2 - Document externe restreint ǀ
14. 14 C2 - Document externe restreint ǀ
15. 15 C2 - Document externe restreint ǀ
16. 16 C2 - Document externe restreint ǀ How to ? IA = Artificial Intelligence GenAI = Generative AI LLM = Large Language Model DATABASE MAINFRAME DOCUMENTS LangChain4j APP C H A T B O T ALGORITHM A P I
17. 17 C2 - Document externe restreint ǀ SUMMARY 1 LANGCHAIN4J, WHAT’S ? 4 API Tools INTEGRATION 2 LLM INTEGRATION 5 USE CASES & WARNINGS 3 RAG INTEGRATION 6 TAKEAWAY
18. 18 C2 - Document externe restreint ǀ
19. 19 C2 - Document externe restreint ǀ LangChain4j What’s ?
20. 20 C2 - Document externe restreint ǀ LangChain4j, What’s ? DOCUMENT LOADERS LLMs CHAINS AGENTS PROMPTS VECTOR STORES FREE OPEN SOURCE LIBRARY LangChain4j
21. 21 C2 - Document externe restreint ǀ LLM Integration
22. 22 C2 - Document externe restreint ǀ ‘LLM’ DEMO I want to create my own basic GPT
23. 23 C2 - Document externe restreint ǀ RAG Integration
24. 24 C2 - Document externe restreint ǀ RAG Integration W H A T ’ S A R A G ?
25. 25 C2 - Document externe restreint ǀ What’s a RAG ? ‘Should a good developer use UML?’ UML : Unified Model Language is a standard modelling language RAG = Retrieval Augmented Generation USER LLM EMBEDDING STORE EMBEDDING MODEL EXTERNAL SOURCES DOCUMENT TEXT QUERY RESPONSE RESPONSE PROGRAM INTERFACE QUERY CONTEXT QUERY CONTEXT + [SEARCH RELEVANT INFORMATION] [VECTOR DATABASE]
26. 26 C2 - Document externe restreint ǀ RAG Integration D E M O “ D A T A ”
27. 27 C2 - Document externe restreint ǀ ‘DATA’ DEMO I would like to use data via API using GenAI
28. 28 C2 - Document externe restreint ǀ API Tools Integration
29. 29 C2 - Document externe restreint ǀ API Tools Integration W H A T ’ S T O O L ?
30. 30 C2 - Document externe restreint ǀ What’s a Tool ? USER LLM Square root of 475695037565 ? 689710 689710 Square root of 475695037565 ? USER LLM Square root of 475695037565 ? 689706…. 689706…. Square root of 475695037565 ? [ToolExecutionRequests] [ToolExecutionResultMessage] PROGRAM INTERFACE
31. 31 C2 - Document externe restreint ǀ API Tools Integration D E M O “ A P I ”
32. 32 C2 - Document externe restreint ǀ Demo API Tools I have a stock management API and I want to use it
33. 33 C2 - Document externe restreint ǀ Use cases
34. 34 C2 - Document externe restreint ǀ Use cases BOOKING SITE INVENTORY MANAGEMENT WEBSITE E-COMMERCE INFORMATION SEARCH SITE SUPPORT TICKET MANAGEMENT HR PROCESS DASHBOARD AND REPORTS VIRTUAL ASSISTANTS SOCIAL NETWORKS IMAGE MANAGEMENT EDUCATION TRAINING INTERNAL GPT
35. 35 C2 - Document externe restreint ǀ Warnings
36. 36 C2 - Document externe restreint ǀ Warnings SECURITY DATA SHARING LICENSE COST PERFORMANCES USE CASES https://medium.com/optimumoutput/dont-use-a-cannon-to-kill-a-fly-a752469262e8
37. 37 C2 - Document externe restreint ǀ Takeaway
38. 38 C2 - Document externe restreint ǀ Takeaway DOCUMENT LOADERS LLMs CHAINS AGENTS PROMPTS VECTOR STORES RAG TOOLS LANGCHAIN4J USE CASE API GAINS
39. 39 C2 - Document externe restreint ǀ GUIs BUSINESS LangChain4j
40. 40 C2 - Document externe restreint ǀ References • Github @rafgitdz – langchain4j : https://github.com/rafgitdz/langchain4j • Github LangChain4j https://github.com/langchain4j/langchain4j • LangChain4j tutorials https://docs.langchain4j.dev/tutorials/ • Java rencontre l'IA : https://www.youtube.com/watch?v=0FEUmI2Ou10 • Du Clic à la Conversation : remplaçons boutons et formulaires par un LLM ! : https://youtu.be/DN8WtezZKYA • An introduction to RAG and simple/ complex RAG https://medium.com/enterprise-rag/an-introduction-to-rag-and-simple-complex-rag-9c3aa9bd017b • Worldline Generative AI program - Retour d’expérience - Meetup #2 LangChain & LLM https://youtu.be/PBwAYlPbZp8 • LangChain - Cas d'utilisation chez Veolia https://youtu.be/2T478zb0eOU • L'Oréal : Intégration de LangChain sur Google Cloud, avec Cloud Run - Meetup #2 LangChain & LLM https://youtu.be/xUorPMci0T0 • OVH RAG chatbot using AI Endpoints and LangChain : https://blog.ovhcloud.com/rag-chatbot-using-ai- endpoints-and-langchain/
41. 41 C2 - Document externe restreint ǀ RESTONS EN CONTACT harvest.fr 5 rue de la Baume - 75008 Paris 41 ǀ Rafik FERROUKH Solution Architect rafik.ferroukh@harvest.fr FEEDBACK