Slide 1

Slide 1 text

1 Pronged Strategy To Mitigating the Risk of Generative AI Hallucinations + Improving Response Quality

Slide 2

Slide 2 text

2 Scientific, Technical & Medical Risk & Business Analytics Exhibitions Legal Professional Legal & Professional Chief Technology Officer - Nexis® Solutions Snehit Cherian Find Snehit Cherian on LinkedIn Booth #17

Slide 3

Slide 3 text

3 The future of work is transforming. • Background • Impact of Generative AI • Execution internally and externally “AI won’t replace humans – but humans with AI will replace humans without AI.” — Prof. Karim Lakhani, Harvard Business School

Slide 4

Slide 4 text

LexisNexis Future of Work Report – 2024 Credibility and Accuracy Matter Most 9/10 Ranked quality and accuracy of Gen AI outputs as #1 consideration 96% Say technology is crucial to organizational success >50% Say job satisfaction has improved thanks to generative AI 69% Already use GenAI to assist with daily tasks 86% Want to use GenAI for creative and professional work 72% Anticipate a positive impact • Investigating AI sentiment and adoption • Collaboration with Harvard • Surveyed 500+ professionals globally Download the Report

Slide 5

Slide 5 text

5 AI Hallucinations: a major challenge for Generative AI Where a GenAI tool gives a plausible but false response which isn’t based on factual data

Slide 6

Slide 6 text

6 A Generative AI-powered tool to support corporate research, intelligence gathering and business decision-making based on licensed sources

Slide 7

Slide 7 text

7 Retrieval Augmented Generation (RAG) Using RAG, to ensure that trusted content provides the context to the LLM minimizing hallucinations. Four-Pronged Strategy to Combat AI Hallucinations + Improve Response Quality R A G F R A M E W O R K Understand intent of the query Provide sections as part of the context to generate answer Retrieve potential answers from licensed content

Slide 8

Slide 8 text

8 Automated Metrics Automated metrics ensure high-quality, trustworthy results by evaluating faithfulness, context utilization, and relevance. Faithfulness Score Context Utilization Answer Relevance Quality of Results = Four-Pronged Strategy to Combat AI Hallucinations + Improve Response Quality

Slide 9

Slide 9 text

9 Human in the loop Human oversight ensures that AI- generated answers are meaningful, accurate, and free from hallucinations, reinforcing the effectiveness of our automated metrics. Four-Pronged Strategy to Combat AI Hallucinations + Improve Response Quality

Slide 10

Slide 10 text

10 Nexis+ AI ensures transparency by linking outputs to licensed sources, allowing users to validate information with confidence. No Citations T Y P I C A L G E N A I Potential Hallucinations Black Box AI X X Cited Information Cited Sources Valid Information Nexis+ AI w/ Citations N E X I S + A I Four-Pronged Strategy to Combat AI Hallucinations + Improve Response Quality Citations

Slide 11

Slide 11 text

11 Retrieval Augmented Generation (RAG) Automated Metrics Human in the loop Citations A Four-Pronged Strategy to Combat AI Hallucinations + Improve Response Quality

Slide 12

Slide 12 text

12 Questions

Slide 13

Slide 13 text

13 Booth #17 Find Snehit Cherian on LinkedIn