The Query Fan-Out Session: Determining Optimal Time Windows for LLM Bot Request Bundling

A Query Fan-Out Session is a bundle of web requests from an LLM chat assistant that originated from a single user question.

My research analyzed the timing patterns of LLM bot requests, to find the ideal time window to group LLM requests of ChatGPT-user for better LLM activity reporting.

Transcript