Traceability and Observability in Multi-Step LLM Systems | Langfuse

In this session, Marc Klingen, CEO & Co-Founder at Langfuse (https://github.com/langfuse/langfuse), talked about advanced techniques and best practices for implementing traceability and observability in multi-step LLM systems.

He also discussed how leveraging OpenTelemetry (OTel) can provide deep insights into RAG systems. 💡

Topics that were covered:

✅ Multi-Step LLM Applications: Understanding the complexity of LLM systems that involve multiple steps, agents, and chains.

✅ Integration Example (RAG): A detailed examination of how RAG systems work. We’ll demonstrate how user input, message history, and additional memory are combined to produce an aggregated response with accompanying sources.

✅ Traces for Observability: Learn about the role of traces in observability and how they serve as a powerful abstraction for logging and monitoring in both production and development environments.