Config-Driven Development for LLMs: Versioning, Routing, & Evaluating LLMs 🚀

In this session, Sarmad, CEO of LastMile AI will talk about how engineering teams can successfully transition their Generative AI apps from prototype to production with open-source and remote LLMs. He will cover how to manage AI prompts and model generation settings as JSON-serializable configs – enabling version control, evaluation, and rapid prototyping.🚀

During the session, he will introduce AIConfig, an open-source framework to build production-ready Generative AI apps.

Topics that were covered:

✅ Learn about JSON-serializable configs, their structure, and how they can be used to manage AI prompts and model generation settings.

✅ Learn how to integrate these configurations with version control systems for better tracking and management of LLM changes.

✅ Learn how AIConfig, an open-source framework can technically enhance collaboration, strengthen governance, and ensure reproducibility.