Session Abstract

Your concept of a product that leverages the power of Large Language Models is gaining traction, and your initial API calls to the selected LLM vendor show promising results. What's next? Should you look forward to ensure your app is scalable, maintainable, safe, secure, and ready for the introduction and monitoring of quality metrics like groundedness, as well as operational metrics such as latency and token consumption? Or should you look back to reconsider model selection or fine-tuning, refine prompts, and improve RAG techniques? And how do you close the continuous improvement loop? In this session, we cover all the important milestones of your LLM-powered product from both application and operations perspectives by introducing the LLMOps maturity model, as well as useful tools and services to support your journey. This will help you determine the best next steps for your Generative AI-based product to achieve operational excellence in today's dynamic and ever-evolving landscape of LLM technology.

Note to event organizers

After introducing LLMOps and its maturity model, we'll embark on the adaptation journey step by step, covering: - Selecting the best LLM for your business requirements - Enriching LLM responses with data relevance and contextualization - Best practices for prompt engineering - Assessing the performance of your LLM solution - Effective management of LLM application deployment - Continuous monitoring techniques for LLM applications - Ensuring safety and security in LLM content

Maxim Salnikov

Maxim Salnikov is a tech and cloud community enthusiast based in Oslo. With over two decades of experience as a web developer, he shares his extensive knowledge of the web platform, cloud computing, and AI by speaking at and providing training for developer events worldwide. By day, Maxim plays a crucial role in supporting the development of cloud and AI solutions within European companies, serving as the leader of developer productivity business at Microsoft. During evenings, he can be found running events for Norway's largest web and cloud development communities. Maxim is passionate about exploring and experimenting with Generative AI possibilities, including AI-assisted development. To share his insights and connect with like-minded professionals globally, he founded and organized the inaugural Prompt Engineering Conference, the first of its kind on a global scale.

Back to speaker profile