← Full program

19 October 2026 15:00–15:40 Cosmos 3CD English

How We Test an AI Chatbot in the Biggest Pharmacy Chain of Norway

In early 2024, I developed an AI-powered RAG-based chatbot for Apotek 1, the largest pharmacy chain in Norway. This assistant helps pharmacists find accurate internal information across more than 450 locations. While developing the chatbot was a great achievement, testing it turned out to be a challenge. Every time we changed a single prompt, model parameter, or retrieval setting, we had to verify the impact. Waiting for deployments or relying on third-party tools wasn’t good enough. I needed something fast, simple, and tailored to our needs, so I built it myself :) In this talk, I’ll share how I designed and implemented our custom chatbot testing tool in just a few days. You’ll see how such tools can give you full control, speed up iteration, and avoid regressions. The session includes code examples, practical tips, and lessons learned. By the end, you'll understand how to implement your own lightweight testing setup, without relying on expensive or complex tools. I look forward to seeing you at my talk!

  • Backend
  • Test
  • AI/ML

Speaker

Vadzim Prudnikau

Co-Owner @ Trainitek & Hands-on Architect @ Apotek 1

Hands-on Architect, IT Trainer, and Conference Speaker with 20+ years of experience, passionate about building high-quality software, mentoring developers, and sharing knowledge. I've trained over 550 professionals in Architecture, EventStorming, and TDD, built and deployed more than 10 production-ready projects, led multiple development teams, and created a successful Java department from scratch. Along the way, I’ve mentored 20+ developers and conducted 100+ technical interviews. My expertise lies in Java, but I also have experience with Kotlin, Groovy, and other programming languages. I believe that strong technical skills, continuous learning, teamwork, and knowledge-sharing are the keys to success in software development.

Our partners