Time: 3:00 PM
Room: ASC B
Measuring GenAI Solutions
Over 85% of GenAI related POCs never make it to production. The most cited reason for this is lack trust in the solution. In this session we explore tools to address this issue, LLM evaluations!
We will show both the philosophy behind how LLM evaluations work, what the metrics mean, as well and how you can use this data to overcome roadblocks to production, and ultimately, providing business value with your solution.
Grey Lovelace
Senior Software Consultant, Coach, and GenAI Specialist
Source Allies
Grey Lovelace is a Senior Software Consultant at Source Allies, specializing in generative AI solutions and enterprise architecture. With over a decade of experience building resilient applications across insurance, financial services, and agriculture sectors, he has experienced first hand what works, and what doesn’t stand the test of time
As an early adopter in the generative AI space, Grey focuses on cutting through the hype to deliver practical, business-driving solutions. He brings a pragmatic approach to AI implementation, drawing from his extensive experience designing systems that gracefully handle real-world complexity. Grey's expertise lies in transforming emerging AI capabilities into robust systems that deliver measurable value in production.
Matt Vincent
Founder
Source Allies
Matt Vincent is the founder of Source Allies, an Iowa-based IT consultancy that builds innovative AI solutions for large enterprises. Inspired by an early fascination with neural networks—sparked by his father’s University research—he helped establish the AI/ML practice at Source Allies years ago, working with organizations from startups to Fortune 100 companies. Specializing in quantifying AI performance, reliability, transparency, and accountability, Matt ensures that AI systems are both innovative and trustworthy. He is dedicated to demystifying AI and empowering enterprises to harness its potential responsibly.