MEL MLOps Community #19 | Advanced Evals & Deep Agent Harnesses

When and where

Date and time

Wed, Sep 30 · 12:30 a.m.PDT — local Abbotsford time

Location

Mantel Group452 Flinders St, Melbourne, VIAbbotsford

About this event

We are stoked to announce our next **Melbourne MLOps Community Meetup** of the year! We’re gathering at Mantel to unpack the realities of building reliable, production-ready AI agents. Join two top-tier industry experts to learn how to move beyond basic evaluations and build the structural harnesses that turn fragile demos into real-world tools. 🎤 Our speakers and topics: 🧪🎯 **The Lesser of Two Evals:** Why Your Agent Passes Benchmarks and Fails Users **Josh Gillies**, Senior Software Engineer @ Prefactor Traditional LLM evaluation metrics (correctness, groundedness, and hallucination checks) are necessary starting points, but they aren't enough to guarantee a great agent. In production, agents encounter unexpected multi-turn branching, bad conversations, and tools which can fail in a myriad of ways. In this talk, we’ll explore evaluations beyond using a single-prompt LLM as a judge and look at Agent quality as a holistic system. 🏗️🧠 **Your Agent Needs a Harness:** How deep ag

Official details

Tickets:

Official ticket page for MEL MLOps Community #19 | Advanced Evals & Deep Agent Harnesses

Price:

Free

Organizer:

Melbourne MLOps Community

Listing source:

meetup

Last verified September 24, 2026 · evntally doesn't sell tickets — we point you to the box office.