Agentic AI Night: AI Infrastructure

Join us for an evening of insightful talks, valuable connections, and great company.

This one is a collaboration: CNCF Sydney x AAIF are bringing the cloud native and agentic AI communities into the same room.

Everyone is shipping agents. Far fewer people are talking about what it takes to actually run them. As agentic AI moves from prototypes to production, the infrastructure underneath matters as much as the models and the agents themselves.

**Speaker 1:** Hrittik Roy, Founding Platform Advocate at vCluster and CNCF Ambassador

**Talk 1:** From Local Inference to Kubernetes: What Changes When Your LLM Gets Busy?

**Details:** Running an LLM locally is a great starting point. But what happens when one user becomes hundreds, requests compete for GPU memory, and response times start climbing?

This talk follows an inference request from prompt to generated tokens, explaining prefill, decode and the KV cache. We’ll explore how batching, model caching and GPU scheduling affect latency and