Open Source & AI - San Diego

Join us for an exciting exploration into the world of open source, platform engineering and AI! This meetup will feature engaging talks on key technologies and practices driving innovation.

🎤 Speaker Lineup & Talks:

Saniya Jaswani | AI Data Scientist

✨ LLM Inference at scale : How to optimize your GPU cost

Most teams obsess over model selection and fine-tuning, then get blindsided when the inference bill hits. A single poorly configured deployment can burn through hundreds of thousands of dollars before anyone notices. This session breaks down exactly how to prevent that.

We'll go from first principles then to decisions that make or break your production costs: GPU architecture selection, batching strategies, KV cache management, quantization tradeoffs, and throughput optimization for handling thousands of concurrent requests. You'll leave with a mental model for auditing your own inference stack and a practical checklist for cutting costs without sacrificing latency.

Ketan Reddy