Varun Kruthiventi

I'm a Staff Engineer working on AI/ML platforms, based in Hyderabad. I have ten years of experience across cloud infrastructure, backend services, frontends, data platforms, machine learning and, more recently, LLM systems.

Much of my work has been taking ML models from notebooks to production: building inference APIs for classical ML, deep learning and LLMs, on public clouds and on private, air-gapped GPU clusters. I started working on MLOps in 2017, before the term was widely used, and later built search and ranking systems on Elasticsearch.

Today I focus on LLM platform infrastructure: model gateways, agent frameworks, evaluation, and observability for cost and quality.