Staff Engineer · AI/ML PlatformHyderabad, India

I take systems to production.

Staff Engineer with ten years of experience taking software and ML systems to production. I have worked on MLOps since 2017, built search and ranking systems along the way, and now build LLM platforms, agents and observability.

10+

years shipping production software

2017

first MLOps pipelines in production

6

domains: cloud, UI, backend, data, ML and LLMs

4

side projects shipped: dev tools and apps

Latest talkFrom Traces to Verdicts: When Tracing Isn’t Enough for LLMs

01Focus

Where I spend my time

01

Building LLM & agentic platforms

Model gateways with routing and cost attribution, agent orchestration, RAG, and the evaluation and observability around them.

02

ML to production

Taking notebooks and model artefacts to inference APIs for classical ML, deep learning and LLMs, on public clouds and air-gapped private GPU clusters.

03

Search & ranking

Enterprise search across systems with different auth models and schemas, Elasticsearch relevance tuning, and topic modelling to improve ranking.

02Projects

Things I’m building

All projects

Kubernetes · Agents · LLM serving · MCP

Active

Krypton Runtime

Kubernetes-native serving for AI agents, self-hosted LLMs and MCP servers. An Agent CRD for A2A, HTTP and framework-backed containers, a Model CRD that turns Hugging Face GGUF weights into an OpenAI-compatible llama.cpp deployment, one gateway, and Prometheus metrics throughout.

Kubernetes · Rust · Tauri · Desktop

v0.1.5

Loupe

An Apache-2.0 desktop client for Kubernetes. It reads your existing kubeconfig and talks straight to the API server, with no in-cluster component and no telemetry. It uses the server’s discovery and table endpoints, so custom resources work without an upgrade.

Mobile · Android · iOS soon

On Google Play

Vedic Panchang

The traditional Hindu calendar, computed on the device: tithi, nakshatra, yoga, karana and vara for any date and city, with sunrise and sunset, in English, Hindi and Telugu.

Rust · Apache DataFusion · SQL

knowhere

A SQL engine for querying CSV, Parquet and Delta Lake files, with a desktop GUI and a terminal UI. Built on Apache DataFusion.

03Speaking

Talks

All talks
Varun speaking at a podium next to a slide asking who has set up observability for an LLM app

July 25, 2026 · Hyderabad

From Traces to Verdicts: When Tracing Isn’t Enough for LLMs

Evaluation and failure detection for production AI systems, where request-level tracing tells you what happened but not whether it was right.

Cloud Native Hyderabad: AI x Observability Meetup

04Writing

Latest posts

All posts