Skip to content

Work

I mostly work on LLM infrastructure. Older projects are further down.

Airbnb · AI Platform

The team already used the package I maintain, which is how they found me. Their internal LLM gateway, used by roughly 28 services, could not safely serve two providers in one process, because configuration lived in process-wide globals. I moved it to per-model registries resolved per request, giving a structural concurrency guarantee rather than a lock, and put an expiry-aware cache behind the auth path. Thirteen changes across ten repos, zero consumer migrations, and a test suite that went from 17 to 144. Two calls in two months; the rest was async.

PYTHONLLM GATEWAYCONCURRENCYCONTRACT

langchain-litellm

Creator and lead maintainer of LangChain’s official LiteLLM integration. Started as my own repository; now developed and released inside the langchain-ai organization, with its own page in the LangChain docs and an entry in the Python API reference. One interface to 140+ providers, plus router-backed load balancing, embeddings and OCR loading. 15 million downloads across 32 releases, and around 1 million every month.

PYTHONPYPICREATORMAINTAINER

ISO · Companion

Applied AI engineer on Companion, the assistant the International Organization for Standardization builds for its own standards work. I designed the agentic graph patterns it runs on, which is what let it scale without maintenance cost scaling with it, and ran the comparative evaluation behind its web search layer so answers come from official ISO sources rather than the open web. Started the architecture documentation and refactored the legacy codebase while I was in there.

LANGGRAPHAGENTSRETRIEVALCONTRACT

Harvard University · Kenya Blood Donation Assistant

Lead developer on a WhatsApp assistant that answers blood donation questions for users in Kenya, built under the Global Alliance for Medical Innovation at Harvard University. Most people do not phrase a medical question the way a clinical document answers it, so the pipeline rewrites a query before it searches. I worked on that retrieval path, added guardrails for personal data and prompt injection, and ran a red-team pass covering injection, data exposure and medical accuracy before the system went to closed beta. Won Best Presentation at the Spring 2025 showcase.

RAGGUARDRAILSWHATSAPPHEALTHCARE
NC State University

Satellite Vision

Vision Transformers benchmarked head-to-head against CNNs on EuroSAT and UC Merced land-use imagery. Pure PyTorch, built to show where self-attention earns its cost on small-image remote sensing and where it does not.

PYTORCHVITCNNREMOTE SENSING

Ollama Local LLM

Running language models locally with Ollama. Custom modelfiles wired into the Python SDK and LlamaIndex for inference that never leaves the machine.

OLLAMALLAMA-INDEXLOCAL LLM

Tech Mahindra · TinyML

Pruning and INT8 quantization on YOLOv5 for deployment to resource-constrained edge devices. Twelve times smaller, ten times faster on CPU, with detection accuracy held on COCO.

TINYMLQUANTIZATIONYOLOV5EDGE
NC State University

CookBook

Full-stack recipe discovery platform. FastAPI and MongoDB, React and TypeScript, Groq inference for nutrition filtering. CI-tested and coverage-tracked.

FASTAPIREACTMONGODBGROQ

Lane Segmentation + Sign Detection

Real-time semantic segmentation for lane detection layered with traffic-sign recognition on one video stream. Faster R-CNN and ResNet50 on GTSRB; FCN on a custom-labelled lane dataset.

PYTORCHFASTER R-CNNFCNGTSRB
NC State University

The Professional Filter

Work-vs-personal email classifier trained on the Enron corpus, with an LLM-augmented layer for the messy long tail.

PYTHONNLPLLM
NC State University

WolfLease

Django and Streamlit sublease marketplace for student housing, with a multi-criteria search and a linting and coverage CI matrix.

DJANGOSTREAMLITCI