Building a Platform in Kubernetes
Nowadays LLMs are very popular, so I wanted to experiment with deploying one on brand-new infrastructure, starting everything from zero. A popular choice for serving LLMs is vLLM, an inference engi...
Nowadays LLMs are very popular, so I wanted to experiment with deploying one on brand-new infrastructure, starting everything from zero. A popular choice for serving LLMs is vLLM, an inference engi...
I’ve been building ec2-sandbox, a small Terraform + Makefile setup to spin up a GPU development environment on AWS on demand. The motivation I wanted to experiment with LLMs, specifically deployi...
I’ve been building english-teacher-agent, a small project born from a simple observation about my own English lessons. The motivation When I turned on the AI analytics feature in my English learn...
Welcome to my blog. Here I’ll be writing about software engineering, infrastructure, and the technical projects I’m working on. What to expect Some of the topics I plan to cover: Infrastructu...