GPU Workload: Hosting an LLM
In this third post, I’ll deploy a GPU node in my cluster. The GPU node will be used to host one of the heaviest workloads nowadays: an LLM. LLMs are huge — they use large Docker images, and their w...
Bootstrapping the Platform with Argo CD
Continuing with the construction of the platform started in the previous post, we’ll now add Argo CD to the cluster and the other components needed to make the platform usable. The apps I’ll insta...
Building a Platform in Kubernetes
I wanted to build a platform where I could deploy multiple projects and experiment with different applications, so as the most customizable tool for the job, I chose Kubernetes. The goal of this p...
ec2-sandbox: a GPU dev environment on AWS
I’ve been building ec2-sandbox, a small Terraform + Makefile setup to spin up a GPU development environment on AWS on demand. The motivation I wanted to experiment with LLMs, specifically deployi...
English Teacher Agent: real-time feedback while you speak
I’ve been building english-teacher-agent, a small project born from a simple observation about my own English lessons. The motivation When I turned on the AI analytics feature in my English learn...
Welcome to the blog
Welcome to my blog. Here I’ll be writing about software engineering, infrastructure, and the technical projects I’m working on. What to expect Some of the topics I plan to cover: Infrastructu...