File Ingestion Pipeline
Incoming data from dozens of heterogeneous sources needed to land reliably in a data lake with schema validation and lineage tracking.
Built an event-driven ingestion service that watches object storage for new uploads, validates schemas, converts formats, and routes files to downstream consumers. Includes dead-letter handling and retry logic orchestrated through Temporal workflows.
Python · Temporal · MinIO · PostgreSQL · Docker
Outcome: Reduced manual data onboarding from days to minutes. Zero data loss across six months of operation.
Self-Hosted Object Storage (Raspberry Pi)
Needed affordable, private S3-compatible storage for side projects without depending on cloud providers.
Set up a MinIO cluster across two Raspberry Pi 4 boards with automated backups, TLS termination via Caddy, and health-check scripts that alert via Telegram.
MinIO · Raspberry Pi · Caddy · Bash · systemd
Outcome: Reliable home lab storage running 24/7 for over a year. Used as the backend for three other personal projects.
Kubernetes Learning Lab
Wanted a reproducible, low-cost environment to learn Kubernetes networking, storage, and observability hands-on.
Created a k3s-based lab using Vagrant and Ansible. Includes Prometheus + Grafana monitoring, Loki for logs, and a sample microservices app with deliberate failure modes for chaos testing.
k3s · Vagrant · Ansible · Prometheus · Grafana
Outcome: Developed deep operational intuition for Kubernetes. Open-sourced the setup; used by a few folks as a learning starter kit.
LLM-Powered Codebase Q&A
Onboarding onto large, undocumented codebases is slow. Wanted a way to ask natural-language questions about a repo.
Built a CLI tool that indexes a Git repository into a vector store, then answers questions using retrieval-augmented generation. Supports filtering by file type and date range.
Python · LangChain · ChromaDB · OpenAI API · Click
Outcome: Cut personal onboarding time on unfamiliar repos noticeably. Useful for reviewing legacy systems during incident investigations.
Uptime & Certificate Monitor
Needed lightweight monitoring for personal and small-team services without the overhead of a full observability stack.
Wrote a Python service that periodically checks HTTP endpoints and TLS certificate expiry. Sends alerts to Telegram and logs history to SQLite. Runs as a single Docker container.
Python · HTTPX · SQLite · Docker · Telegram Bot API
Outcome: Caught two certificate expirations and one DNS misconfiguration before they became outages.
Geospatial Data Platform
A team needed to query, visualize, and export large geospatial datasets without spinning up expensive GIS software.
Designed a backend using PostGIS for spatial queries, exposed through a gRPC service with a thin REST gateway. Included tile-serving for map previews and bulk CSV/GeoJSON export.
Python · PostGIS · gRPC · Redis · Docker
Outcome: Enabled the team to run spatial queries on millions of rows in seconds. Replaced a manual workflow that took hours.