Hi there 👋

Introduction For the past few months I’ve been playing around with open source AI models that run locally. I recently received my second DGX Spark (Asus GX10), which I ordered back in March before the price hikes, and I now have a cluster at home that supports up to 1M tokens of context. Since I am now happy with my setup, I decided to write a post about it. Why I am doing this This is not a guide on how to replace cloud subscriptions. Doing this is much more expensive and a lot more work than most people are willing to admit. If your goal is to completely replace frontier models, you might be disappointed. ...

Introduction I was recently exploring the idea of adding some metrics to my personal project. My use case was simple: I wanted to let users track the number of packets processed by each of their firewall rules over time. All I needed was a graph that showed the daily, weekly, and monthly trends of the number of packets processed by each rule. Initial Exploration As I was researching my options in terms of databases, I quickly came to the conclusion that most of the time series databases out there have limited licensing options. This meant that I would either have to host a managed service in their cloud or self-host it on a VM in the cloud of my choice (GCP). This was looking like a lot of work for something that I just wanted to try out. Since I already had a Postgres database running on Cloud SQL, I decided to explore the possibility of also using it for time series data. ...

I’ve been recently working with the Go package google/nftables written by Michael Stapelberg and wanted to share some insights on why and how to use it as an alternative to invoking the nft CLI tool via shell commands. Introduction If you are familiar with iptables, you probably know that it has been deprecated in favor of nft as the default Linux firewalling tool. Many systems still use the iptables frontend via iptables-nft which bridges iptables commands to the nftables backend. ...