How I Self-Host AI at Home
Introduction For the past few months I’ve been playing around with open source AI models that run locally. I recently received my second DGX Spark (Asus GX10), which I ordered back in March before the price hikes, and I now have a cluster at home that supports up to 1M tokens of context. Since I am now happy with my setup, I decided to write a post about it. Why I am doing this This is not a guide on how to replace cloud subscriptions. Doing this is much more expensive and a lot more work than most people are willing to admit. If your goal is to completely replace frontier models, you might be disappointed. ...