
{"id":82,"date":"2026-10-04T22:05:41","date_gmt":"2026-10-04T22:05:41","guid":{"rendered":"https:\/\/shofutex.net\/?p=82"},"modified":"2026-10-04T22:05:41","modified_gmt":"2026-10-04T22:05:41","slug":"more-ai-tinkering-local-models","status":"publish","type":"post","link":"https:\/\/shofutex.net\/index.php\/2026\/10\/04\/more-ai-tinkering-local-models\/","title":{"rendered":"More AI Tinkering: Local Models"},"content":{"rendered":"\n<p>I canceled my Claude subscription. While it was cool to play around with\u2014and super helpful at updating a number of my scripts\u2014I couldn\u2019t really justify the expense. It also, as many others have noted, had some interesting architectural decisions around my scripts, but I\u2019m not sure I would have fared any better. Right now, the Python scripts I built to handle summarizing my Mastodon home timeline have a hodgepodge of configuration and command-line options. I\u2019m putting together a framework to merge the command-line and configuration options, among some other odd architecture choices. That being said, it works\u2014and it\u2019s quite possibly a little more polished than anything I would have written by hand in the same amount of time.<\/p>\n\n\n\n<p>I\u2019ve also gotten qwen3.8 and devstral working with aider in my local environment. They were pretty effective at doing some of the low-hanging fruit tasks I\u2019ve tasked them with. The main issue is how long it takes to run a local model, but I think it\u2019s good experience to tinker with local models. For a lot of conceptual use-cases, I think experience with them is handy for understanding how these models can be used in real-world scenarios. I don\u2019t really envision everything connecting to Claude, or Gemini, or ChatGPT\u2014there too many potential failure states. What happens if there\u2019s a network hiccup? What happens when they change the API? What happens when your credit card expires and you forgot to change it? And\u2014what happens when they increase prices? Local models are pretty handy.<\/p>\n\n\n\n<p>I tried several different local claud-code style solutions and really only got two to function remotely well: opencode and aider. Opencode runs *extremely* slow and every local model seems to get the tooling configuration weird. Aider is much slimmer and it\u2019s proven to be quite effective. I\u2019ve tasked it with updating my scripts\u2014and by configuring larger context windows\u2014it has done a pretty good job on the small tasks I\u2019ve set it about doing. It\u2019s still somewhat slow, but it\u2019s also helpful to watch the thinking process. Watching an AI think through the prompt I gave, ask questions, then make odd choices has helped me better understand how to be more specific in what I ask, which also seems to make the final run go quicker.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Thoughts from the past couple weeks<\/p>\n","protected":false},"author":1,"featured_media":60,"comment_status":"closed","ping_status":"","sticky":false,"template":"","format":"standard","meta":[],"categories":[11],"tags":[],"_links":{"self":[{"href":"https:\/\/shofutex.net\/index.php\/wp-json\/wp\/v2\/posts\/82"}],"collection":[{"href":"https:\/\/shofutex.net\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/shofutex.net\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/shofutex.net\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/shofutex.net\/index.php\/wp-json\/wp\/v2\/comments?post=82"}],"version-history":[{"count":1,"href":"https:\/\/shofutex.net\/index.php\/wp-json\/wp\/v2\/posts\/82\/revisions"}],"predecessor-version":[{"id":83,"href":"https:\/\/shofutex.net\/index.php\/wp-json\/wp\/v2\/posts\/82\/revisions\/83"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/shofutex.net\/index.php\/wp-json\/wp\/v2\/media\/60"}],"wp:attachment":[{"href":"https:\/\/shofutex.net\/index.php\/wp-json\/wp\/v2\/media?parent=82"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/shofutex.net\/index.php\/wp-json\/wp\/v2\/categories?post=82"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/shofutex.net\/index.php\/wp-json\/wp\/v2\/tags?post=82"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}