This solo builder runs 24/7 local AI on his own hardware | Alex Finn

[00:00] What is stacked around your office right now? I have three Mac Studio 512 gigabytes. We got a DGX Spark as well as a computer. I just built an RTX 5090. Basically at all times of the day, each one of these computers is just burning tokens. The number one pushback I get on all this is your computers are so expensive. Isn't cloud models cheap? Isn't it $20 for a ChadGBT subscription? Well, that's not the point. The point is in pure ROI. [00:30] The use cases it unlocks. You now have, because you have AI models running locally, the ability to run unlimited intelligence [00:39] around the clock 24/7. If you were to do that with [00:44] a cloud model like ChadGBT or Claude, you would be spending outrageous amounts of money. What else fun are you doing with AI? The most fun I've been having lately is building out my software factories. I have two loops in Claude code going. I have a build loop and a review loop. First, it has a build loop where it'll take all those tasks [01:07] and start building out the tasks it came with over and over and over again. And then it has a review loop that takes all the tasks that were built and has another agent go in and review it. Once that's reviewed, it pings me on Slack, and I can just leave a rocket emoji. And when I leave the rocket emoji, it says "Merged." And my Henry loop goes and merges it. It's been a blast kind of cracking this nut of how do you build your own software factory?

[01:35] Welcome back to How I AI. I'm Claire Vaux, product leader and AI obsessive here on a mission to help you build better with these new tools. Today, I have Alex Finn, and he's going to walk us through his two Mac studios. [01:48] DGX Spark and the Nvidia backed computer he built for himself and demystify what it means to run local models and have ambient AI working for you 24 hours a day. Let's get to it. This episode is brought to you by Runway, a new kind of creative platform that has everything you need to generate any image, video, or piece of content you want all in one place. With Runway, it's now possible [02:18] matter of minutes. [02:19] From turning low fidelity product shots into campaign ready imagery all the way through putting together big brand films, Runway can help your team scale your creative ambitions while keeping your budgets and timelines from doing the same. [02:33] Runway brings together the world's most advanced AI models, which is why enterprises like Microsoft, Robinhood, Amazon, and Adobe, along with studios like Lionsgate and Legendary, all use Runway to ship real work every day. Try it yourself at RunwayML.com slash HowIAI. Promo code HowIAI. [02:59] Alex, welcome to How I AI Hardware Edition, Local Model Edition. I am so excited.

[03:06] excited. So before we jump in, tell us just what is stacked around your office right now? [03:12] It feels like a sauna in this office right now, to be quite honest with you, because I got a lot going. [03:19] I have three Mac Studio 512 gigabytes, which apparently puts me in the wealth class of Elon Musk having these now. I think they resell for like $30,000 each. We got a DGX Spark. [03:33] as well as a computer I just built two days ago, basically a big... [03:39] computer built around an RTX 5090. So we have, I think, what's that come out to five or six different [03:45] computers for AI. So a lot of hardware around here. [03:49] And you are making really good use of it. Yeah. So I use it basically as what I call ambient AI to support my entire life. And we'll go through all the things it's doing. But basically at all times of the day, each one of these computers is just burning tokens, doing things, helping my life. Right. Unlimited AI is basically how local AI works. And I'll have them doing jobs around the clock for me, which you really can't do a cloud cloud. [04:15] you know, APIs. [04:16] So how did we get here? How did you become... [04:19] hardware, local model guy. Like, like, why is it so hot in your, in your office? What? [04:26] What brought you to this moment? [04:28] My big awakening was back in January when I discovered Open Claw. [04:34] And so I was scrolling X one day on a Friday,

[04:37] I saw a blog post around OpenClaw. [04:41] I open it and I'm like, "Wow, this is really interesting. Don't know why, my gut instinct is like I gotta go buy a Mac Mini." This is before anyone was talking about Open Claw, by the way. [04:49] I get a Mac Mini. [04:51] put it on, start using it, [04:53] It was one of the most aha awakening moments of my life. [04:56] And something about building this like personal bond [05:00] with [05:01] the open claw and with this agent was like [05:05] I want this to live in the computer. I don't want this to come from the cloud. I don't want this. I want this working for me on my computer. [05:13] And like, this is the future, just having this kind of personal assistant [05:18] on your computer and so i started doing research okay how can i run uh models locally and i came inclusion all right i'm gonna go now after buying this mac mini and buy a mac studio with tons and tons of ram and run local models and run it locally and so that was kind of my i guess red pill moment into local ai was using openclown it only just advanced the last couple months you know then they started banning frontier models like fable [05:45] and then the hardware prices start exploding and it just felt like [05:51] Everything was moving in this direction of like sovereign own your own intelligence. And so I just can investing more and more and more into it over the last couple of months. So I mean, I had a very similar moment, which is I just like got deeply claw pilled in in January. Like it just I remember.

[06:09] I told this story. I woke up one morning and turned to my husband because this is the kind of things I say to him. [06:13] And I was like, I'm having a chat, like truly having a chat GPT moment. [06:17] where I think everything from here on out is going to be totally different. [06:22] different. So every red pill that we took is that little lobster color, I think. And I... [06:27] Look. [06:28] I [06:30] accidentally by accidentally. I just like waited too long to get a studio and now literally I can't afford one or find one. [06:36] But I do have little fat stacks of minis back here that are doing... [06:40] plenty of good work, but through through cloud API. So I'm a little bit behind you. [06:46] I'm a strong believer, though, that those minis will be very useful soon enough. Like Google is doing a lot of research around like optimizing models so they can run on hardware like mini. So you won't be out of the game for long. Well, and I still I still find use for them. They're still they're still happily at work. They're just at expensive, expensive cloud work. But let's go to, you know, you you have all these. [07:09] these machines, you have bought them, [07:12] and you have built them. [07:14] Kind of what's good for what? Can you walk me through like how you make decisions and how you actually just get these models set up and running on on these machines? Yeah. So I have been experimenting the last few months around technology. [07:27] the different machines, the different capabilities, what they're good for, what they're weak for. Obviously, I started out with the Mac Studio. I bought three of these 512GB. They've been great. But since then, I've experimented with kind of AI-focused computers like the DGX Spark.

[07:43] And then just recently, most recently, I've been buying... [07:47] kind of traditional GPUs from NVIDIA, like the 5090, soon the 6000 Pro. [07:53] I put together a little chart here, which I'll show you. [07:57] So you basically have four different options. Your Mac Studios, [08:02] Your AI computers like the DGX Spark, which is getting very popular now. Your kind of powerhouse, traditional Nvidia chips like the 5090, building computers around these chips. [08:12] And then basically everything else, laptops, [08:16] Mac minis, whatever you got sitting around your house. They all have different strengths and weaknesses, different reasons why you'd want to go for one over the other. First, there's the Mac studio. [08:28] What's very powerful about Macs, and the reason why a lot of people are going for them, is they have what's called high unified memory. [08:37] When you buy like an Nvidia chip for instance, and you build it into your computer, you have kind of two separate [08:43] types of memory. You have your memory that runs all your, you know, programs, and then you have your memory which is like your VRAM, which is for your graphics. [08:52] And when you run AI models on that, it's all in the VRAM. The issue is the VRAM is very small. [08:57] With the Mac, it's unified, so everything's the same. So whatever memory you have on your computer can be used for graphical processing. And so if you buy a Mac with a ton of memory, 512 gigabytes, 256, even 128,

[09:13] You can use all of that [09:15] for graphical processing and that graphical processing is what [09:19] you know, runs the AI models. So Mac studios are fantastic for huge big models because you can use unified memory, right? I'm running GLM 5.2, which is Opus 4.8 level, [09:33] you know, intelligence on one Mac studio right now, which is unbelievable. [09:38] The downside is you have very low memory bandwidth with Mac computers, which means you [09:44] it can't process a lot of it all at once, which means speeds are very slow. Right. So the models are very, very slow. If I send a prompt to GLM 5.2 right now on my Mac studio, it might take five minutes for me to get a response back. So it is very, very slow, but you have... [09:59] frontier intelligence [10:02] roaming on your hardware, which is amazing. [10:05] Then you have... [10:06] AI computers. This is like the DGX Spark, very popular right now. It's like, I think the price just went up to like, I think $4,600 or a micro center for 4,000. These are plug and play AI workstations. They have actually unified memory with Nvidia. So you do get a lot of memory, 128 gigabytes. And you also get pretty decent bandwidth and you get the Nvidia architecture, which is called CUDA. [10:34] which basically gives you a lot of speed as well. So it's kind of this sweet spot where you get decent memory, [10:39] and decent speed. [10:41] And so you can run like kinda these mid-sized good models like Quen 3.6,

[10:46] pretty quickly, which is nice. It's also very plug and play, these AI computers. You don't even need a monitor, you just plug it into the wall [10:53] and you can connect to it. [10:56] And then lastly, you have your traditional NVIDIA chips. This is when you go on Twitter and you see the people saying buy GPUs. And they have these huge racks of all these chips. [11:06] These are all Nvidia chips. [11:09] And these are... [11:11] probably the most powerful of all the three, you get kind of lower VRAM, right? The 5090, which is a $4,000 chip, only has 32 gigs of VRAM, but it is lightning fast. It is extremely high bandwidth, and you're getting cloud speeds, but locally, which is [11:29] really amazing so these are really like your three and then you have everything else the mac minis your old laptop you can still run local models on them there's options out there like gemma 4 um like a few other really small ones they're not going to be anything close to frontier but you can do small things like embedding which is basically managing memory for your agents so you have these [11:53] Mac Studio, and just like... [11:55] Big beefy models, high intelligence, slow. [11:58] kind of [12:00] these AI computers, kind of like sweet metal spot, and then these chips. [12:05] very, very speedy. And then, you know, industrial computers, maybe these like [12:10] point solution models that are like small for a specific use case that might be beneficial to be running in some context.

[12:17] but are probably not going to be the thing that you just rely on over and over again. [12:21] Though you still, on dusty old computers, what I say is like, you can still put them to work in terms of parallelizing your cloud work across computers. So we have a bunch of old computers and it's like... [12:34] I cannot do enough on my MacBook Pro. I'm kicking off stuff. [12:39] to other computers just to like run work trees and do all sorts of interesting things. I'm sure I could do that in the cloud too. But, you know, I like to make use of all this hardware sitting around. [12:47] No, and it's, I like to do that as well. I have two Mac minis and I do the exact same thing [12:54] And these apps are so good now, like Codex, for instance, is [12:58] maybe the best agent harness out there right now, you can just go to Codex and be like, "Hey, go on the Mac mini, [13:05] right? Start building an app on there, test it yourself, do play right so you can go through the flow, screenshot things, send me videos. So I actually like running it locally, like on the Mac Mini as opposed to cloud because you can have it actually click through and do things and then like send you screenshots of what it's doing. So it's [13:23] It's a lot better for that too. [13:25] Completely agree. OK, and then how do you get these [13:28] you know, just high level set up with these models. What is kind of your typical install on any of these machines? [13:35] So the good news is Open Claw and Hermes has made this process [13:41] 10 trillion times easier, right? Before you would have to go find the right model, find the right version of it, make sure it can fit into memory, download it, run it on a server, all these really complex things.

[13:55] that a normal person would never be able to do in like a thousand years. [13:59] Well, the good news is you can now take Hermes or Open Claw [14:04] Basically make it your IT guy say, "Hey, check out my Mac Studio, check out my DGX Spark, whatever you got." [14:11] see what the hardware is, and then find whatever model you think is most appropriate for that hardware. [14:16] and load it up. And then so as long as you have [14:19] an agent Hermes are open claw as well as tail scale. [14:23] which basically allows you to create a private network across all your devices [14:28] Your agent's basically your IT guy and can go across all of your devices, install, [14:34] whatever models and needs, set it up, do whatever you need. [14:38] I'm gonna show you a dashboard soon, which shows all my models working and running. It's all coordinated and run [14:44] by my Hermes and my open claw. So as long as you have Hermes open claw going, you're going to say... [14:50] Hey OpenClaw, check out the new Mac Studio I just bought. [14:54] Look at all the hardware, figure out which model we should run, think about the use cases that are appropriate for me. [15:00] and then load up a model and get it going. And like, you don't need any technical knowledge whatsoever. [15:06] They'll go across your devices on tail scale and set it up for you. There really is like no technical work needed. And so to repeat this for folks, just so you want, so I'm understanding, you have a machine set up with OpenClaw. [15:18] You also have all your machines networked on tail scale, which allows you to have this like little virtual private network. [15:24] And then that one sort of like IT guy, open claw, or Hermes agent,

[15:28] can then use tailscale to just go into these different machines, configure and manage them. Yeah, exactly. [15:33] Tailscale is worth getting even if you just have one computer. Yeah. Because it creates this private network where even if you're vibe coding like on your MacBook Pro and you just have a phone, you can like go on the local host on your phone. And from that's on your computer and like test your local apps out because it's all in the same network now. But it's even better if you have multiple computers. So maybe you have your MacBook Pro, then you buy a Mac Studio for AI or a DGX Spark. [16:01] You install TailScale and all of them. And then you can just say, hey, go on this other computer and do this. Load up the model, whatever. And it will jump between all your devices. No technical knowledge needed. And load up and run anything you want. [16:14] This episode is brought to you by Jira Product Discovery. AI has made individual PMs incredibly productive, but multiplayer mode is where it still breaks, getting everyone aligned on what should actually get built. [16:28] Decisions live in a markdown file from last week. The roadmap's a spreadsheet no one's looking at. Jira product discovery is where teams actually decide what to build. [16:38] capture ideas, prioritize them as a team, and share a living roadmap everyone works from. It's powered by Atlassian's Teamwork Graph, so it can pull in customer feedback, what your team shipped, plus your goals, and suggest what to build next. [16:53] And when a decision is made, you can hand it off straight to JIRA, so a developer, or even an agent, can pick it up and start building.

[17:01] Teams at Canva, Deliveroo, and Toast already use Jira Product Discovery. Join more than 25,000 teams at atlassian.com slash howiai. Start building the right things together. [17:17] Okay, so we've talked enough about hardware. We've talked enough about how to get it set up. [17:22] show me how you use it. So what are you using all this [17:26] sort of intelligence for and how do you keep it [17:29] burning tokens. [17:31] you know, effectively. [17:34] I've been building a system over the last couple months to coordinate all these computers and all these models. [17:42] I do a lot of different things just to kind of set the stage here. [17:46] The number one pushback I get on all this is [17:49] Well, [17:50] Your computers are so expensive. Isn't cloud models cheap? Isn't it $20 for a ChadGBT subscription? Why the hell would I buy a $10,000 Mac Studio? That's like 11 years of ChadGBT usage. [18:03] Well, that's not the point. [18:05] The point is in pure ROI. Not everything in your life is pure ROI dollars and cents, right? [18:11] The point is... [18:12] the use cases it unlocks, right? [18:15] You now have, because you have AI models running locally, [18:20] the ability... [18:22] to run unlimited intelligence around the clock 24/7. [18:27] If you were to do that with [18:29] a cloud model like ChadGBT or Claude,

[18:32] you would be spending outrageous amounts of money. So you wouldn't be running it 24/7, burning tokens around the clock. But because it's local, because you have unlimited usage of it, [18:42] You can burn tokens around the clock. And so that brings me to... [18:47] my... [18:48] Fleet control I call it, this is my fleet dashboard. [18:52] which allows me to see all my computers, [18:55] which models are running on them currently, and monitor everything they're doing and organize [19:02] They're 24/7, 365 tasks. Throughout the day, the local models I have running are constantly doing work for me to support my life, to support my many lines of business. I'm building a SaaS right now, Henry Intelligent Machines. Every 30 minutes to an hour, one of these local models does a security scan. So actually picks out [19:24] an API endpoint or some part of my code [19:27] runs a security scan on it and makes sure it's secure. [19:30] Another local model every half hour or so. [19:33] Does a code review picks out some piece of code? [19:37] and de-slopifies it, right? Finds ways to optimize it, finds ways to speed it up, finds ways to make it better. [19:44] Another local model will, every 20 minutes, [19:47] Look at Twitter. [19:48] Reddit, Product Hunt. [19:50] Hacker News and look for Signal. [19:54] As a problem solver, the only way I can solve problems is if I find them, right? And so I have this ambient AI going online

[20:03] 24 hours a day reading all the social media sites, looking for signal, looking for challenges people are having. If someone goes, man, I really wish I had a piece of software that allows me to edit my videos like this or something like that. [20:18] My agent will find that signal, put it in my queue, and I'll be like, okay, can I build a SAS to solve this? Can I build a program to solve this? [20:26] And this is there's many screens here I can go through but that is from a high level [20:31] what these agents are doing and the strength of local AI, is you can have it running 24/7, 365, just doing different things online for you. [20:40] And so for that, let's just talk about the coding use cases really quickly. So for these like automated security scans, automated like quality checks, [20:48] Do you feel like the local models are of sufficient intelligence to get the job done? And are there specific models that you've applied to... [20:57] in particular the coding use case? When getting into local models, you really want to understand... [21:03] What is the delineation between what you want to do with local models and what you want to do with frontier intelligence? Right. You don't want your entire security apparatus to be run by local models. The intelligence just isn't there yet. [21:17] But where the advantages and the strengths come in is... [21:21] Basically, it runs this security scan, looks for these challenges, [21:25] And then what it does is every day it builds a report. [21:28] And you can see some of them here where it'll build a report around what the security issue is, what the code snippet is, what the problem is. Put it all in this markdown file that describes like, for instance, today's has 374 findings in it of security issues.

[21:46] Every day I have a loop running in Claude code. So slash loop 24 hours. [21:52] where it goes and takes whatever the latest finding is from the local models and reviews it and then goes through the code exactly where it points to and sees if it's a real issue and how to fix it or not so [22:04] It's, you know, if I were to [22:06] loop clawed code [22:08] like the local models doing every 20 minutes look at different i'd be spending thousands thousands thousands of dollars a month but the you know the this is almost like the business development rep right that's going qualifying leads and then claude codes like the clothes are taking those leads make okay what can we fix so like you don't have the clothes are doing all the work how do you federate work across these machines and so we're like do you have some that you're like this is my coding machine [22:34] This is my market research machine. [22:36] Are you like round robin? Again, we're like using very SDR terms. Are we round robin these leads? We've both been in the SaaS world way too long. Exactly. Yeah. How do you do that allocation? Again, every model computer has... [22:52] different strengths. GLM 5.2 is... [22:57] Opus level. [22:58] Right? But it's very, very slow. So I don't need it doing... [23:03] super fast work so I can have it doing the security scans, right? I can have it go and do security scans even if it takes 24 hours, that's fine. Claude Coats only check in the report once a day. So it can do the kind of super critical smart stuff. On the other end,

[23:19] Quen36, which is not quite as smart as G-Lam, I can have that reading Twitter and Reddit all day just looking for signal. That's a very simple thing to find. Look for someone who has a challenge. And so it's just pulling in data, crunching it, and reading for challenges, which you don't need the highest intellect. So you just need to know, like, [23:37] What's the strength of the computer? [23:39] What's the strength of the model and what would be tasks that be appropriate for those strengths? Is it in this daily brief that you have these tasks assigned to you? Like, is this the dashboard for you? [23:49] the agents and the machines all to collaborate. [23:52] So I'm going to advance it to the point where it's like collaborative with Cloud Code and Codex eventually. Right now, the system where Cloud Code is like looping every day and going in, that's happening separately, just in its own chat inside Cloud Code where it loops over and over again. [24:08] But no, this is all around my local... [24:13] models but I think where the connector is with everything else going on is with my open claw and my Hermes they're basically the Guy that runs this as well this dashboard then communicates with cloud code. Hey, can you kick this off? Can you do this? So it's kind of all glued together by my personal agent and [24:29] Okay, I have to ask you a question. Open Claw Hermes. [24:33] You run both. You have a favorite. [24:36] Tell me. [24:38] Because much like [24:40] Clawed code in codex [24:42] It feels like there's some days where one is really, really dumb and the other is significantly smarter. And like, I feel like uninstalling one and getting rid of the other. I'll say this, though.

[24:53] The dependability of Open Claw turned me off. There was a run for like a month straight where every update I did broke it, and then I had to spend half an hour... [25:03] Fixing it [25:04] Hermes, I've never had that issue. It seems to be a much more [25:08] dependable application [25:09] I would say this, if both were like 100% dependable, never broke, I can lean on it no matter what. I'd probably be using Open Claw because I think I've had the most wow... [25:20] impressive big bang moments with open claw i just can't afford to be like spending a half hour once a week fixing it from breaking for some reason and so that's why i think i've been using hermy's agent a little bit more lately that's i mean that was my general takeaway as well as like open claw doesn't [25:39] doesn't functionally work, but it works in my heart. [25:42] And Hermes functionally works, but has not cracked my heart yet. [25:47] The trick that I have, I mean, we all have like agents, managing agents, is now I have [25:51] the lifeguard. He's an open claw. He runs on his own gateway. [25:55] And his only job... [25:57] is to keep the other agents alive. He does not get upgrades as much as... [26:01] Everybody yells. Because truly, I was spending like you. [26:04] All my time. [26:06] trying to figure out why my agents were broken um but i just i just love i love my little open clause i can't i can't get over it it's just too good [26:15] I have an emotional attachment to my open claw. I've never had an emotional attachment to my Hermes. [26:20] But I eventually got to the point where I don't care about emotions anymore. I just got to get work done. But I have a similar setup where I have so much failover. So I have, I think, three Hermes agents I'm running. An Opus one, a ChadGBT one, and one on a local model. And then two Open Claws, an Opus and a ChadGBT one. And like...

[26:43] I didn't give him point of those five agents, like three are always down for one reason or other. But the good news is I have two that can go and fix the other. So I had that failover as well. [26:54] perfect well you should have so much in terms of like how to pick hardware how to set up hardware how to manage all this compute across all your machines [27:02] use cases from engineering perspective, from a market discovery perspective. [27:06] What else fun are you doing with AI? Any other ones where you're like, [27:09] I didn't get to show a fun workflow, but just something that's really been a delight for you. [27:14] to use with either local or kind of cloud models? [27:19] The most fun I've been having lately [27:21] is building out my software factory. So there's been this big trend the last month [27:29] And I'll show this to you as well in a second of [27:32] People talking about loops online. Everyone's kind of like vague posting about loops, which is, you know, at first it was kind of, [27:41] Angry me. It was pissing me off a little bit like why are these people vague posting about Lewis? Why wouldn't they go into it? So I spent like [27:48] Days. [27:50] locked in trying to figure out how it can make a really productive loop. And I've just had like a blast the last few weeks trying to make this [27:58] loop system completely autonomous and this is like [28:02] Part of what I showed you ties into it, like the security reviews, the code reviews ties into this loop. [28:07] But basically what I have doing, I'll try to show you enough here. Let's see what I can show you. [28:13] Basically, what I have doing is I have...

[28:18] two loops in Claude code going. I have a build loop. [28:23] in a review loop. And basically what I do is first, I'll start, I'll show you cloud code in a second. First, what I do is I go in a cloud in the morning and I go, uh, [28:35] morning build and ask me a bunch of questions what I'm thinking about. [28:39] comes up with a bunch of tasks to build for my SAS Henry Intelligent Machines. And then what it does is it goes in here and first it has a build loop. [28:51] where it'll take all those tasks and start building out the tasks it came with over and over and over again. [28:58] And then it has a review loop that takes all the tasks that were built. [29:01] and has another agent go in and review it. [29:04] and fix any code or anything like that. [29:07] And then from there, once that's reviewed, I can go in to Slack. It pings me on Slack. [29:13] And. [29:14] It shows me everything that was built and reviewed. [29:17] And I can just leave a rocket emoji. And when I leave the rocket emoji, it says merged. And my Henry loop goes and merges it. And so I have this new workflow. I've had a blast building out, which I think is the future of software development, where [29:31] Before, you prompt your agent all day, hey, build this, now build this, now build this, now build this, and you kind of hand-hold it as it builds things. Now, I go in. [29:41] We talk to each other a little bit, comes up with a bunch of ideas. [29:44] spends all day building it and reviewing itself and testing it out.

[29:48] At the end of the day, I come in, I see what's merge ready, and I just leave a rocket ship emoji on every single thing that looks ready. Shows me exactly how to test it, puts it on its own Vercel preview site, and I can go in. [30:02] test it out and then give it a rocket ship emoji. So this has been like the most fun, interesting thing I've been doing recently. And, you know, I'm figuring out how the local models can tie into it and support this, but it's been a blast kind of [30:15] cracking this nut of how do you just like build your own software factory? I love it. I love it so much. It's giving me some inspiration on some things that [30:23] that I'm going to do with my own loops. And in case folks missed it, I did do a... [30:28] WTF, our loops episode. [30:31] about a week ago. [30:32] Very clear. I do three loops that you can copy and paste. So if you're still trying to figure out, I too was like, why are people being vague about loops? Like, this is not a scary or mysterious thing. So we just popped up the screen share and showed a couple of them. Thesis, by the way. I'll share the thesis. My thesis that why everyone's being vague and not like sharing how they're doing it, like neither OpenAI or Clutter. Like they talk about it a lot, but they haven't shared it. It is like, I think this is kind of the last moat. [31:01] for a lot of these companies is like, [31:03] You know, anyone could build anything they want. [31:05] but the actual infrastructure around it and like how you automate that to put out more code [31:11] Like they probably have their own systems that pump out a ridiculous amount of high quality code. If they were to share how they do it, other people would be able to copy and they'd be able to be equally as productive. But like this is kind of a motive theirs now. Like if they can figure out a really good system that builds high quality codes, I think that's why they're being vague and not sharing it. And I have a suspicion about why non kind of model people are being vague, which is one.

[31:36] their use of loops is probably pretty boring. [31:38] - Yes. - They're not like, guess what? This is my loop. [31:42] In the morning it runs a cron and does this thing, [31:45] And two, they probably get more eyes being vague than being specific. So I am very cynical about the vague posting, which is why we are a screen sharing. [31:55] um podcast here well alex this has been super fun let's do [31:58] Quick lightning round, and then I will get you out of here. [32:02] Question number one of all the hardware, which one is your favorite? [32:06] I'm torn between the Mac Studio and the 5090. I like the Mac Studio because I love the integration with all Apple devices. Everything owns Apple, iPhone, iPad. The integration, being able to run models side by side. [32:19] locally, first of all, I think is the future of computing. I think Apple will start running local models built in that help you out within the next 10 years. [32:28] But I feel like I kind of lean the 5090 because I can play Cyberpunk 2077 in all ultra with all the hyper-realistic mods. So I think I lean the 5090. Okay, and then on the model side of all the models that you have locally installed, do you have one that you just... [32:48] You just really love. [32:50] I've, so I was on QN first 3.5, then 3.6 for basically the entire span of the last five months. I've been on local models, but a new model just came out. I know nothing about the team. I've done zero research, so I hope to God I'm not promoting bad people, but it's called Ornith 1.0. And I think they did some like reinforcement learning on QN and improved it and made it even better at coding.

[33:16] In every eval I've run on it has shown that it's better than Quen. It's faster and smarter. And so Ornith 1.0 35B has been my most used model recently. And you can run on a DJX Spark. So anyone who has that, you can load it up and it works great. [33:32] Who thought that you and I [33:34] SaaS people would just be like, [33:36] Ornith 1.0 83B DGX, like just letter after letter after letter. But this is our life now. I love it. [33:45] We both had the same background working for SaaS marketing tools, spamming people all day with email to now the nerdiest technology on planet Earth. That's exactly right. [33:56] And then last question I ask everybody, when you're open claw, your Hermes agent is being real dumb and not listening to you. [34:04] What is your prompting strategy? Are you extremely polite or... [34:08] Less so. Let's just say this. If my chat logs were to ever leak to the Internet, [34:13] First of all, you would never have me on your podcast again. Second of all, I think I'd be taken off every single social media site. So I am a pretty nasty person to my agents. I am not nice to them. I'll just say I've threatened them multiple times. [34:27] The threats never seem to work, even though I threatened to hurt their agent family. Doesn't work. They still fail. But, uh... [34:33] Yeah, I'm pretty mean but [34:35] I find that when just much like Claude Code and Codex, one's stupid. I just go to the other until things calm down and they figure out what's going on and it gets fixed. And then eventually they're smart again.

[34:46] Amazing. I love it. Well, Alex, this has been so fun. [34:49] Where can we find you and how can we be helpful? [34:52] I'm Alex Spin on YouTube. [34:54] Alex been on X. [34:56] I have a community you can join, the Vibecode Academy. I also have two SaaS I'm working on, Creator Buddy, which is a basically operating system for Twitter, as well as Henry Intelligent Machines, which is coming soon. [35:10] If you do subscribe to me on YouTube, you'll hear about all the other things eventually. Amazing. Alex, well, I will get you back to your machines and back to building. Thanks for joining How I AI. [35:19] Thanks so much for having me, Claire. [35:29] You can also find this podcast on Apple Podcasts, Spotify, or your favorite podcast app. Please consider leaving us a rating and review, which will help others find the show. You can see all our episodes and learn more about the show at howiaipod.com. [35:47] See you next time.