9 ms·
This is all wonderful and all but what happens when these tools aren't available - you lose internet connection or the agent is misconfigured or you simply ran
by FitchApps 8mo ago
This is all wonderful and all but what happens when these tools aren't available - you lose internet connection or the agent is misconfigured or you simply ran out of credits. How would someone support their business / software / livelihood? First, the agents would take our software writing tasks then they encroach on CI/CD and release process and take over from there...
Now, imagine a scenario of a typical SWE in todays or maybe not-so-distant future: the agents build your software, you simply a gate-keeper/prompt engineer, all tests pass, you're now doing a production deployment at 12am and something happens but your agents are down. At that point, what do you do if you haven't build or even deployed the system? You're like a L1 support at this point, pretty useless and clueless when it comes to fully understanding and supporting the application .
- darkhorse222 8mo agoPeople used to and still say the same thing about GPS. As these systems mature they stay up and become incorporated into our workflows. The implication in the case of GPS was that navigating on your own is not a very critical task anymore. Correspondingly the implication here is that software design and feature design are more important than coding or technical implementation. Similar to Google, it's more important that you know how and what to ask for rather than be able to generate it yourself.
- psyclobe 8mo agoIt’s kinda scary actually. After getting used to ai doing all the work, doing it yourself again is like using a toilet without a bidet.
- bathwaterpizza 8mo agoBuy a Mac and run a local model that's likely good enough
- akomtu 8mo agoOr your business gets flagged by an automated system for dubious reasons with no way to appeal. It's the old story of big tech: they pretend to be on your side first, but their motives are nefarious.
- dham 8mo agoThe tools are going to ~zero (~ 5 years). The open source LLM's are here. No one can put them back or take them down. No internet, no problem. I don't see a long term future in frontier llm companies.
- Sevii 8mo agoWhat I don't get is, how are these free LLMs getting funded? Who is paying $20-100 million to create an open weights LLM? Long term why would they keep doing it?
- dham 8mo agoI see what you're saying, but it doesn't matter that much in the long run. If everything stopped right now, the state-of-the-art open source models can still solve a lot of problems. They may never solve coding, per se, but they're good enough.
- direwolf20 8mo agoBillionaires trying to hurt each other. Facebook released LLaMa hoping to hasten OpenAI's bankruptcy.
- LtWorf 8mo agoBut it's not open, and in fact AFAIK it's not possible to use commercially.
- direwolf20 8mo agoIt's possible, just not legal if they find out and you're worth suing.
- LtWorf 8mo agoThanks for the pointless correction!
- 8mo ago
- Kiboneu 8mo agoIt’s like with most programmers today having forgotten assembly. If their compiler breaks, what are they going to do?! (I jest a bit, actually agree since turning assembly->compiled code is a tighter problem space than requirements in natural language->code)
- ambicapter 8mo agoWhat a grossly disingenuous comparison.
- Kiboneu 8mo agoRead the second line. If you can't generalize then I can't help you. Have good faith (and obtain a sense of humor).
- ambicapter 8mo agoI can't read it, your comment has been flagged. Good day.
- Kiboneu 8mo agoThat flag won't stick. Flagging someone just because you disagree with them is abusing the system. It adds noise and more work for the moderators to actually remove spam and troll comments. There's a downvote button. If you flagged it, then should be obvious to you after a decade of having an account on this site. If you still don't get it, then I can only assume that you're trolling (good luck with that). Also, fix your browser or whatever you use to read hn. Good day. lol
- ambicapter 8mo agoNo, I didn't flag your comment lol Still a terrible apples to oranges comparison.
- 8mo ago
- t_mahmood 8mo agoYeah! I use JetBrains AI assistant sometimes, which suddenly showing only blank window, nothing else. So, not getting anything out of it. But I can see my credits are being spent! IF I was totally dependent on it, I would be in trouble. Fortunately I am not.
- i_am_proteus 8mo agoI am not convinced of the wonderfulness, because the study implies that AI does not improve task completion time but does reduce programmer's comprehension when using a new library.
- raw_anon_1111 8mo agoYes instead I am suppose to understand the library I use the most boto3? https://boto3.amazonaws.com/v1/documentation/api/latest/index.html https://boto3.amazonaws.com/v1/documentation/api/latest/inde... I don’t need to comprehend “the library”. I need to know what I need to do and then look up the API call.
- esperent 8mo agoI've had a fairly long career as a web dev. When I started, I used to be finicky about configuring my dev environment so that if the internet went down I could still do some kind of work. But over time, partly as I worked on bigger projects and partly as the industry changed, that became infeasible. So you know what do, what I've been doing for about a decade, if the internet goes down? I stop working. And over that time I've worked in many places around the world, developing countries, tropical islands, small huts on remote mountains. And I've lost maybe a day of work because of connectivity issues. I've been deep in a rainforest during a monsoon and still had 4g connection. If Anthropic goes down I can switch to Gemini. If I run out of credits (people use credits? I only use a monthly subscription) then I can find enough free credits around to get some basic work done. Increasingly, I could run a local model that would be good enough for some things and that'll become even better in the future. So no, I don't think these are any kind of valid arguments. Everyone relies on online services for their work these days, for banking, messaging, office work, etc. If there's some kind of catastrophe that breaks this, we're all screwed, not just the coders who rely on LLMs.
- alt187 8mo agoNow I wonder, how has this become infeasible exactly?
- lmc 8mo ago> And over that time I've worked in many places around the world, developing countries, tropical islands, small huts on remote mountains. And I've lost maybe a day of work because of connectivity issues. I've been deep in a rainforest during a monsoon and still had 4g connection. cries on a Bavarian train
- giancarlostoro 8mo ago> This is all wonderful and all but what happens when these tools aren't available - you lose internet connection or the agent is misconfigured or you simply ran out of credits. How would someone support their business / software / livelihood? This is why I suggest developers use the free time they gain back writing documentation for their software (preferably in your own words not just AI slop), reading official docs, sharpening your sword, learning design patterns more thoroughly. The more you know about the code / how to code, the more you can guide the model to pick a better route for a solution.
- FitchApps 8mo agoI'm seeing things that are seriously alarming though. Claude can now write better documentation and document things 95% there (we're building a set of MCP tools and API end-points for a large enterprise..) - Claude is already either writing code or fixing bugs or suggesting fixes. We have a PM, who has access to both React and API projects, on our team who saw one of the services return 500; they used Claude to pinpoint the bug to exact database call and suggest a fix. So now, it's quite common for PMs to not only post bugs but also "suggested fixes" from the agents. In a not so distant future, developers here will be simply redundant since PM can just use Claude to code and support the entire app. Right now, they still rely on us for support and deployments but that could go away too.
- giancarlostoro 8mo agoSure Claude can write better docs but if you dont write the documentation yourself you wont fully know the codebase. I would argue write docs and then have Claude critique it. Then adjust.
- 3371 8mo agoWell, if they make the decision to accept the suggestion and it's wrong, that's on them. But if you do, that's on you. LLM? How can your boss blame the LLM? Like yelling at it?
- giancarlostoro 8mo ago
- luxcem 8mo agoAt some point it will get treated like infrastructure, what a typical SWE is doing when cloudfare is broken or AWS is down.
- newsoftheday 8mo agoAt most places I've worked, we can still get things done when AWS/GCP/Azure/OCI are down. For my own selfhosted work, I'm more self-reliant. But I'm aware there are some companies who do 100% of their work within AWS/GCP/Azure/OCI and are probably 100% down when they go down. That's a consequence of how they decided to architect their apps, services and infrastructure.
- b_t_s 8mo agoSame thing you do if AWS goes down. Same thing we used to do back in the desktop days when the power went out. Heck one day before WFH was common we all got the afternoon off 'cause the toilets were busted and they couldn't keep 100 people in an office with no toilets. Stuff happens. And if that's really not acceptable, you invest in solutions with the understanding that you're dumping a lot of cash into inefficient solutions for rare problems.
- empath75 8mo ago> - you lose internet connection or the agent is misconfigured or you simply ran out of credits. What happens when github goes down. You shrug and take a long lunch.
- newsoftheday 8mo agoWhen GitHub goes down? I keep working, that's the point of a distributed version control system.
- 1718627440 8mo agoYes, and when you do want to share with your colleagues `git push /media/user/usb` takes a few seconds and plugging an Ethernet cable into both computers and disabling ufw takes a few minutes (when you need to find a cable first).
- wodenokoto 8mo agoThe stack overflow era wasn’t that long ago and none of us could write a library call without consulting online sources. You are at least a decade late to post fears about developers reliance on the internet. It was complete well before the LLM era
- 1718627440 8mo ago> none of us could write a library call without consulting online sources. I use SO quite often, but it is for questions I would otherwise consult other people, because I can't figure it out short of reverse-engineering something. For actual documentation man pages and info documents are pretty awesome. Honestly I dread leaving the world of libraries shipped with my OS vendor, because the quality of documentation drops fast.
- wizzwizz4 8mo agoI rely on the internet just as much as the rest of you. When that goes down, I crack out man pages, and the local copy of the documentation I can build from source code comments, and (after a 5-minute delay while I figure out how to do that) I'm back to programming. I'm probably half as quick, but I'm also learning more (speeding me up when the internet does come back on), so overall it's not actually time lost.
- raw_anon_1111 8mo agoOr I can just take a break, go to the gym downstairs, etc … Before you go on about kids these days, my first time coding was on an Apple //e in assembly.
- greenie_beans 8mo ago> This is all wonderful and all but what happens when these tools aren't available - you lose internet connection or the agent is misconfigured or you simply ran out of credits. i would work on the hundreds of non-coding tasks that i need to do. or just not work? what do you do when github actions goes down?
- LtWorf 8mo agoDon't rely solely on github actions?
- greenie_beans 8mo agoit's only an example for a rhetorical question
- seanmcdirmid 8mo agoI invested in a beefy laptop that can run Qwen Coder locally and it works pretty good. I really think local models are the future, you don’t have to worry about credits or internet access so much.
- jimmaswell 8mo agoWhat are the specs, and how does it compare to Copilot or GPT Codex?
- seanmcdirmid 8mo agoYou can check out https://www.reddit.com/r/LocalLLaMA/comments/1piq11p/mac_with_64gb_try_qwen3next/ https://www.reddit.com/r/LocalLLaMA/comments/1piq11p/mac_wit... for a sentiment of usefulness and the specs of the machines running it. It will be some variation of Max or Ultra level Apple silicon, and around 64GB or more RAM. Oh, and an HN submission from 9 months ago: https://news.ycombinator.com/item?id=43856489 https://news.ycombinator.com/item?id=43856489 Copilot comparison: Intelligence: Qwen2.5-Coder-32B is widely considered the first open-source model to reach GPT-4o and Claude 3.5 Sonnet levels of coding proficiency. While Copilot (using GPT-4o) remains highly reliable, Qwen often produces more concise code and can outperform cloud models in specific tasks like code repair. Latency: Local execution on an M3 Max provides near-zero network latency, resulting in faster "start-to-type" responses than Copilot, which must round-trip to the cloud. Reliability: Copilot is an all-in-one "vibe" that integrates deeply into VS Code. Qwen requires local tools like Ollama or MLX-LM and a plugin like Continue.dev to achieve the same UX. GPT-Codex: Intelligence & Reasoning: In recent 2025–2026 benchmarks, the Qwen3-Coder series has emerged as the strongest open-source performer, matching the "pass@5" resolution rates of flagship models like GPT-5-High. While OpenAI’s latest GPT-5.1-Codex-Max remains the overall leader in complex, project-wide autonomous engineering, Qwen is frequently cited as the better choice for local, file-specific logic. Architecture & Efficiency: OpenAI models like GPT-OSS-20b (a Mixture-of-Experts model) are optimized for extreme speed and tool-calling. However, the M3 Max with 64GB is powerful enough to run the Qwen3-Coder-30B or 32B models at full fidelity, which provides superior logic to OpenAI's smaller "mini" or "OSS" models. Context Window: Qwen models offer substantial context (up to 128K–256K tokens), which is comparable to OpenAI’s specialized Codex variants. This allows you to process entire modules locally without the high per-token cost of sending that data to OpenAI's servers.
- direwolf20 8mo agoHow would you answer the same question about water or electricity? Your pizza restaurant is all wonderful and all but what happens when the continual supply of power to the freezer breaks? How will you run your restaurant then?
- cyanydeez 8mo agoI think you laid out why so much mobey is being pressed into this: its digital crack and if they can addict enough businesses, they have subscription moats. Oraclification.
- blub 8mo agoLosing connectivity is a non-issue because it will come back soon enough absent some global event. The realistic risks are rather: * all services are run at a loss and they increase price to the point the corp doesn’t want to pay for everyone any more. * it turns out that our chats are used for corporate espionage and the corps get spooked and cut access * some dispute between EU and US happens and they cut our access. The solution’s having EU and local models.
- jillesvangurp 8mo agoWhy wouldn't these tools be available suddenly? Once you answer the question, the challenge then becomes mitigating that situation rather than doing things the old way. Like having backup systems, SLAs from network and other providers, etc. Actually, the last thing you probably want is somebody reverting back to doing things the way we did them 20 years ago and creating a big mess. Much easier to just declare an outage and deal with it properly according to some emergency plan (you do have one, right?). CI/CD are relatively new actually. I remember doing that stuff by hand. I.e. I compiled our system on my Desktop system, created a zip file, and then me and our operations department would use an ISDN line to upload the zip file to the server and "deploy" it by unzipping it and restarting the server. That's only 23 years ago. We had a Hudson server somewhere but it had no access to our customer infrastructure. There was no cloud. I can still do that stuff if I need to (and I sometimes do ;-) ). But I wouldn't dream of messing with a modern production setup like that. We have CI/CD for a reason. What if CI/CD were to break? I'd fix it rather than adding to the problem by panicking and doing things manually.
- reycharles 8mo ago> Why wouldn't these tools be available suddenly? Take a look at how ridiculously much money is invested in these tools and the companies behind them. Those investments expect a return somehow.
- vineyardmike 8mo agoThe models are already made. They can just run the very useful models they have indefinitely, and they’d be profitable. Or when they go under someone else can buy the rights to the weights. Anthropic, a common coding model provider, has said that their models generate enough cash to cover their own training costs before the next one is released. If they stopped getting massive investments, they should be able to coast with the models they have.
- jillesvangurp 8mo agoI look at this as cost savings waiting to happen. Nvidia extorts companies to the extent of tens of thousands for a GPU. Somebody's going to undercut them. At the same time, people are working on optimizations as well. Using cheap CPUs for inference instead of expensive GPUs. Doesn't work for anything but if your model is small enough you can get away with it. Using lower bit quantization makes the models cheaper to run. Using hacks like prompt caching makes subsequent calls more efficient. Etc. Your base assumption is that it is expensive and therefore these companies will eventually fail when they keep on making less money than they are spending. The reality is that they are indeed spending enormously now and making a lot of very non linear progress. At the same time a lot of that stuff is being widely published and quite a lot of it is open source. At some point you might get consolidation and maybe some companies indeed don't make it. But their core tech will survive. Investors might be crying in a corner. But that won't stop people from continuing to use the tech in some form or another. I already have a laptop that can some modestly largish models locally. I'm not going to spend 40K or whatever on something that can run a GPT 5 class model. But it's not going to cost that in a few years either. This tech is here to stay. We might pay more or less for it. The current state is the worst it is ever going to be. It's going to be faster, bigger, better, cheaper, more useful, etc. At some point the curves flatten and people might start paying attention to cost more. Maybe don't burn a lot of gas in expensive and inefficient gas generators (as opposed to more efficient gas power plants) and maybe use cheap wind/solar instead. Maybe get some GPUs from a different vendor at a lower price? Maybe take a look at algorithm efficiencies, etc. There is a lot of room for optimization in this market. IMHO surviving companies will be making billions, will be running stuff at scale, and will be highly profitable. Maybe some investors won't get their money back. Shit happens. That's why it's called venture capital. The web bubble bursting didn't kill the web either.
- deleted 8mo ago[deleted]
- DesaiAshu 8mo agoOn device models (deepseek-coder, etc) are very good // better than the old way of using stack overflow on the internet. I have been quite productive on long haul flights without internet! You're an engineer, your goal is to figure stuff out using the best tools in front of you Humans are resilient, they reliably perform (and throw great parties) in all sorts of chaotic conditions. Perhaps the thing that separates us most from AI is our ability to bring out our best selves when baseline conditions worsen
- Gallows4574 8mo agoI know this gets asked all the time, but what is your preferred workflow when using local models? I was pretty deep into it early on, with Tabby and Continue.dev, but once I started using Claude Code with Opus it was hard to go back. I do the same as you, and still use them on flights and whatnot, but I think my implementation could be improved.
- Bnjoroge 8mo agoon-device models are still a tier or two below most frontier models(really opus 4.5).
- light_hue_1 8mo agoThis is the argument that people used to fight against rich customized IDEs like emacs for decades. What if you need to ssh into a machine that only has baseline vi in an emergency? I'll happily optimize my life for 99.999% of the time. If the Internet is down for a long time, I've got bigger problems anyway. Like finding food.
- 1718627440 8mo ago> If the Internet is down for a long time, I've got bigger problems anyway. I don't know about you, but I don't connect to the internet most of the time, and it makes more productive, not less.
- bigbuppo 8mo agoWell, you're supposed to pay for the Platinum Pro Gold Deluxe package which includes priority support with an SLA so that six months down the road you get a one month credit for the outage that destroyed your business.
- RA_Fisher 8mo agoThat reminds me of when teachers would say: what if you're without a calculator? And yet we all have smartphones in our pockets today with calculators.
- davidmurdoch 8mo agoHaving a deep intuition about what the calculator is doing is the skill we were actually being taught. Teachers don't know always understand why things are being taught.
- RA_Fisher 7mo agoI’m a fan of using a variety of methods to teach, no issue with that. My issue is with teachers that don’t admit how the world is changing. Dinosaurs.
- 1718627440 8mo ago> Teachers don't know always understand why things are being taught. Yes, but I don't think that is the actual bottleneck, even when they do, most children probably don't care about abstract goals, but rather about immediate skills in their everyday life, or just the statement, that they will need it.
- davidmurdoch 8mo agoI guess I'm just trying to suggest that teachers sometimes might think they know why things are being taught, and make claims like "you wont always have a calculator" as the reason for learning mathematics. One conclusion might be that it'd be better for some students if teachers understood the why, as they might change their approach on some subjects. An example: knowing that certain equations and patterns EXIST, and which kinds of problems they apply to, is generally much more important that knowing the actual equations by heart themselves.
- fatherwavelet 8mo ago"You can't begin to paint until you have learned to stretch canvas by hand like the old masters. What if one day you couldn't just go to the art supply store and buy a pre-stretched canvas? It is all besides the point anyway. You are going to learn to stretch canvas by hand first because that is what my teacher made me do!"
- raw_anon_1111 8mo agoWhat good would being able to “build my software” without internet access unless I’m building software for a disconnected desktop? Exactly what am I going to do with it? How am I going to get to my servers?
- zahlman 8mo ago> unless I’m building software for a disconnected desktop? ... Why wouldn't you build software that works there? As I understand things, the purpose of computers is to run software. But more importantly, let's suppose your software does require an Internet connection to function. Why should that imply a requirement for your development environment to have one? Why should that imply a requirement for a code generation tool to have one?
- raw_anon_1111 8mo agoBecause to a first approximation, no one wants desktop software, maintenance is a pain, it’s a pain to distribute across a large organization and people want to use the same app across devices and no one will pay me for it. > But more importantly, let's suppose your software does require an Internet connection to function. Because I have been able to depend on “fast” internet since 2000 both at home and at work, just like I’ve been able to depend on a compiler since 1992? There is nothing so important that can’t wait in the rare chance that internet goes out. > Why should that imply a requirement for a code generation tool to have one Because I don’t want to spend thousands of dollars to run a frontier model locally when I can spend $20/month and codex is included with my ChatGPT subscription?
- zahlman 8mo agoThen why are people constantly talking about how expensive it is now to get a new computer with 64GB of RAM and several TB of flash storage and a modern graphics card? Why would they remotely need any of that, if "to a first approximation no one wants desktop software"? > when I can spend $20/month and codex is included with my ChatGPT subscription? I bought the machine I'm posting from for about $1k (with some minor upgrades since then). Canadian. More than 11 years ago. And that gets me the entire computer rather than one specific cloud service. $20/month is a lot, actually. Even comparing to a new computer (which there is apparently still a lot of demand for): monthly charges really should be compared to a couple decades of principal, the amount you'd have to save up to yield that cash flow as a return on investment (or just interest). But even just a year or two of $20/month is hundreds of dollars. That's not insignificant, when the opportunity cost is reckoned in terms of physical goods that perform general computation.