7 ms·
At this point, I trust LLMs to come up with something more secure than the cheapest engineering firm for hire.
by lr4444lr 7mo ago
At this point, I trust LLMs to come up with something more secure than the cheapest engineering firm for hire.
- minimalthinker 7mo agothis.
- lukan 7mo agoAnd the cheapest engineering firm won't use LLMs as well, wherever possible?
- fc417fc802 7mo agoThe cheapest engineering firm will turn out to be headed up by an openclaw instance.
- TheRealPomax 7mo agofun fact, LLMs come in cheapest and useless and expensive but actually does what's being asked, too. So, will they? Probably. Can you trust the kind of LLM that you would use to do a better job than the cheapest firm? Absolutely.
- Aurornis 7mo agoThe cheapest engineering firms you hire are also using LLMs. The operator is still a factor.
- jama211 7mo agoYeah, but they’ll add another layer of complexity over doing it yourself
- Aurornis 7mo agoThe people doing these kickstarters are outsourcing the work because they can’t do it themselves. If they use an LLM, they don’t know what to look for or even ask for, which is how they get these problems where the production backend uses shared credentials and has no access control. The LLM got it to “working” state, but the people operating it didn’t understand what it was doing. They just prompt until it looks like it works and then ship it.
- caminante 7mo agoYou're still not following. The parents are saying they'd rather vibe code themselves than trust an unproven engineering firm that does(n't) vibe code.
- TeMPOraL 7mo ago> they'd rather vibe code themselves than trust an unproven engineering firm You could cut the statement short here, and it would still be a reasonable position to take these days. LLMs are still complex, sharp tools - despite their simple appearance and proteststions of both biggest fans and haters alike, the dominating factor for effectiveness of an LLM tool on a problem is still whether or not you're holding it wrong.
- caminante 7mo agoI forgot about that Jobs/Apple reference! Paraphasing, LLMs are great (bad) tools for the right (wrong) job... in the right hands, at the right time, in the right place...
- Aurornis 7mo agoI’m following exactly, but the parent commenter is off on a tangent unrelated to the topic. We’re not taking about the parent commenter, we’re talking about unskilled Kickstarter operators making decisions. Not a skilled programmer using an LLM.
- numpad0 7mo agoThis took me a while(I'm slow), but I think GP is saying: "I've seen enough of (expressions) thinking ideas is the key when engineering was; with everyone snorting LLMs, we'll see that replicating in software world" but nicely. THAT makes sense. Engineering was never cheap nor non-differentiating if normalized by man-hours, only when it was USD normalized. If a large enough number of people were to get the same FALSE impression that software and firmware parts are now basically free and non-differentiating commodities, then there will be tons of spectacular failures in software world in coming years. There has already been early previews of those here.
- nozzlegear 7mo ago"Anyone else out there vibe circuit-building?" https://xcancel.com/beneater/status/2012988790709928305 https://xcancel.com/beneater/status/2012988790709928305
- alexjplant 7mo agoPeople make these mistakes too. Several times in my high school shop class kids shorted out 9V batteries trying to build circuits because they didn't understand how electronics work. At no point did our teacher stop them from doing so - on at least one occasion I unplugged one from a breadboard before it got too toasty to handle (and I was/am an electronics nublet). Similarly there was also a lot of hand-wringing about the Gemini pizza glue in a world where people do wacky stuff like cook fish in a dishwasher or defrost chicken overnight on the counter or put cooked steak on the same plate it was on when raw just a few minutes prior. LLMs are just surfacing the fact that assessing and managing risk is an acquired, difficult-to-learn skill. Most people don't know what they don't know and fail to think about what might happen if they do something (correctly or otherwise) before they do it, let alone what they'd do if it goes wrong.
- nozzlegear 7mo agoWell said, but I'd add that LLMs are also surfacing the fact that there's a swathe of people out there who will treat the machines as more trustworthy than humans by default, and don't believe they need to do any assessment or risk management in the first place.
- hnlmorg 7mo agoPeople are just lazy. It’s got nothing to do with LLMs having more trust because they’re a machine because most people would happily trust their friend over an expert. They’d trust the first blog post they find online over an expert. Most people are just too lazy and not skilled enough to perform independent review. And to be fair to those people, coming to topics with a research mindset is genuinely hard and time consuming. So I can’t actually blame people for being lazy. All LLMs do is provide an even easier way to “research”. But it’s not like people were disbelieving random Facebook posts, online scams, and word-of-mouth before LLMs.
- Kiro 7mo agoLLMs definitely write more robust code than most. They don't take shortcuts or resort to ugly hacks. They have no problem writing tedious guards against edge cases that humans brush off. They also keep comments up to date and obsess over tests.
- devmor 7mo agoInteresting and completely wrong statement, what gave you this impression?
- Kiro 7mo agoThe discourse around LLMs has created this notion that humans are not lazy and write perfect code. They get compared to an ideal programmer instead of real devs.
- salawat 7mo agoLLM's at best asymptotically approach a human doing the same task. They are trained on the best and the worst. Nothing they output deserves faith other than what can be proven beyond a shadow of a doubt with your own eyes and tooling. I'll say the same thing to anyone vibe coding that I'd say to programmatically illiterate. Trust this only insofar as you can prove it works, and you can stay ahead of the machine. Dabble if you want, but to use something safely enough to rely on, you need to be 10% smarter than it is.
- gxs 7mo agoAmen. On top of that, especially now, with good prompting you can get closer to that better than you think.
- joe_mamba 7mo agoThis. The hacks, shortcuts and bugs I saw in our product code after i got hired, were stuff every LLM would tell you not to do.
- dylanowen 7mo ago
- seanmcdirmid 7mo agoI don’t know, you can get a lot of nice engineering done in a Shenzhen dark alley.