6 ms·
I find the very popular response of "you're just not using it right" to be big copout for LLMs, especially at the scale we see today. It's hard to think of any
by ivanovm 1y ago
I find the very popular response of "you're just not using it right" to be big copout for LLMs, especially at the scale we see today.
It's hard to think of any other major tech product where it's acceptable to shift so much blame on the user.
Typically if a user doesn't find value in the product, we agree that the product is poorly designed/implemented, not that the user is bad. But AI seems somehow exempt from this sentiment
- DanielVZ 1y ago> It's hard to think of any other major tech product where it's acceptable to shift so much blame on the user. Sorry to be pedantic but this is really common in tech products: vim, emacs, any second-brain app, effectiveness of IDEs depending on learning its features, git, and more.
- ndsipa_pomu 1y agoWell, surely vim is easy to use - I started it and and haven't stopped using it yet (one day I'll learn how to exit)
- lmeyerov 1y agoIt's a specialist tool. You wouldn't be surprised that it took awhile for someone to take a big to get at typed programming, parallel programming, docker, IaaC, etc. either. We have 2 sibling teams, one the genAI devs and the other the regular GPU product devs. It is entirely unsurprising to me that the genAI developers are successfully using coding agents with long-running plans, while the GPU developers are still more at the level of chat-style back-and-forth. At the same time, everyone sees the potential, and just like other automation movements, are investing in themselves and the code base.
- xandrius 1y agoOn the other hand if you don't use vim, emacs, and other spawns from hell, you get labeled a noob and nothing can ever be said about their terrible UX. I think we can be more open minded that an absolutely brand new technology (literally did not exist 3y ago) might require some amount of learning and adjusting, even for people who see themselves as an Einstein if only they wished to apply themselves.
- iLemming 1y ago> you get labeled a noob No one would call one a noob for not using Vim or Emacs. But they might for a different reason. If someone blindly rejects even the notion of these tools without attempting to understand the underlying ideas behind them, that certainly suggests the dilettante nature of the person making the argument. The idea of vim-motions is a beautiful, elegant, pragmatic model. Thinking that it is somehow outdated is a misapprehension. It is timeless just like musical notation - similarly it provides compositional grammar and universal language, and leads to developing muscle memory; and just like it, it can be intimidating but rewarding. Emacs is grounded on another amazing idea - one of the greatest ideas in computer science, the idea of Lisp. And Lisp is just as everlasting, like math notation or molecular formulas — it has rigid structural rules and uniform syntax, there's compositional clarity, meta-reasoning and universal readability. These tools remain in use today despite the abundance of "brand new technology" because time and again these concepts have proven to be highly practical. Nothing prevents vim from being integrated into new tools, and the flexibility of Lisp allows for seamless integration of new tools within the old-school engine.
- xandrius 1y agoOne could try to be poetic with LLMs in order to make their point stronger and still convince absolutely no one who wasn't already convinced. I'm sure nobody really reject the notion of LLMs but sure as hell do like to moan if the new technology doesn't absolutely perfect fit their own way of working. Does that make them any different than people wanting an editor which is intuitive to use? Nobody will ever know.
- iLemming 1y ago> still convince absolutely no one who wasn't already convinced. I don't know, people change their opinions all the time. I wasn't convinced about many ideas throughout my career, but I'm glad I found convincing arguments for some of them later. > wanting an editor which is intuitive to use Are you implying that Vim and Emacs are not? Intuitive != Familiar. What feels unintuitive is often just unfamiliar. Vim's model actually feels pretty intuitive after the initial introduction. Emacs is pretty intuitive for someone who grokked Lisp basics - structural editing and REPL-driven development. The point is also subjective, for some people "intuitive editor" means "works like MS Word", but that's just one design philosophy, not an objective standard. Tools that survive 30+ years and maintain passionate user bases must be doing something right, no? > the new technology doesn't absolutely perfect fit their own way of working. Emacs is extremely flexible, and thanks to that, I've rarely complained about new things not fitting my ways. I bend tools to fit my workflow if they don't align naturally — that's just the normal approach for a programmer.
- deleted 1y ago[deleted]
- novaleaf 1y agoI've spent the last 2 months trying to figure out how to utilize AI properly, and only in the last week do I feel that I've hit upon a workflow that's actually a force multiplier (vs divisor).
- player1234 1y ago[dead]
- viraptor 1y ago> It's hard to think of any other major tech product where it's acceptable to shift so much blame on the user. It's completely normal in development. How many years of programming experience you need for almost any language? How many days/weeks you need to use debuggers effectively? How long from the first contact with version control until you get git? I think it's the opposite actually - it's common that new classes of tools in tech need experience to use well. Much less if you're moving to something different within the same class.
- KaiserPro 1y ago> How many days/weeks you need to use debuggers effectively I understand your point, but would counter with: gdb isn't marketed as a cuddly tool that can let anyone do anything.
- themk 1y agoHmmm, I don't see it? Are debuggers hard to use? Sometimes. But the debugger is allowing you to do something you couldn't actually do before. i.e. set breakpoints, and step through your code. So, while tricky to use, you are still in a better position than not having it. Just because you can get better at using something doesn't automatically mean that using it as a beginner makes you worse off. Same can be said for version control and programming.
- anthonypasq 1y agoi guarantee you there were millions of people that needed to be forced to use excel because they thought they could do the calculations faster by hand. we retroactively assume that everyone just obviously adopts new technology, yet im sure there were tons and tons of people that retired rather than learning how computers worked when the PC revolution was happening.
- Avshalom 1y agoLinus did not show up in front of congress talking about how dangerously powerful unregulated version control was to the entirety of human civilization a year before he debuted Git and charged thousands a year to use it.
- Lerc 1y ago>It's hard to think of any other major tech product where it's acceptable to shift so much blame on the user. Is that perhaps because of the nature of the category of 'tech peoduct'. In other domains, this certainly isn't the case. Especially if the goal is to get the best result instead of the optimum output/effort balance. Musical instruments are a clear case where the best results are down to the user. Most crafts are similar. There is the proverb "A bad craftsman blames his tools" that highlights that there are entire fields where the skill of the user is considered to be the most important thing. When a product is aimed at as many people as the marketers can find, that focus on individual ability is lost and the product targets the lowest common denominator. They are easier to use, but less capable at their peak. I think of the state of LLMs analogous to home computing at a stage of development somewhere around Altair to TRS-80 level. These are the first ones on the scene, people are exploring what they are good for, how they work, and sometimes putting them to effective use in new and interesting ways. It's not unreasonable to expect a degree of expertise at this stage. The LLM equivalent of a Mac will come, plenty of people will attempt to make one before it's ready. There will be a few Apple Newtons along the way that will lead people to say the entire notion was foolhardy. Then someone will make it work. That's when you can expect to use something without expertise. We're not there yet.
- edmundsauto 1y agoNew technologies that require new ways of thinking are always this way. "Google-fu" was literally a hirable career skill in 2004 because nobody knew how to search to get optimal outcomes. They've done alright improving things since then - let's see how good Cursor is in 10 years.
- sanderjd 1y ago> It's hard to think of any other major tech product where it's acceptable to shift so much blame on the user. Maybe, but it isn't hard to think of developer tools where this is the case. This is the entire history of editor and IDE wars. Imagine running this same study design with vim. How well would you expect the not-previously-experienced developers to perform in such a study?
- fingerlocks 1y agoNo one is claiming 10x perf gains in vim. It’s just a fun geeky thing to use with a lot of zany customizations. And after two hellish years of memory muscling enough keyboard bindings to finally be productive, you earned it! It’s a badge of pride! But we all know you’re still fat fingering ggdG on occasion and silently cursing to yourself.
- TeMPOraL 1y ago> No one is claiming 10x perf gains in vim. Sure they are - or at least were, unitl the last couple years. Same thing with Emacs. It's hard to claim this now, because the entire industry shifted towards webshit and cloud-based practices across the board, and the classical editors just can't keep up with VS Code. Despite the latter introducing LSP, which leveled the playing field wrt. code intelligence itself, the surrounding development process and the ecosystem increasingly demands you use web-based or web-derived tools and practices, which all see a browser engine as a basic building block. Classical editors can't match the UX/DX on that, plus the whole thing breaks basic assumptions about UI that were the source of the "10x perf gains" in vim and Emacs. Ironically, a lot of the perf gains from AI come from letting you avoid dealing with the brokenness of the current tools and processes, that vim and Emacs are not equipped to handle.
- fingerlocks 1y agoYeah I’m in my 40s and have been using vim for decades. Sure there was an occasional rando stirring up the forums about made-up productivity gains to get some traffic to their blog, but that was it. There has always been push back from many of the strongest vim advocates that the appeal is not about typing speed or whatever it was they were claiming. It’s just ergonomics and power. It’s just not comparable to the LLM crazy hype train. And to belabor your other point, I have treesitter, lsp, and GitHub Copilot agent all working flawlessly in neovim. Ts and lsp are neovim builtins now. And it’s custom built for exactly how I want it to be, and none of that blinking shit or nagging dialog boxes all over VSCode. I have VScode and vim open to the same files all day quite literally side by side, because I work at Microsoft, share my screen often, and there are still people that have violent allergic reactions to a terminal and vim. Vim can do everything VSCode does and it’s not dogshit slow.
- milchek 1y agoI think the reason for that is maybe you’re comparing to traditional products that are deterministic or have specific features that add value? If my phone keeps crashing or if the browser is slow or clunky then yes, it’s not on me, it’s the phone, but an LLM is a lot more open ended in what it can do. Unlike the phone example above where I expect it to work from a simple input (turning it on) or action (open browser, punch in a url), what an LLM does is more complex and nuanced. Even the same prompt from different users might result in different output - so there is more onus on the user to craft the right input. Perhaps that’s why AI is exempt for now.
- ay 1y agoJust a few examples: Bicycle. Car(driving). Airplane(piloting). Welder. CNC machine. CAD. All take quite an effort to master, until then they might slow one down or outright kill.
- deleted 1y ago[deleted]
- Maxious 1y ago>It's hard to think of any other major tech product where it's acceptable to shift so much blame on the user. Apple's Response to iPhone 4 Antenna Problem: You're Holding It Wrong https://www.wired.com/2010/06/iphone-4-holding-it-wrong/ https://www.wired.com/2010/06/iphone-4-holding-it-wrong/
- davely 1y agoMobile phone manufacturers were telling users this long before the iPhone was ever invented. e.g., Nokia 1600 user guide from 2005 (page 16) [0] [0] https://www.instructionsmanuals.com/sites/default/files/2019-05/Nokia-1600-en.pdf https://www.instructionsmanuals.com/sites/default/files/2019...
- TeMPOraL 1y agoThe important difference is that in your example, it was the manufacturer telling customers they're holding it wrong. With LLMs, the vendors say no such things - it's the actual users that are saying this to their peers.
- wiether 1y agoI don't see how the Antennagate can be qualified as "acceptable" since it caused a big public uproar and Apple had to settle a class action lawsuit. https://www.businessinsider.com/apple-antennagate-scandal-timeline-10-year-anniversary-2020-7 https://www.businessinsider.com/apple-antennagate-scandal-ti...
- 8note 1y agoit didnt end the iphone as a brand, or end smart phones altogether though. how much did that uproar and settlement matter?
- jeswin 1y agoNot every tool can be figured out in a day (or a week or more). That doesn't mean that the tool is useless, or that the user is incapable.
- lackoftactics 1y agoStay tuned, a new study is coming with another revelation: you aren't getting faster by using Vim when you are learning it. My previous employer didn't even allow me to use Vim until I learned it properly so it wouldn't affect my productivity. Why would using a cursor automatically make you better at something if it's just new to you and you are already an elite programmer according to this study?
- player1234 1y agoHow did you measure this? Was the conslusion of your studies that typing/editing speed was the real bottlekneck for a SWE becoming 10x?
- redhale 1y agoKubernetes. AWS. React. All have high learning curves to use effectively, hoardes of footguns, etc. But if you get over that curve, they can be fantastic tools with tons of value. LLM-assisted dev tooling is similar, in my view.
- Kon5ole 1y ago>It's hard to think of any other major tech product where it's acceptable to shift so much blame on the user. I have the opposite impression! I find it's hard to think of any other tech product where users expect to master it with no training at all. I think people get tricked into believing they need no training because the tool uses natural language as the UI. You learn how to use a spreadsheet or a word processor, how to drive a car, sail a boat, play a guitar. In the 90s there were courses that spent hours teaching users how to work a mouse and keyboard! Of course you need to learn how to use a coding assistant as well, it just makes sense. There has already been a million words written about how to use LLMs from people who don't really know how to use LLM's. Everyone is learning, there is a boom, you can make a fortune selling knowledge about LLM's whether you have that knowledge or not.
- sarlalian 1y agoThere are plenty of examples of other tech where "you're just not using it right" is perfectly acceptable and many people find that it provides a high level of value. Rust and Vim being two that come immediately to mind. Both have sharp edges and steep learning curves, yet for some population are wildly popular, yet not right for everyone. It's also possible for the user to be not using it right and that not be a value judgement on the user. We all suck at using new tools, that's part of learning.