5 ms·
It’s fascinating to think about what true GUI for LLM could be like. It immediately makes me think a LLM that can generate a customized GUI for the topic at ha
by hgl 1y ago
It’s fascinating to think about what true GUI for LLM could be like.
It immediately makes me think a LLM that can generate a customized GUI for the topic at hand where you can interact with in a non-linear way.
- nbbaier 1y agoI love this concept and would love to know where to look for people working on this type of thing!
- dpkirchner 1y agoLike a HyperCard application?
- necrodome 1y agoWe (https://vibes.diy/ https://vibes.diy/) are betting on this
- diggan 1y agoBorder-line off-topic, but since you're flagrantly self-promoting, might as well add some more rule breakage to it. You know websites/apps who let you enter text/details and then not displaying sign in/up screen until you submit it, so you feel like "Oh but I already filled it out, might as well sign up"? They really suck, big time! It's disingenuous, misleading and wastes people's time. I had no interest in using your thing for real, but thought I'd try it out, potentially leave some feedback, but this bait-and-switch just made the whole thing feel sour and I'll probably try to actively avoid this and anything else I feel is related to it.
- necrodome 1y agoThanks for the benefit of the doubt. I typed that in a hurry, and it didn’t come out the way I intended. We had the idea that there’s a class of apps [1] that could really benefit from our tooling - mainly Fireproof, our local-first database, along with embedded LLM calling and image generation support. The app itself is open source, and the hosted version is free. Initially, there was no login or signup - you could just generate an app right away. We knew that came with risks, but we wanted to explore what a truly frictionless experience could look like. Unfortunately, it didn’t take long for our LLM keys to start getting scraped, so the next best step was to implement rate limiting in the hosted version. [1] https://tools.simonwillison.net/ https://tools.simonwillison.net/
- diggan 1y agoMy complaint isn't about that you need to protect it with a login/signup, but where in the process you put that login/signup. Put it before letting people enter text, rather than once they've entered text and pressed the button, and people won't feel mislead anymore.
- jchrisa 1y agoThe generation is running while you login, so this appreciable decreases wait time from idea to app, because by the time you click through the login, your app is ready. (Vibes DIY CEO here.) If login takes 30 seconds, and app gen 90, we think this is better for users (but clearly not everyone agrees.) Thanks for the feedback!
- karpathy 1y agoFun demo of an early idea was posted by Oriol just yesterday :) https://x.com/OriolVinyalsML/status/1935005985070084197 https://x.com/OriolVinyalsML/status/1935005985070084197
- aprilthird2021 1y agoThis is crazy cool, even if not necessarily the best use case for this idea
- hackernewds 1y agoit's impressive but it seems like a crappier UX? that none of the patterns can really be memorized
- suddenlybananas 1y agoHaving different documents come up every time you go into the documents directory seems hellishly terrible.
- falcor84 1y agoIt's a brand of terribleness I've somewhat gotten used to, opening Google Drive every time, when it takes me to the "Suggested" tab. I can't recall a single time when it had the document I care about anywhere close to the top. There's still nothing that beats the UX of Norton Commander.
- sensanaty 1y ago[flagged]
- cjcenizal 1y agoMy friend Eric Pelz started a company called Malleable to do this very thing: https://www.linkedin.com/posts/epelz_every-piece-of-software-forces-you-to-learn-activity-7335696786247831552-GL1_ https://www.linkedin.com/posts/epelz_every-piece-of-software...
- whatarethembits 1y agoI'm curious where this ends up going. Personally I think its a mistake; at least at "team" level. One of the most valuable things about a software or framework dictating how things are done is to give a group of people a common language to communicate with and enforce rules. This is why we generally prefer to use a well documented framework, rather than letting a "rockstar engineer" roll their own. Only they will understand its edge cases and ways of thinking, everyone else will pay a price to adapt to that, dragging everyone's productivity down. Secondly, most people don't know what they want or how they want to work with a specific piece of software. Its simply not important enough, in the hierarchy of other things they care about, to form opinions about how a specific piece of software ought to work. What they want, is the easiest and fastest way to get something done and move on. It takes insight, research and testing to figure out what that is in a specific domain. This is what "product people" are supposed to figure out; not farm it out to individual users.
- swader999 1y agoYou bake those rules into the folders in a Claude.md file and it becomes it's guide when building or changing anything. Ubiquitous language and all that Jazz.
- jonny_eh 1y agoAn ever-shifting UI sounds unlearnable, and therefore unusable.
- dang 1y agoIt wouldn't be unlearnable if it fits the way the user is already thinking.
- guappa 1y agoAI is not mind reading.
- NitpickLawyer 1y agoA sufficiently advanced prediction engine is indistinguishable from mind reading :D
- dang 1y agoBehavioral patterns are not unpredictable. Who knows how far an LLM could get by pattern-matching what a user is doing and generating a UI to make it easier. Since the user could immediately say whether they liked it or not, this could turn into a rapid and creative feedback loop.
- kevinventullo 1y agoSo, if the user likes UI’s that don’t change, the LLM will figure out that it should do nothing? One problem LLM’s don’t fix is the misalignment between app developers’ incentives and users’ incentives. Since the developer controls the LLM, I imagine that a “smart” shifting UI would quickly devolve into automated dark patterns.
- dang 1y agoA user who doesn't want such changes shouldn't be subjected to them in the first place, so there should be nothing for an LLM to figure out. I'm with you on disliking dark patterns but it seems to me a separate issue.
- semi-extrinsic 1y agoHumans are shit at interacting with systems in a non-linear way. Just look at Jupyter notebooks and the absolute mess that arises when you execute code blocks in arbitrary order.
- bicepjai 1y agoWhat is the mess you are referring with regards to Jupyter notebooks ?
- semi-extrinsic 1y agoIf you run cells out of order, you get weird results. Thus you have efforts like marimo which replace jupyter with something that reruns all dependent cells.
- stoisesky 1y agoThis talk https://www.youtube.com/watch?v=MbWgRuM-7X8 https://www.youtube.com/watch?v=MbWgRuM-7X8 explores the idea of generative / malleable personal user interfaces where LLMs can serve as the gateway to program how we want our UI to be rendered.
- stuartmemo 1y agoIt's probably Jira. https://medium.com/question-park/all-aboard-the-ai-train-b03ec62aaae1 https://medium.com/question-park/all-aboard-the-ai-train-b03...