4 ms·
Serious question but if it hallucinates about almost everything, what's the use case for it?
by marinhero 1y ago
Serious question but if it hallucinates about almost everything, what's the use case for it?
- rotexo 1y agoAn army of troll bots to shift the Overton Window?
- ants_everywhere 1y agooh no now we'll never hear the end of how LLMs are just statistical word generators
- iLoveOncall 1y agoNothing, just like pretty much all models you can run on consumer hardware.
- cyanydeez 1y agoThis message brought to you by OpenAI: we're useless, but atleast theres a pay gate indicating quality!
- striking 1y agoIt's intended for finetuning on your actual usecase, as the article shows.
- simonw 1y agoFine-tuning for specific tasks. I'm hoping to see some good examples of that soon - the blog entry mentions things like structured text extraction, so maybe something like "turn this text about an event into an iCal document" might work?
- turnsout 1y agoGoogle helpfully made some docs on how to fine-tune this model [0]. I'm looking forward to giving it a try! [0]: https://ai.google.dev/gemma/docs/core/huggingface_text_full_finetune
- CuriouslyC 1y agoFine tuning messes with instruction following and RL'd behavior. I think this is mostly going to be useful for high volume pipelines doing some sort of mundane extraction or transformation.
- iib 1y agoThis is exactly the fine-tuning I am hoping for, or I would do if I had the skills. I tried it with gemma3 270M and vanilla it fails spectacularly. Basically it would be the quickadd[1] event from google calendar, but calendar agnostic. [1] https://developers.google.com/workspace/calendar/api/v3/reference/events/quickAdd https://developers.google.com/workspace/calendar/api/v3/refe...
- zamadatix 1y agoI feel like the blog post, and GP comment, does a good job of explaining how it's built to be a small model easily fine tuned for narrow tasks, rather than used for general tasks out of the box. The latter is guaranteed to hallucinate heavily at this size, that doesn't mean every specific task it's fine tuned to would be. Some examples given were fine tuning it to efficiently and quickly route a query to the right place to actually be handled or tuning it to do sentiment analysis of content. An easily fine tunable tiny model might actually be one of the better uses of local LLMs I've seen yet. Rather than try to be a small model that's great at everything it's a tiny model you can quickly tune to do one specific thing decently, extremely fast, and locally on pretty much anything.
- deadbabe 1y agoGames where you need NPCs to talk random jiberrish.
- numpad0 1y agorobotic parrots?
- luckydata 1y agoBecause that's not the job it was designed to do, and you would know by reading the article.
- yifanl 1y agoIt's funny. Which is subjective, but if it fits for you, it's arguably more useful than Claude.
- mirekrusin 1y agoThe same as having a goldfish. You can train it to do a trick I guess.