7 ms·

Is... is this named because they have a lemon they're trying to make the most of?

by moconnor 6mo ago

parsimo2010 6mo ago
I think saying "L-L-M" sounds kind of like "lemon," so this is an LLM-aid (sounds like lemonade).
- projektfu 6mo ago
  Wonder why they didn't call it LLMonade, which would be unique.
- metalliqaz 6mo ago
  so obvious and yet I didn't connect the dots. thank you
  - ProllyInfamous 6mo ago
    wait until you discover the LuLuleMonade -connection /s
deleted 6mo ago
[deleted]
TeMPOraL 6mo ago
If life keeps giving it them, they should instead invent a combustible lemon.
- eddieroger 6mo ago
  Do they know who you are? They're the guys who are going to blow your house up ... with the lemons.
  - LorenDB 6mo ago
    On an unrelated note, do you think this software supports running models from a CD?...
- deleted 6mo ago
  [deleted]
altmanaltman 6mo ago
Lemonsqueeze was considered too violent
- nathan_douglas 6mo ago
  If you run it in a cluster, does it become a Lemon Party?
  - speed_spread 6mo ago
    If you run it on someone else's computer it becomes Lemon Stealing
deleted 6mo ago
[deleted]
lrvick 6mo ago
I exclusively buy AMD hardware for local inference. For open drivers, power efficiency, and cost AMD beats Nvidia easily for consumers.
- javchz 6mo ago
  Any recommendations in the current market? Love how plug and play and is on Linux from the driver side of things.
  - lrvick 6mo ago
    Strix Halo 128 w/ linux 7x
- suprjami 6mo ago
  You have got to be joking. My three NVIDIA cards are more power efficient than my one AMD card, both at idle and during usage. Official ROCm is like pulling teeth with poor support for desktop cards. Debian, a volunteer led project, have better ROCm CI than AMD and support more cards. Look at any benchmarks. NV midrange cards are faster than AMD and at least a generation in front. Owning a 7900XTX is an embarrassing disappointment. I like AMD and want them to succeed, but they are way behind NV in this area.
  - roenxi 6mo ago
    > Official ROCm is like pulling teeth with poor support for desktop cards... I agree with most of your post and fled the AMD ecosystem some time ago because of the machine learning situation, but their problem seemed to be more the firmware bugs and memory management of compute shaders than the higher level libraries. The obvious solution to this one would be not to use ROCm. ROCm has always been a bit of a train wreck for small users and it doesn't seem to do anything special anyway. The way forward would be something more like Vulkan which the server that today's link points to seems to be using. The existence of a badly managed software package doesn't really imply that users have to use it, they can use an alternative. It would be nice if AMD sorts themselves out though. The NVidia driver situation on linux is painful and if AMD can reliably run LLMs without the hardware locking then I'd much rather move back to using their products.

Is... is this named because they have a lemon they're trying to make the most of?

parsimo2010 6mo ago

I think saying "L-L-M" sounds kind of like "lemon," so this is an LLM-aid (sounds like lemonade).

projektfu 6mo ago
Wonder why they didn't call it LLMonade, which would be unique.
metalliqaz 6mo ago
so obvious and yet I didn't connect the dots. thank you
- ProllyInfamous 6mo ago
  wait until you discover the LuLuleMonade -connection /s

deleted 6mo ago

[deleted]

TeMPOraL 6mo ago

If life keeps giving it them, they should instead invent a combustible lemon.

eddieroger 6mo ago
Do they know who you are? They're the guys who are going to blow your house up ... with the lemons.
- LorenDB 6mo ago
  On an unrelated note, do you think this software supports running models from a CD?...
deleted 6mo ago
[deleted]

altmanaltman 6mo ago

Lemonsqueeze was considered too violent

nathan_douglas 6mo ago
If you run it in a cluster, does it become a Lemon Party?
- speed_spread 6mo ago
  If you run it on someone else's computer it becomes Lemon Stealing

deleted 6mo ago

[deleted]

lrvick 6mo ago

I exclusively buy AMD hardware for local inference. For open drivers, power efficiency, and cost AMD beats Nvidia easily for consumers.

javchz 6mo ago
Any recommendations in the current market? Love how plug and play and is on Linux from the driver side of things.
- lrvick 6mo ago
  Strix Halo 128 w/ linux 7x
suprjami 6mo ago
You have got to be joking. My three NVIDIA cards are more power efficient than my one AMD card, both at idle and during usage. Official ROCm is like pulling teeth with poor support for desktop cards. Debian, a volunteer led project, have better ROCm CI than AMD and support more cards. Look at any benchmarks. NV midrange cards are faster than AMD and at least a generation in front. Owning a 7900XTX is an embarrassing disappointment. I like AMD and want them to succeed, but they are way behind NV in this area.
- roenxi 6mo ago
  > Official ROCm is like pulling teeth with poor support for desktop cards... I agree with most of your post and fled the AMD ecosystem some time ago because of the machine learning situation, but their problem seemed to be more the firmware bugs and memory management of compute shaders than the higher level libraries. The obvious solution to this one would be not to use ROCm. ROCm has always been a bit of a train wreck for small users and it doesn't seem to do anything special anyway. The way forward would be something more like Vulkan which the server that today's link points to seems to be using. The existence of a badly managed software package doesn't really imply that users have to use it, they can use an alternative. It would be nice if AMD sorts themselves out though. The NVidia driver situation on linux is painful and if AMD can reliably run LLMs without the hardware locking then I'd much rather move back to using their products.