6 ms·

I previously posted that DS4Flash was _good_ but not _great_ on two DGX Sparks, but I have to say that GLM-5.3 is pretty amazing. It's been able to tackle all t

I previously posted that DS4Flash was _good_ but not _great_ on two DGX Sparks, but I have to say that GLM-5.3 is pretty amazing. It's been able to tackle all the random hard problems I've thrown at it and it has the intuition that DS4Flash seems to lack. We're nowhere near a Fable-class model IMO, but things are going to get interesting in this next year.

villish 19d ago
What quant are you running and tps?
- mmastrac 19d ago
  NVFP4 ~20-30tps (MTP + vision, no dflash2).
petu 19d ago
I assume that's about 5.3 Flash, not full?
- mmastrac 19d ago
  Yes, sorry 5.3 flash.
deagle50 19d ago
do you mean GLM 5.3 flash?
VariousPrograms 19d ago
It's early days, but GLM 5.3 Flash is the first local model that feels good enough to me to be a "main" model without debating whether each problem needs to be sent to a stronger model. DS4 Flash is good enough at implementing given a plan, but I wasn't always a fan of what it came up with when asked to plan something. The good news is it can only get better from here.
pyrophane 19d ago
> We're nowhere near a Fable-class model IMO, but things are going to get interesting in this next year. I'm wondering of you could clarify your thoughts on this. I've had a hard time evaluating what Fable-class actually is capable of that sets them (or really it) apart from other models in a very significant way.
- lukan 18d ago
  Have you tried it out? I doubt there is a general accepted definition. For me it is just more capable of deep reasoning/handling complexity. Still can mess up, still does not count as strong AI - but a level above Opus and co.
  - mtrovo 18d ago
    Could you give me an example of a similar task you asked Fable and a different model to do where Fable did a better job? I have a hard time getting models like GLM 5.3 to not perform on my tasks but I might be biased.
    - lukan 18d ago
      Changes in a complex codebase. Opus can do it, but needs more handholding. Making the plan with fable and let opus implement it worked out well.
      - mtrovo 17d ago
        That's actually not quite what I was asking for.
boodleboodle 19d ago
What coding harness are you using? I am trying to take the plunge and wondering which I should use

villish 19d ago

What quant are you running and tps?

mmastrac 19d ago
NVFP4 ~20-30tps (MTP + vision, no dflash2).

petu 19d ago

I assume that's about 5.3 Flash, not full?

mmastrac 19d ago
Yes, sorry 5.3 flash.

deagle50 19d ago

do you mean GLM 5.3 flash?

VariousPrograms 19d ago

It's early days, but GLM 5.3 Flash is the first local model that feels good enough to me to be a "main" model without debating whether each problem needs to be sent to a stronger model. DS4 Flash is good enough at implementing given a plan, but I wasn't always a fan of what it came up with when asked to plan something. The good news is it can only get better from here.

pyrophane 19d ago

> We're nowhere near a Fable-class model IMO, but things are going to get interesting in this next year. I'm wondering of you could clarify your thoughts on this. I've had a hard time evaluating what Fable-class actually is capable of that sets them (or really it) apart from other models in a very significant way.

lukan 18d ago
Have you tried it out? I doubt there is a general accepted definition. For me it is just more capable of deep reasoning/handling complexity. Still can mess up, still does not count as strong AI - but a level above Opus and co.
- mtrovo 18d ago
  Could you give me an example of a similar task you asked Fable and a different model to do where Fable did a better job? I have a hard time getting models like GLM 5.3 to not perform on my tasks but I might be biased.
  - lukan 18d ago
    Changes in a complex codebase. Opus can do it, but needs more handholding. Making the plan with fable and let opus implement it worked out well.
    - mtrovo 17d ago
      That's actually not quite what I was asking for.

boodleboodle 19d ago

What coding harness are you using? I am trying to take the plunge and wondering which I should use