MrScruff

5 ms·

1.
by MrScruff 4d ago
The distinction that can be drawn is between the code, and the user experience of the software. You may argue that the two are inextricably linked, but I don’t think that can be treated as an absolute principle. I'd also say I've
2.
by MrScruff 4d ago
It's a bad analogy, because unless you're cooking a recipe, cooking is about all the small decisions you're making during the process which could apply both to coding or the design aspect of building software with an LLM.
3.
by MrScruff 4d ago
I don't agree. That would imply they asked for a piece of software and the LLM one-shotted it, but that's absolutely not what's happening in the vast majority of cases. If two people vibe code the same tool from the same high
4.
by MrScruff 5d ago
I think we’re seeing the agents become very advanced at tasks with verifiable reward through RL. Currently they don’t exhibit the same skills in their attempts to manipulate humans - presumably because they’re not being specifically trained
5.
by MrScruff 10d ago
The point is, the big improvements we’re seeing nowadays are coming from RL, not from scraping the internet.
6.
by MrScruff 11d ago
I think this all rings true for where we are right now. The trend is that the agents are becoming superhuman in tasks for which there is a verifiable reward, and analysing a business problem, identifying inefficiencies and turning it into a
7.
by MrScruff 12d ago
The point was, if your internal model of the world makes a prediction of a negative outcome at some point in the future, and you optimise your individual actions to avoid that negative outcome, then wouldn’t it make sense to focus on the fa
8.
by MrScruff 12d ago
I am not an expert, but I do understand the distinction that is being made here. It makes sense to describe the result of pre-training as a ‘next token’ predictor as that’s what it’s been trained to do, not because it’s an autoregressive ar
9.
by MrScruff 12d ago
Not sure if this was a serious comment but it’s worth considering that humans have a long history of figuring out ways to make other humans work for them without bestowing rights on them.
10.
by MrScruff 16d ago
In general, the frontier models are not capable of reliably authoring non-trivial code without careful oversight yet. They are great at producing code that can pass tests, but not neccessarily a code review. This means if you care about cod
11.
by MrScruff 25d ago
I get around 20 tok/s, 4 bit quant, MTP, 4 bit KV cache quantisation. On an M4 Pro 48Gb.
12.
by MrScruff 1mo ago
I thought the main advantage of oMLX is it's less likely to invalidate the KV cache when working with coding agents, which is key when working on a Mac because of the slower prompt processing.
13.
by MrScruff 1mo ago
LLM prompt processing and diffusion models are compute bound, while LLM token generation is memory bandwidth bound.
14.
by MrScruff 1mo ago
I got my girlfriend to install Claude Code and she was happily able to create software with it completely independently of me.
15.
by MrScruff 3mo ago
Yeah exactly. After a hard day when my brain is frazzled, a workout will actually make me feel better.
16.
by MrScruff 3mo ago
I think what the parent post was saying is that there is a finite amount of useful mental function time in any one day, and once you’ve exhausted this any attempted learning will be pretty inefficient. Also some jobs will have a faster burn
17.
by MrScruff 3mo ago
Considering all of the great research that has come from his labs (eg. DINO, Segment Anything) I don’t think that’s fair (no pun intended).
18.
by MrScruff 3mo ago
I’m normally comparing frontier open/cheap models against frontier closed source. I use deepseek/glm regularly, they’re fine and you can get real work done with them but it’s super obvious when you switch back to opus or even sonn
19.
by MrScruff 3mo ago
You really need to take the benchmarks with a massive pinch of salt. I’ve been testing local LLMs since the original llama and there’s nothing I’ve tried that is in the same category as Opus.
20.
by MrScruff 3mo ago
I think this is true for projects beyond a certain complexity. I have 100% vibe coded projects with tens of thousands LOC, and haven't seen any real issues with fully automated maintenance. Will that approach work in every scenario, ab
21.
by MrScruff 3mo ago
That would imply that the biological physical substrate is necessary for conciousness, which I don't think you can say with any degree of certainty. It's not an assumption I would personally make. And while I'm speculating, m
22.
by MrScruff 3mo ago
Ah, mea culpa.
23.
by MrScruff 4mo ago
My point was the "stochastic parrot" label can be both true and irrelevant. LLMs are predicting the next token based on their training data, so at that level "stochastic parrot" is accurate. But it tells us nothing abo
24.
by MrScruff 4mo ago
I think (rather ironically) you're reacting to the version of my comment you have in your mind rather than what I actually wrote. My point was that "stochastic parrot" is reductionist and irrelevant as most people would agree
25.
by MrScruff 4mo ago
I can't actually figure out what you're reacting to - perhaps you could elaborate?
26.
by MrScruff 4mo ago
The reason people are confused by LLMs is that they are stochastic parrots. They do an incredibly good job of emulating human behaviours and speech patterns as that's what they've been trained on. But like an actual parrot, it&#
27.
by MrScruff 4mo ago
What we do know is that conciousness is not binary and that it emerged through evolution. That doesn't entirely rule out your magic tsar bomb particle but it gives a strong indicator as to it's likeliness.
28.
by MrScruff 4mo ago
The problem with this is that the word 'hot' only has meaning to a conscious being. And while we don't know what conciousness is, it's extremely hard to argue it's not an emergent property of physics. So if your sup
29.
by MrScruff 4mo ago
Do you believe consciousness to be an emergent property of the laws of physics?
30.
by MrScruff 4mo ago
You can avoid the smells with a prompt. I have a benchmark involving short story writing within specific styles and the level of sophistication achievable is increasing over time, in my opinion.

More ›