westoncb

7 ms·

1.
by westoncb 1mo ago
Location: Tucson, Arizona, USA Remote: Yes Willing to relocate: Yes Technologies: TypeScript, Rust, React, three.js, HTML/CSS, Java Résumé/CV: https://symbolflux.com/resume.html Email: westoncb@gmail.
2.
by westoncb 2mo ago
That's fine as a point but it's not what the headline describes. The question of total/real effect on accuracy is also something one could ask about. Both are valid.
3.
by westoncb 4mo ago
I've been building this "general problem solver" (will likely focus on math problems first) that uses a special kind of orchestrator to direct/structure the problem solving approach in accordance with how many 'roun
4.
by westoncb 5mo ago
Taking on a 'slow' software project with the kind of attention to quality (inside and out) that I had pre-AI. It's a tool I'll use myself, LLM-related, but not any kind of radical idea; it's main value is in careful
5.
by westoncb 6mo ago
>but you could give me two black boxes that act the same externally, one written as a single line , single character variables, etc. etc. etc. and another written to be readable, and I wouldn't care so long as I wasn't expected
6.
by westoncb 7mo ago
He also remade quake a couple weeks ago (on three.js as well I believe).
7.
by westoncb 8mo ago
It wouldn’t work for other models if it’s encoded in a latent representation of their own models.
8.
by westoncb 8mo ago
I would guess you can if you're using their Responses api for inference within your agent.
9.
by westoncb 8mo ago
Interesting that compaction is done using an encrypted message that "preserves the model's latent understanding of the original conversation": > Since then, the Responses API has evolved to support a special /respons
10.
by westoncb 8mo ago
https://symbolflux.com
11.
by westoncb 9mo ago
That depends on the content of the SVGs.. Of course you can write a script to do a very literally kind of conversion of regardless, but in practice a lot of interpretation would be required, and could be done by an LLM. Simple case is an SV
12.
by westoncb 9mo ago
That's about how it came across for me as well: ignoring my actual content and joking about generalizations related to key words. Project is cool overall, love the xkcd-like comic idea—but prompting and/or model-selection could us
13.
by westoncb 9mo ago
It sounds more like you just made an overly simplistic interpretation of their statement, "everything works like I think it should," since it's clear from their post that they recognize the difference between some basic level
14.
by westoncb 9mo ago
I've been on a break from coding for about a month but was last working on a new kind of "uncertainty reducing" hierarchical agent management system. I have a writeup of the project here: https://symbolflux.com&#x2
15.
by westoncb 9mo ago
Ah interesting, I missed that possibility. Digging a little more though my understanding is that what's universal is a shared basis in weight space, and particular models of same architecture can express their specific weights via coef
16.
by westoncb 9mo ago
> So, they found an underlying commonality among the post-training structures in 50 LLaMA3-8B models, 177 GPT-2 models, and 8 Flan-T5 models; and, they demonstrated that the commonality could in every case be substituted for those in the
17.
by westoncb 10mo ago
I think the idea is like: it took extra work 'cause Rust makes you be so explicit about allocations and types, but it's also probably faster/more reliable because that work was done. Of course at the end of the day it's
18.
by westoncb 1y ago
Doing math is not the same as calculating. LLMs can be very useful in doing math; for calculating they are the wrong tool (and even there they can be very useful, but you ask them to use calculating tools, not to do the calculations themsel
19.
by westoncb 1y ago
lol no problem. In reality though there's kind of a funny story behind it because I suspect the way I ended up using them so much is similar to how ChatGPT did. When I got into writing I studied grammar, then decided to read a bunch of
20.
by westoncb 1y ago
I actually tweeted like a month ago that I was the reason LLMs use em dashes so much lol: https://x.com/Westoncb/status/1961802304698671407
21.
by westoncb 1y ago
The difference is the incentive to improve, and actual present rate of improvement, for models like this is far higher than it is for jetpacks. (That and certain intrinsic features at least suggest the route to improvement is roughly "
22.
by westoncb 1y ago
Yep, it's surreal.
23.
by westoncb 1y ago
lol yep, fully get that. And I mean I'm sure o4 will be great but the '-mini' variant is weaker. Some of it will come down to taste and what kind of thing you're working on too but personal preferences aside, from the he
24.
by westoncb 1y ago
I've seen that specific kind of role-playing glitch here and there with the o[X] models from openai. The models do kinda seem to just think of themselves as being developers with their own machines.. I think it usually just doesn'
25.
by westoncb 1y ago
Gotcha. Yeah, give o3 a try. If you don't want to get a sub, you can use it over the api for pennies. They do have you do this biometric registration thing that's kind of annoying if you want to use over api though. You can get th
26.
by westoncb 1y ago
There is a skill to it. You can get lucky as a beginner but if you want consistent success you gotta learn the ropes (strengths, weaknesses, failure modes etc). A quick way of getting seriously improved results though: if you are literally
27.
by westoncb 1y ago
This sounds like a cool project and I may sign up. I think the idea of seeding collaborations with side projects vs something necessarily serious right out the gate is pretty solid/clever. Edit: I do agree with others though that we sh
28.
by westoncb 1y ago
Location: Tucson, AZ (US) Remote: Yes Willing to relocate: Possibly! Technologies: LLMs, Typescript, node, React, three.js, dabbled with Elixir and Rust, lots of Java a long time ago and a bit of Objective C/Swift Portfolio: https:&#x
29.
by westoncb 1y ago
SEEKING WORK | USA | Remote is fine (I'm also considering relocation to Chicago or NYC, maybe SF) I'm a jack-of-all-trades software engineer who's done extensive "founding engineer" work in the context of both VC-ba
30.
by westoncb 1y ago
> and must say that I'm a bit confused by this presentation, and it's a bit unclear to me what it adds. I think the disconnect might come from the fact that Karpathy is speaking as someone who's day-to-day computing work h

More ›