jfreds

5 ms·

1.
by jfreds 4d ago
I think taxes like these actually worsen the incentive structure. If it’s effectively more expensive to do training and inference, labs will be incentivized even more to improve efficiency. Opaque recurrence seems like a great way to improv
2.
by jfreds 13d ago
Agree with the sentiment - but some companies like mine bought into cursor, and post acquisition, grok is relatively cheap via cursor
3.
by jfreds 29d ago
Oh no a reranker which optimizes for pclick (bias to cheaper items) and profit (bid and margin) I don’t think the forest is dark (obvious financial incentives) and I don’t think we’re pre-Google (as you said, you can literally still find wh
4.
by jfreds 1mo ago
Huge gains? What was the impact of this change, considering the only context that we have is that it was not important to the customer? Answer should be expressed in terms of cost, revenue, profit. I don’t doubt the CTO was exercising poor
5.
by jfreds 1mo ago
> would an ML optimization loop have discovered transformers? I think that’s exactly the kind of problem this group is looking to solve. You make a compelling intuitive argument, but that’s not the same thing as a proof
6.
by jfreds 3mo ago
So they’re watermarking requests according to your environment variables and maybe changing a string format if you’re in a certain time zone? Am I missing something here? Where’s the five alarm fire?
7.
by jfreds 3mo ago
> The worst case of these were the few companies that set up token leaderboards, which is perhaps the dumbest way possible to encourage learning how to use LLMs well My company does something dumber now. A leaderboard of how many lines o
8.
by jfreds 4mo ago
I’m confused: is it just markdown files in git? Or does the hybrid graph+semantic layer matter? If the latter is true, the title is just clickbait right
9.
by jfreds 4mo ago
I tried semaglutide and while it was effective for losing weight, it made working out impossible (felt exhausted and very sick as soon as hr went up) and it made hangovers awful. Is retatrutide any different?
10.
by jfreds 5mo ago
To be fair this was a thing before AI as well…
11.
by jfreds 5mo ago
I’ve seen loads of very bad/wrong code written by humans
12.
by jfreds 5mo ago
I agree in part, but I think AI does meaningfully make it harder for leadership to detect their bullshit.
13.
by jfreds 5mo ago
The author of stringzilla, Ash Vardanian, has a bunch of really cool talks/lectures/demos. Highly recommend checking him out if you like that kind of thing :)
14.
by jfreds 5mo ago
I don’t think OP’s point has anything to do with AI companions. The big benefit of moving compute to edge devices is to distribute the inference load on the grid. Powering and cooling phones is a lot easier than powering and cooling a datac
15.
by jfreds 6mo ago
My issue with this is that a simple design can set you up for failure if you don’t foresee and account for future requirements. Every abstraction adds some complexity. So maybe the PoC skips all abstractions. Then we need to add a variant t
16.
by jfreds 6mo ago
I am seeing this at my work right now. They are about to start using token consumption as _part_ of the performance review process. Obviously this is a coarse and problematic proxy for productivity. OTOH, it’s an attempt to address a real p
17.
by jfreds 7mo ago
Very bad hire. I’ve gently said as much to my manager and skip. But for some reason hiring is hard and firing is hard, and we’re a small team, so I’ve been told to just lower my standards. Yeah, I know
18.
by jfreds 7mo ago
AI pull request descriptions are my current pet peeve. The ones I have seen are verbose and filled with meaningless fluff words (“optimized”, “performant” for what? In terms of what?), they leak details about the CoT that didn’t make it int
19.
by jfreds 7mo ago
I burnt out helping a junior on my team for the past few months. It was just terribly obvious she was feeding my responses directly into a chatbot to fix instead of actually understanding the issue. I can’t really even blame her, there isn’
20.
by jfreds 7mo ago
I think this is well put. Cohesive philosophy, even if flawed, is a lot easier to work with than a patchwork of out-of-context “best practices” strewn together by an LLM
21.
by jfreds 7mo ago
Literally yes
22.
by jfreds 7mo ago
Context management, plan mode versus agent mode, skills vs system prompt, all make a huge difference and all take some time to build intuition around. Not all that hard to learn, but waiting for things to settle down assumes things are goin
23.
by jfreds 7mo ago
Strawman. It’s entirely possible for two things to be true at once: border laws are worth enforcing, and the current approach of flooding ICE with untrained goons explicitly targeted with white supremacist recruiting material is not going t
24.
by jfreds 8mo ago
You kinda can, just don’t make a Twitter account, don’t buy teslas, don’t use grok. Tell your friends
25.
by jfreds 8mo ago
The crux is in the “and it gets implemented” part. Teams have a limited bandwidth, so what gets implemented absolutely is a zero sum game, that’s why backlog prioritization exists. In order for your idea to get implemented, you have to advo
26.
by jfreds 8mo ago
> good work speaks for itself I disagree. Ideas don’t speak, and work doesn’t speak. People do. Being a 10x engineer isn’t just about having great ideas, it’s about having great impact. Sometimes I hear ICs say with some pride that “I’m
27.
by jfreds 8mo ago
Inviting a reporter from the Atlantic to your signal chat where you coordinate military plans has nothing to do with government being too big
28.
by jfreds 8mo ago
This is true. What are the implications of that?
29.
by jfreds 9mo ago
I get this at work, frequently. “Oh, cursor wrote that.” If it made it into your pull request, YOU wrote it, and it it’ll be part of your performance review. Cursor doesn’t have a performance review. Simple as
30.
by jfreds 9mo ago
> automated review tools that publish comments without human review are not allowed This seems like a curious choice. At my company we have both Gemini and cursor (I’m not sure which model under the hood on that) review agents available.

More ›