mlinsey

28 ms·

1.
by mlinsey 12d ago
Especially with these big models chewing up limits fast, I feel good about simultaneously having an Anthropic sub, an OpenAI sub, and an Opencode balance. The models also seem to catch things when code reviewing each other that they don&#x
2.
by mlinsey 21d ago
Revoked or not, just ever having those controls signals to the Chinese ecosystem that you're not necessarily a reliable supplier (Would you trust US export policy to remain stable for the next ~decade given the state of US politic?) an
3.
by mlinsey 2mo ago
High-performing open weight models being released recently, and your customers looking into working with multiple providers as a result, are a great reason to drop prices on your non-frontier offerings. Although I'm sure there are some
4.
by mlinsey 2mo ago
"With one big caveat: you need a very clear set of requirements" Most new product launches are an exercise in figuring out what the product requirements should be through trial and error (really: through ongoing dialogue with yo
5.
by mlinsey 2mo ago
For ordinary coding (making webapps, frontend and backend), the non-SOTA models do fine, but the SOTA models have better judgement and need me to intervene less often, allowing workflows like "Go and pitch me a solution to this problem
6.
by mlinsey 2mo ago
I have some sympathy to geohot's view when it comes to pure informational chatbots. It's a first amendment issue, I'm allowed to write and read books that are useful to getting away with crimes, etc. This obviously doesn&#x27
7.
by mlinsey 2mo ago
Also, I just want to step back and actually give Costco some props here for their brand loyalty. Inshallah, when I have a 400 Billion market cap company and someone writes a fawningblog post about how awesome I am from a social-benefit pers
8.
by mlinsey 2mo ago
You got me, I'm totally paid off. Real New Yorkers love to go five miles (just for the closest one to me, in Manhattan seven avenues over and around 100 streets north), take a cab back from shopping, then haul costco-sized boxes up the
9.
by mlinsey 2mo ago
Costco is an elegant solution for the suburbs, where everyone is driving around a vehicle large enough to store giant boxes off a pallet and bring them home. Here in NYC, it's really impractical to go to a warehouse and carry a month&#
10.
by mlinsey 3mo ago
I'm not sure where in my post you thought I was suggesting either ignoring an export control or that all export controls are illegal. Export controls are governed by the Export Control Reform Act of 2018. The procedures the government
11.
by mlinsey 3mo ago
The labs will not just ignore the order, there are too many other levers they can try to pull to mess with those companies. Just for some examples, think about the number of employees reliant on visas that could be revoked, the government c
12.
by mlinsey 3mo ago
In 2004, I took a class where we trained "language models" that were bigram word models, on an archive of a couple years of the Wall Street Journal. I remember someone who literally announced they were dropping the class to the wh
13.
by mlinsey 3mo ago
I understand why Anthropic might not want to fight this particular one in court, because they're trying to convince the administration to let them move forward. But would another company who is not on the trusted partner list and has l
14.
by mlinsey 3mo ago
ID checks are possible for first-party harnesses...but they would also mean no more API access. Your wrapper could easily become a way for a foreign national to query Fable. Maybe a few large customers like Cursor would work with Anthropic
15.
by mlinsey 4mo ago
If the existing memory makers retains control of the market and don't defect from the optimal-long-term equilibrium for themselves, that's true. It just takes one player to defect for short term gains as we've seen with some
16.
by mlinsey 4mo ago
You're describing efforts by powerful institutions to squash the technology, which they definitely try to do, but that's just a strong signal that the technology itself is inherently opposed to centralized power, not an enabler of
17.
by mlinsey 4mo ago
That's definitely too broad a statement. I'd argue encryption, oral contraceptives, and the printing press were all strongly decentralizing.
18.
by mlinsey 5mo ago
My anecdata is that it heavily depends on how much of the relevant code and instructions it can fit in the context window. A small app, or a task that touches one clear smaller subsection of a larger codebase, or a refactor that applies the
19.
by mlinsey 5mo ago
The consumer surplus is quite high. Even with the regressions in this postmortem, performance was above the models last fall, when I was gladly paying for my subscription and thought it was net saving me time. That said, there is now much
20.
by mlinsey 5mo ago
It's true he could write off xAI today and the company could still fetch a trillion-dollar valuation. But I was more referring to his stated intentions - between his stated plans, his actions taking SpaceX from a profitable company to
21.
by mlinsey 5mo ago
Is this cash or compute? Elon has one of the world's biggest compute clusters spun up, and little inference demand to speak of. Trading billions worth of idle compute, in exchange for a high-strike call option on the #3 player in the m
22.
by mlinsey 5mo ago
Yes, cost per successful task is rising - ie, we are all paying effectively more for AI. And yet - Anthropic is still struggling to have enough capacity to serve demand - they are virtually sold out. And yes, are almost-as-good open models,
23.
by mlinsey 5mo ago
You're observing that: a) effective price-per-token is rising b) there is insufficient compute to meet the demand. And your conclusion is that the industry is circling the drain and due to collapse?
24.
by mlinsey 5mo ago
The models that we are paying to generate tokens are already not really just LLMs, as anyone studying language models ten years ago (or someone who describes them as "next token predictors") would understand them. Doing a bunch
25.
by mlinsey 5mo ago
I agree, but also the model intelligence is quite spikey. There are areas of intelligence that I don't care at all about, except as proxies for general improvement (this includes knowledge based benchmarks like Humanity's Last Ex
26.
by mlinsey 5mo ago
Different users do seem to be encountering problems or not based on their behavior, but for a rapidly-evolving tool with new and unclear footguns, I wouldn't characterize that as user error. For example, I don't pull in tons of th
27.
by mlinsey 5mo ago
If we have the source and it's easy to test, validate, and deploy an update - AI should make those easier to update. I am thinking of situations where one of those aren't true - where testing a proposed update is expensive or comp
28.
by mlinsey 5mo ago
I'm pretty optimistic that not only does this clean up a lot of vulns in old code, but applying this level of scrutiny becomes a mandatory part of the vibecoding-toolchain. The biggest issue is legacy systems that are difficult to patc
29.
by mlinsey 6mo ago
I feel like every new iteration of ways to find good content online: webrings, blogrolls, user upvoting/downvoting, giving everyone their own microblog to share interesting links, ML to learn your own preferences by your behavior - the
30.
by mlinsey 6mo ago
I admit I'm surprised by the move, from a company that reportedly just talked about how they need to focus more on fewer, more strategic products. But I also see the potential value. This is an entertaining and highly influential podc

More ›