nixon_why69

7 ms·

1.
by nixon_why69 4d ago
KV cache is per conversation, I'm getting 100% hit rate on my single tenant local set up. The benefits of scale are on the token generation side, you can batch rounds and generate tokens for multiple conversations per pass instead of j
2.
by nixon_why69 5d ago
It's not even a person, it's a system. There's a million people behind you who will take your job if you don't grind, and that goes for your boss as well.
3.
by nixon_why69 5d ago
The usage of Neijuan as I understand it isn't about a complete lack of results, Chinese test scores are really good, but there's only 10% in the top 10% so competing even harder just means everyone is miserable competing for the
4.
by nixon_why69 5d ago
In China, one could look at hours of homework, work hours etc and conclude there's a reason the term was coined.
5.
by nixon_why69 6d ago
Numbers aside, SpaceX has a technological lead. They're not strangling competitors in a commodity business with monopoly practices. I wouldn't call ASMR or TSMC monopolies either, anyone can compete with them in theory. Standar
6.
by nixon_why69 6d ago
Defending standard oil is an all-timer hot take. They only had 90% market share? In a commodity? SpaceX isn't a monopoly because they have domestic and international competition. Before they showed up, ULA was a deliberately const
7.
by nixon_why69 7d ago
Standard oil is the textbook example of an abusive monopoly and was broken up for that reason. They improved efficiency by cutting exclusive deals with railroads and transport companies due to their size which froze out every other company.
8.
by nixon_why69 8d ago
Speaking for China specifically, and this is all word of mouth since my kids are at a posh international school (apply hate appriopriately): Elementary school is 8-5, longish day but not too bad on homework. Middle school (grades 6-9) there
9.
by nixon_why69 8d ago
Living in one Asian country, phone scrolling still happens with adults but kids get a lot of homework and definitely do it. Honestly excessive amounts, quantity over quality but at least studying is happening. If some third type of country
10.
by nixon_why69 9d ago
Yup, and additionally said stooge would probably be optimizing for their own position and package in a way Zuck doesn't have to. There's a whole new category of selfishness and shortsightedness out there.
11.
by nixon_why69 10d ago
If colloquial usage of "anarchy" has a different definition than, an, I'm sorry, irrelevant niche political movement, then you should assume a given speaker meant the colloquial form.
12.
by nixon_why69 11d ago
If we abandon the moral "should", then the right move is to shake down Google along the lines I already said. Google should, as a rational actor, pay out better for legitimate vulnerabilities that pose actual risk to them to avoid
13.
by nixon_why69 12d ago
That's one of the points, yes, but the black market doesn't dictate the value of the exploit to Google. A hardline bargaining position with Google would be more like "pay me what I want, or else I'll give it to all taker
14.
by nixon_why69 12d ago
That's really informative but maybe a little overly capitalist-brained. We shouldn't look to the black market as cost discovery for these vulnerabilities, most non-criminal researchers are not putting up an ask order and letting t
15.
by nixon_why69 14d ago
For qwen, it's an additional transformer layer at the very back, it ships as part of the model.
16.
by nixon_why69 14d ago
I find mtp=3 does well with that model, only at 4 it becomes unprofitable. Check your quants, its worth having the mtp layer be a bigger quant if it leads to 2x throughput from more accepted tokens.
17.
by nixon_why69 15d ago
Yeah, well, Google under Sundar hasn't exactly been full of bold stances.
18.
by nixon_why69 15d ago
Google isn't a branch of the government, they can call the lake whatever they want. It's a decision to comply that quickly and cravenly, presumably because Trump is vindictive, why die on this hill.
19.
by nixon_why69 16d ago
> For example, something they still struggle with is consistently translating terms coined within the text with consistent phrases. Harness issue, just explicitly tell them to maintain a vocabulary as they go for proper nouns and novel t
20.
by nixon_why69 17d ago
But another 30-40% of SpaceX will come out of lockup in the coming months. What happens when all of that tries to sell, after the market barely absorbed 5%?
21.
by nixon_why69 18d ago
If the results of the distillation are released freely for everyone to download, I wouldn't even call it a wrong. Big models are built by scraping the recorded thoughts of everyone, so giving everyone a chance to run a distilled small
22.
by nixon_why69 20d ago
Sorry for your friend. It sounds unfortunate all around. I'm not a doctor but I was an athlete and the default suggestion of "my neck/knee/legs/arms hurt" -> massage is standard common wisdom. Maybe an MD
23.
by nixon_why69 21d ago
Chiropractors are cranks but a normal muscle massage is really unlikely to cause a stroke AFAIK. The risks from Chiros as I understand it involve the big "adjustments" where they go for big pops, particularly in the neck.
24.
by nixon_why69 21d ago
I'm actually curious too, haven't been there in a while. It's possible that the MBR pyramid has become LLM assisted on all sides but the cultural themes are surely all still there. Honestly, the whole thing felt LLM to start
25.
by nixon_why69 21d ago
Google is better but it's an incredibly low bar. Amazon will drive these people to quit within a couple years over filling out MBRs and threats about how the MBR isn't good enough (MBR = monthly business report, pure bullshit thea
26.
by nixon_why69 21d ago
Assuming historical returns might be a little unsafe at a point in time near the peak of a bubble popping.
27.
by nixon_why69 21d ago
The reason it's good is because, although it is bad, you never have to worry about it in terms of maintenance, admin or scale. It's like lambda for databases. For the same price, you can run a much more capable PSQL instance with
28.
by nixon_why69 21d ago
They don't have to be getting paid. The natural bias of media is towards laziness and sensationalism (stolen from Jon Stewart, so maybe the same is true about comments).
29.
by nixon_why69 23d ago
If we want to be even more charitable to Anthropic, they're going from nothing to hyperscaler in like 3 years. I'm as happy as anyone to dunk on the general bubble situation and people claiming their technology is too dangerous t
30.
by nixon_why69 27d ago
Tao is talking about academic publishing, based around learning for it's own sake. If no learning happened, do not publish. From a different angle, what we don't understand can absolutely hurt us and you're right too, but it

More ›