nabakin

10 ms·

1.
by nabakin 3mo ago
Are you running qwen3.6-27b on one 3090 with your KV cache at q4? Ime there is significant long-context recall accuracy degradation at that precision. I prefer putting the KV cache at q8 and working with the 120k context
2.
by nabakin 4mo ago
Then you can sandbox
3.
by nabakin 5mo ago
I think they were mistaken or maybe they were just referring to inference because I don't see anyone making that claim and it would be quite the news.
4.
by nabakin 5mo ago
Probably because you said you used DeepSeek. People don't want to see AI in the comments and don't trust AI responses.
5.
by nabakin 5mo ago
Yes, that's the footnote from citation [5].
6.
by nabakin 5mo ago
> Also, note that there's zero CUDA dependency. It runs entirely on Huawei chips. That is a huge claim to make with no evidence. I researched what you said, and I have found no statement to that effect in their paper[0], on huggingf
7.
by nabakin 5mo ago
> When it comes to information transfer and processing, light can do things that electricity can’t. Photons — particles of light — are far zippier than electrons at working their way through circuits. Electrons themselves don't move
8.
by nabakin 6mo ago
Dunno but there's a PR for it. Probably also more performant than Modular.
9.
by nabakin 6mo ago
If OP meant they have the fastest implementation of Gemma 4 on Blackwell at the moment, I guess that is technically true. I doubt that will hold up when TensorRT-LLM finishes their implementation though.
10.
by nabakin 6mo ago
I know Arc AGI 2 has a private test set and they have a good amount of results[0] but it's not a conventional benchmark. Looking around, SWE Rebench seems to have decent protection against training data leaks[1]. Kagi has one that is f
11.
by nabakin 6mo ago
It's easy to game and human evaluation data has its trade-offs, but it's way easier to fake public benchmark results. I wish we had a source of high quality private benchmark results across a vast number of models like Lmarena. Ha
12.
by nabakin 6mo ago
Faster than TensorRT-LLM on Blackwell? Or do you not consider TensorRT-LLM open source because some dependencies are closed source?
13.
by nabakin 6mo ago
It's referring to the Lmsys Leaderboard/Lmarena/Arena.ai[0]. It's very well-known in the LLM community for being one of the few sources of human evaluation data. [0] https://arena.ai/leaderboard/chat
14.
by nabakin 6mo ago
Public benchmarks can be trivially faked. Lmarena is a bit harder to fake and is human-evaluated. I agree it's misleading for them to hyper-focus on one metric, but public benchmarks are far from the only thing that matters. I place mo
15.
by nabakin 6mo ago
And nowadays we have Debian running in a VM on Android [1] [1] https://www.zdnet.com/article/how-to-use-the-new-linux-termi...
16.
by nabakin 7mo ago
I would consider it reasonable if this was 4x TTFT and Throughput, but it seems like it's only for TTFT.
17.
by nabakin 8mo ago
And right to repair
18.
by nabakin 9mo ago
Ty this is great
19.
by nabakin 9mo ago
TIL Europe still has some presence in the Americas. Thought all of that was gone with the Monroe Doctrine
20.
by nabakin 10mo ago
Fyi it doesn't look like this post is listed on the frontpage anymore, even with the points it has. Not sure if it's intentional
21.
by nabakin 10mo ago
Ty!
22.
by nabakin 10mo ago
I understand they are similar, but I think this post adds new information to the situation. Regardless, appreciate your help moderating the site.
23.
by nabakin 10mo ago
Oops, that's correct, ty
24.
France threatens GrapheneOS with arrests / server seizure for refusing backdoors(mamot.fr)
576 points by nabakin 10mo ago|3 comments
25.
by nabakin 10mo ago
Google Translate link: https://translate.google.com/translate?tl=en&hl=en&u=https:/... Additional context: https://grapheneos.social/deck/@GrapheneOS/11557599710445618... https:&#x2F
26.
France threatens GrapheneOS with arrests / server seizure for refusing backdoors(mamot.fr)
324 points by nabakin 10mo ago|370 comments
27.
by nabakin 10mo ago
This is a better link from a French privacy non-profit but I can't change it now: https://mamot.fr/@LaQuadrature/115581775965025042 @dang or other mods, could you change it? Google Translated text: > Two articl
28.
by nabakin 10mo ago
I haven't bought a VR headset since the Oculus Rift CV1, but this might do it for me
29.
by nabakin 10mo ago
I don't think a lot of people realize how big of a deal this is. You used to have to choose between wireless and slow or wired and fast. Now you can have both wireless and fast. It's insane.
30.
by nabakin 10mo ago
Also mentions 1-2ms latency on a modern GPU

More ›