RandyOrion

5 ms·

1.
by RandyOrion 5d ago
No. The 996 working culture in this page is actually *996.ICU*. "Work by '996', sick in ICU", an ironic saying among Chinese developers, which means that by following the "996" work schedule (9 am to 9 pm, six
2.
by RandyOrion 8d ago
> I was shown a prompt and told the internal research model had simply been given the problem statement. Levent had been told by Sebastien “very little human input” had been used. This turned out not to be true. Over the course of the ca
3.
by RandyOrion 13d ago
Good to see new open source/weight LLM families. Waiting for the final release of https://huggingface.co/IFM/K2-Horizon-32B .
4.
by RandyOrion 24d ago
For people who want to quantize kv caches for longer context, basically, if the model checkpoint you use didn't trained to use quantized kv caches (and all most all of model checkpoints you can access didn't), you shouldn't q
5.
by RandyOrion 27d ago
In contrast to memory-bounded autoregressive decoding, diffusion decoding can be computation-bounded. Devices with a decent amount of compute but very small memory, e.g. nvidia consumer-grade GPUs, could benefit from diffusion decoding mass
6.
by RandyOrion 1mo ago
Thank you Qwen team for this release. Compared to closed weight (especially unreleased and access-limited) and open weight/source large sparse MoE LLMs/VLMs, open weight/source small dense models benefits public the most beca
7.
by RandyOrion 2mo ago
Thanks Bonsai team. Now open weight LLMs/VLMs/LMMs are becoming even larger to the extent that consumer-grade hardware are no longer able to run these models. In contrast, quantization and pruning make the model better at the size
8.
by RandyOrion 2mo ago
Other details for the official (Yang Youlin) in this news. --- Whistleblower Yang Hai already reported Yang Youlin for his economic misconduct in July 2008. The whistleblower was detained because of the report at Nov 21st, 2008. --- People&
9.
by RandyOrion 2mo ago
The criminal complaint missing in this article: https://www.justice.gov/usao-ndil/media/1450651/dl Basically, Microsoft logs things from windows users, including and not limiting to, the machine GDID, IPs tha
10.
by RandyOrion 2mo ago
Yeah, searxng instance reliability problem goes deeper than simple uptime. The google response time function on public instance page [1], a good measure of the search engine availability of one instance, is broken for some time. Without rea
11.
by RandyOrion 3mo ago
I've been using searxng for several years now. I don't run my own instances because the inhumane network censorship imposed by GFW, and proxy detection enforced by search engines. Instead, I rely on public instances on the list [1
12.
by RandyOrion 3mo ago
Android developer verification program, together with recent reCAPTCHA push [1], and Manifest v2 force depreciation on chrome [2], make one thing crystal clear. When companies like GOOGLE talks about things in the name of "your securit
13.
by RandyOrion 3mo ago
Glad to see more open models. However, where are the 31b models?
14.
by RandyOrion 3mo ago
I've been using FUTO voice input for several month. It's not perfect as I have to manually do the correction like always. However, it definitely saves me some time and effort. It also helps me to degoogle, starting from gboard. Ap
15.
by RandyOrion 3mo ago
We paid for your things, AMD. If you want to strip some features from things we bought after the purchasing, you must ask me and every other customers for consents explicitly, with a reasonable explanation, and before the strip happens. If
16.
by RandyOrion 3mo ago
To people who silently downvoted this: please explain why you did that, you're doing things like AMD.
17.
by RandyOrion 3mo ago
The github issue that never made it in this news: https://github.com/AMDESE/AMDSEV/issues/292 Silent enshittification in the name of updates is getting out of hand. There are several evidences that downgradin
18.
by RandyOrion 3mo ago
Seems like the affected version of chrome is 150 and 151, and the timewindow is near. Because of ungoogled-chromium, I'm used to manually update the browser. This time I won't update until MV2 problem is solved properly. I've
19.
by RandyOrion 3mo ago
Please do not claim you trained a new model, only to got caught red-handed by others. There are already several people or groups did that, got caught, and vanished in no time. Check how the "authors" of "this model" reac
20.
by RandyOrion 3mo ago
I don't know how open source AI wins. The description is too vague for serious discussions. What I do know is that, once closed source AI groups become anti-you, you should punish them, or help open source groups, or both. If you reall
21.
by RandyOrion 3mo ago
Hilarious read. I laugh out loud multiple times during the read. In the end, I think amd should pay the author simply for the will of debugging for a broken software written by amd, as well as the sheer amounts of loose ends this exploratio
22.
by RandyOrion 3mo ago
Thanks gemma team for this release. Compared to autoregressive decoding, diffusion is huge for local MoE inference because of the improved token generation efficiency, especially for normal GPU + ram offload setting. However, there are mode
23.
by RandyOrion 3mo ago
More rants about local inference, consider yourself warned. Together with bf16 related deliberate hardward degrades on consumer-level nvidia gpus, i.e., gtx 10, rtx 20, 30, 40, 50 series, things gets sour really quickly.
24.
by RandyOrion 3mo ago
From the perspective of a local llm user, I think the qat doesn't solve the major problem of the gemma models. Gemma family (gen 1 to gen 4) is consistent with extreme range of activations, i.e., 600000, essentially forcing people to
25.
by RandyOrion 4mo ago
A small dense multimodal model with audio support, interesting. Wait, *Excluding Chinese language. This is ... curious. P.S. Where is gemma 4 124b?
26.
by RandyOrion 4mo ago
This website brings me some good chuckles. Now I really know how powerful an on-demand bullsh*t generator is.
27.
by RandyOrion 5mo ago
Like the recent copilot silent signing incident, the without consent part is blatant foul move. If you don't like be treated like anything but human, you should seriously consider replacing chrome with ungoogled chromium or other brows
28.
by RandyOrion 5mo ago
Yeah, this is part of the reason why vscodium exists.
29.
by RandyOrion 5mo ago
Wow. Just like using ungoogled-chromium instead of chrome, lineage os instead of oem android, using vscodium instead of vscode is again justified. These decisions really are the ones that I'll never regret. In addition, using the word
30.
by RandyOrion 5mo ago
One thing that makes me wonder is that there are 4 security issues raised and all of them were automatically commented and closed by some bot called `pl-ghost` [1][2][3][4]. In the end, only this one [4] properly handled, and all bot commen

More ›