fotcorn

11 ms·

1.
by fotcorn 20d ago
I am also running some old AMD datacenter cards, 2x MI25 in my case. Getting around 30 tokens/second with short context. Tensor parallel in llama.cpp using RCCL (disabled by default in llama.cpp for some reason). Surprisingly, for thes
2.
by fotcorn 6mo ago
Also, there is zero reason to think that the big labs did not have anything similar to TurboQuant for a long time already. The recent blog post from Google announcing TurboQuant does not change anything regarding RAM planning for the big la
3.
by fotcorn 6mo ago
Cheapest i know if is around $96k
4.
by fotcorn 7mo ago
The memory bandwith on M4 Max is 546 GB/s, M5 Max is 614GB/s, so not a huge jump. The new tensor cores, sorry, "Neural Accelerator" only really help with prompt preprocessing aka prefill, and not with token generation. T
5.
by fotcorn 7mo ago
Related to this, how do you get your comments that you add in the review back into your agent (Claude Code, Cursor, Codex etc.)? Everybody talks about AI doing the code review, but I want a solution for the inverse - I review AI code and it
6.
by fotcorn 8mo ago
I think the ability to actually run the code on the target helped a lot with understanding and optimizing for the specific micro architecture. Quite a few of the ideas turned out to not to be optimal and were discarded. Also important to ha
7.
by fotcorn 8mo ago
I used Claude Opus 4.5 inside Cursor to write RISC-V Vector/SIMD code. Specifically Depthwise Convolution and normal Convolution layers for a CNN. I started out by letting it write a naive C version without intrinsic, and validated it
8.
by fotcorn 10mo ago
Seems like the hiker at the bottom of the article was introduced in 1997 and removed only in 2017: https://s.geo.admin.ch/be66brq5oby9
9.
by fotcorn 11mo ago
I have the PCIe version of NanoKVM, and I am also happy with it. The big advantage of the PCIe version is that it does not take up space on the desk and all the cables for ATX power control an inside the PC case. Full-sized HDMI is nice, th
10.
by fotcorn 1y ago
It says that there are multiple sizes in the second sentence of the huggingface page: https://huggingface.co/Qwen/Qwen3-Coder-480B-A35B-Instruct You won't be out of work creating ggufs anytime soon :)
11.
by fotcorn 1y ago
The VPN product is very good, it's basically a thin wrapper around Mullvad, arguably the best VPN on the planet right now. At least from a privacy standpoint.
12.
Spiking Neural Network Chip for Smarter Sensors(spectrum.ieee.org)
1 points by fotcorn 1y ago|0 comments
13.
by fotcorn 1y ago
Why do you think it's a negative result? The table on page 9 shows great results.
14.
by fotcorn 1y ago
There are quite a few well funded companies now that use forks of VSCode: Google (IDX, now Firebase Studio), Cursor, Windsurf (especially if they are bought by OpenAI soon), GitLab etc. An alternative marketplace already exists with open-vs
15.
by fotcorn 2y ago
Gamers Nexus is talking to one big PC manufacturer (my guess is Dell) that is seeing failure rates of 10-25% for specific SKUs: https://youtu.be/gTeubeCIwRw?t=527&si=YzpDzI2IyadzQYid Not fully confirmed yet, but that so
16.
by fotcorn 2y ago
The best way to swap desktops is to install the correct Ubuntu flavour from the start, i.e. Kubuntu, Xubuntu or Lubuntu to avoid those problems. I am quite happy with Regolith Desktop [0] installed on top of standard Ubuntu. Gives you a nic
17.
by fotcorn 2y ago
Regolith Desktop ( https://regolith-desktop.com/ ). A fully preconfigured Tiling Window Manager based desktop environment for Linux. Uses i3 on X11, sway on Wayland. No more fiddling with config files to make basics like syst
18.
by fotcorn 2y ago
Note that YouTube Shorts are just normal YouTube videos on a different URL. This means you can take a link to a Shorts like https://www.youtube.com/shorts/<id> and change it to https://www.youtube.com&
19.
by fotcorn 2y ago
I wonder if they have a clear hardware separation between each of the API, ChatGPT, their lower-scale experiments and their large scale (e.g. GPT5) training hardware. Or is everything just a big blob of hardware, that dynamically gets alloc
20.
by fotcorn 2y ago
Consumer AMD chips to be precise. AMD is mostly focusing on their datacenter chips (MI300X), and I assume the support for AI workloads there is much better. They might even see their consumer chip undermining sales of datacenter chips. NVID
21.
by fotcorn 3y ago
Here you go: https://www.moneysavingexpert.com/savings/savings-accounts-b...
22.
by fotcorn 3y ago
I wouldn't be surprised if the answer is "all of the above" and more. Not only is there limited availability of NVIDIA chips, it's also useful to tell Jensen that you actually could buy from somewhere else, even if you
23.
by fotcorn 3y ago
I remember similar things. Running Windows 2000, even going back to Win98 on my first PC (shipped with XP before SP1) and also running Windows 2003 Server at some point, all just to avoid XP. After SP2, it was fine.
24.
by fotcorn 3y ago
I can only access https://makersuite.google.com/ when using a VPN to the US. Also, it spams popups that get blocked by Firefox. Some basic prompts, which are answered correctly most of the time by ChatGPT4: There are 31 boo
25.
by fotcorn 3y ago
A charitable interpretation might be that search requires a fair amount of compute, and is therefore a big denial of service vector. I am not sure how much behavioral data GitHub can gather from logged in user, and how useful that is compar
26.
by fotcorn 3y ago
The recently released XTTS-v2 model[0] from coqui.ai is coming very close to what ElevenLabs[1] can do. It runs reasonably fast on a recent GPU, and should also work on CPU. Requires a 3 second (!) clip of the voice you want to clone. Licen
27.
by fotcorn 3y ago
That is a very editorialized title, original is "Bcachefs Lands Big Scalability Improvement, Disables Debug Option By Default". Also note that debug is enabled by default, so Phoronix tested the use-case most end users would actua
28.
by fotcorn 3y ago
In my experience, people do hack game engines all the time for game specific optimizations, fixes and special features. At least in the bigger AA/AAA games I've seen. We tried to sell our plugin as binary only (C++), but basically
29.
by fotcorn 3y ago
The Apache 2 license is incompatible with GPL2, you cannot have code under those two licenses in the same project. So they dual licenses it under MIT, which is compatible with GPL2. The Rust project has the same problem, it's also dual
30.
by fotcorn 3y ago
I worked with it quite a bit on my last job, and for me it's really the quality that is not there yet. One example is prefabs: They worked just fine in Lumberyard years ago. The first few releases of O3DE broke them (that was in 2021 I

More ›