jononor

7 ms·

1.
by jononor 8d ago
That is not great. But it is still better than other continents?
2.
by jononor 21d ago
If you have good feedback signals, like tests/benchmarks/etc, then it is potentially better to do multiple turns where model uses that to adjust code. Which might not need as smart a model.
3.
by jononor 21d ago
If Simon would pitch for example PCBWay that and I am pretty sure they will sponsor it (assuming their logo stays). They can do laser engraved versions also ;)
4.
by jononor 1mo ago
It depends on your tolerance level for having less than frontier LLM capabilities. First level worth trying, Qwen 3.6 35B A3B with a 16 GB VRAM (example 1x 5060ti 16gb, 600 USD for the card) with partial GPU offloading. Next level would be
5.
by jononor 1mo ago
AI seems to be on the same trajectory? Search was very useful in the start also, until it became entrenched. Then search placement became a target, and they are just focusing on extracting rents. All way paying the content providers zero or
6.
by jononor 1mo ago
And it is not success compared to another possibility, earning enough money to not need further fundraising. Of course some businesses are more capital intensive and have longer time-to-money timelines due to factors outside the control of
7.
by jononor 1mo ago
Suck at what aspect of (analog) electronics specifically? Not contradicting the claim, just want to understand it. I have not tested yet, but I suspect that LLMs with a harness that can execute code can do SPICE simulations rather ok these
8.
by jononor 2mo ago
That could/should be required by law. As well as advertising the recording status. Then we can have app or OS level feature to avoid these things.
9.
by jononor 2mo ago
Ban them. Assuming that people installed such brain chip voluntarily I do not see an issue.
10.
by jononor 2mo ago
Teams are more than welcome to use a non-LLM approach (or hybrid) if they consider that to be more suitable.
11.
by jononor 2mo ago
Not at all. They are mini games.
12.
by jononor 2mo ago
The cards are also coming... Some of the very first are already out - but it will take a couple of years before they hit their stride in full. And cards will likely be primarily for Chinese companies initially, and then go for exports later
13.
by jononor 2mo ago
Even in a fine tuning scenario, the preferred form for making modifications is the weights plus the training pipelines, including evaluation protocols, tooling, etc.
14.
by jononor 2mo ago
Not comparable today. But in 10 or 20 years the situation might be considerably different. Hopefully closer to a everyone-can-build-using-hardware-they-already-have.
15.
by jononor 2mo ago
Does anyone have a good article on the topic? This one seems rather LLM generated. Not sure the specifics can be trusted... Overall thesis is maybe right, but would like to understand this in a bit more detail.
16.
by jononor 2mo ago
Capability per GB and per watt has also been going up lot. This will continue in the future as well (not necessary as the same rate as last years). But enough that I think Opus 4.8 level is reachable on consumer PCs within 10 years from its
17.
by jononor 2mo ago
Yeah China has a huge (and growing) advantage in power generation. And they have been looking to break into high-end chip manufacturing. The latter has high cost of entry and needs large scale to become viable. AI inference on own hardware
18.
by jononor 2mo ago
Writing a Python extension would a good way to dip your toes into Rust, and also add a useful skill to Python programming (writing performant extensions). PyO3 is the main project, and the topic has been covered in several talks at Python c
19.
by jononor 2mo ago
There are no limits to what you can imagine yourself hearing... And appreciation is a extremely complex subjective feeling, one could argue most of that is way beyond audio and acoustics, and even beyond psychacoustics into plain psychology
20.
by jononor 2mo ago
Or "this code (which you happened to write) is bad" vs "you are a shitty programmer".
21.
by jononor 2mo ago
I believe the proposed system is to run the containers on dedicated rented server(s). Instead of having the containers/VMs share underlying CPU/RAM with others.
22.
by jononor 2mo ago
Also, many of the successful European companies are bought up by US companies.
23.
by jononor 2mo ago
GB200 and GB300 are decent for training LLMs? H100 can be used also? Though the current European deployments are rather small, even the biggest are just some thousand GPUs.
24.
by jononor 2mo ago
EU already has supercomputers and data centers. Some examples: https://www.eurohpc-ju.europa.eu/supercomputers/our-supercom... The goal is to triple the number of data centers over the next years. It is not like there
25.
by jononor 2mo ago
You also need a shitton of data. People are saying that synthetic data is widely used, but pretty sure that is on top of the organic data. Both for pretraining and posttraining. That said, I do think we will see more open and collaborative
26.
by jononor 3mo ago
Prior to AI making a PR involved considerable effort from a human. So the default position for many open source projects was that it deserved some level of attention for the effort. Even if many projects in practice would struggle to review
27.
by jononor 3mo ago
Many people in LocalLLaMA Reddit community has been reporting the same, that 3.5 122B-A10B is on par or slightly better. And a 3.6 or 3.7 od the 122B is one of the models people want to see the most.
28.
by jononor 3mo ago
Not only that, but such a node is fully booked with existing orders, many which are long term commitments with penalties if they fail to deliver.
29.
by jononor 3mo ago
Dual 5060ti 16gb does over 100 tok/s on 35B A3B. Even with PCIE Gen 4 x4, which quite a lot of motherboards can do. Though Gen 4 x8 or Gen 5 x4 is slightly faster. Misc working notes on this hardware combo here, https://gith
30.
by jononor 4mo ago
Dual color filaments exist, and they do not mix at all... It gives the objects a nice transition when rotated. But indicates that color mixing in the nozzle is probably pretty difficult?

More ›