dgfl

5 ms·

1.
by dgfl 24d ago
I wouldn't really say SRAM-fast. Maybe DRAM-fast? At least in write speed. But the thing is, you don't need high write speed for this application. And read speed should be the same between flash and FeFETs. Btw, I've seen som
2.
by dgfl 25d ago
The vanguard chiplets even steps down to 30M… but they do claim to have a “Mead” design [1] designed to run GPT-3 in a single chip. 3D NAND flash can indeed routinely store hundreds of GB per die, so that’s proven. The question is about all
3.
by dgfl 25d ago
Temperature is a relatively trivial issue because it can either be compensated or the chip simply kept at a constant temperature (they’re low power chips anyway, throttling could be skipped to simplify the design). The ADCs and DACs are ind
4.
by dgfl 25d ago
Joke’s on us, all of their pages are LLM pages! LLM generated, that is. Btw, can guarantee that they are not ready to demonstrate that yet. They’re using 2D FLASH with 30M weights per die [1], so to get to 1T they will need… 33,333 dies. In
5.
by dgfl 25d ago
This page seems pretty in depth: https://www.mythic.ai/supply-chainmanufacturing They are using GlobalFoundries’ 28nm node for the floating gate transistors, afaiu, which they then bond onto a TSCM 5nm digital I/O wafe
6.
by dgfl 27d ago
They will keep a live leaderboard at https://huggingface.co/spaces/tabularisai/YapBench Here is the top 10 right now: | Rank | Model | YapIndex | YapTax$ | | ---: | -----
7.
by dgfl 27d ago
That one is more specific, but "vomit" captures the feeling of Opus 5's writing very well for me. I don't know if it's the watermarking, but every single language idiosyncrasy that Opus 4.x (x > 5) had has been p
8.
by dgfl 2mo ago
It can also go the other way. It outputs a paragraph so full of telegraphic technobabble that it’s just unreadable, inventing new jargon every other sentence, using terminology invented in its thinking stream and never explained. And when i
9.
by dgfl 2mo ago
This is a great related watch if you have some time to kill: https://youtu.be/KnUFH5GX_fI
10.
by dgfl 2mo ago
I realized how awful of an OS modern android is when I bought an iPad. I later fully switched to iOS and never looked back. Point is, sometimes people just have different experiences from you.
11.
by dgfl 2mo ago
This is intentional repetition. More specifically, anaphora [1]. You may not personally like it, but it is a rhetorical device used to emphasize a point. This one also comes with a nice progression: storms, storms, heat, heat, farmland, gr
12.
by dgfl 2mo ago
Not at all. The model could (and sometimes should) burn all the money it wants, and then produce a single line of actual production code. Only some things, e.g. full rewrites, have clear cost - LoC scaling. For my usage, I would very much p
13.
by dgfl 2mo ago
This looks like a good benchmark. Time and time again I keep giving OpenAI models the chance to win me back, but Opus (and Fable especially) just writes more elegant code and is a significantly more productive rubber duck for interactive di
14.
by dgfl 3mo ago
My hope is that the flood of AI articles pushes the academic publication system to its highly-anticipated breaking point. The most absurd part is that everyone in academia knows that publish or perish is tremendously damaging to real resear
15.
by dgfl 3mo ago
It doesn’t, no. The most successful platform actually uses superconducting devices as large as millimeters, you can literally see them with the naked eye. The issue with “just” photons and electrons is that you need something else to force
16.
by dgfl 3mo ago
You could make maybe ten transistors or so, but no more. That technique is quite literally pushing atoms one by one with a sharp needle. Not scalable, though maybe useful for some quantum computing platforms’ fabrication since we’re at earl
17.
by dgfl 3mo ago
Swedes have an almost comical compulsion to stay in the sun. Growing up in a hot place you get the opposite instinct. Still, it’s known that your skin color is the main thing that matters, which is why Australians have the worst melanoma st
18.
by dgfl 3mo ago
I’ve found the UV index forecasts to generally be a good metric, so try looking at those for various locations. The main factor here is that the lower the sun is from the horizon, the more its light will be absorbed by the atmosphere due to
19.
by dgfl 4mo ago
I feel like this is directly addressed in the article, right? I think you are coming from the same direction, but Rovelli goes a bit further and says "how can we affirm that there is gonna be a knowledge gap when we just aren't at
20.
by dgfl 4mo ago
Look up the “China brain” idea. It’s basically the same. Could you explain why that wouldn’t be conscious a priori?
21.
by dgfl 4mo ago
Can we start by defining consciousness as something that could be quantified physically, rather than a nebulous concept? With a common shared ground, we could at least define why we are all sure that individual neurons are unconscious. To a
22.
by dgfl 4mo ago
The point is that you don’t need to put a whole datacenter into a single satellite. You can put a single rack per satellite and have different racks communicate via antennas, laser links, or perhaps even wires since they’ll be launched in g
23.
by dgfl 4mo ago
The existence of starlink proves that this is false. Look at most current pitches, they don’t talk about GW-class monsters anymore. There’s absolutely nothing stopping a 20-30kW satellite bus the size of starlink (or I guess up to 100kW? on
24.
by dgfl 5mo ago
For context, this is paraphrasing a 1907 manuscript by Kenneth John Freeman [1], which itself was summarizing the complains that older generations would direct against the youth in Ancient Greece. [1] https://quoteinvestigator.co
25.
by dgfl 5mo ago
I’m not a native speaker and you may find my writing simplistic if your standard vocabulary includes three expressions I’ve had to look up (I don’t mean this as an insult, I was just genuinely stumped I could barely understand your comment)
26.
by dgfl 5mo ago
I think these articles may benefit from a more thorough table of content at the beginning, or from some kind of abstract. If you briefly presented the whole list of topics in a single article, it would be more clear that your views on the t
27.
by dgfl 5mo ago
lol. I did use a lot of short sentences, that’s my bad. But please read through [1] and compare my text onto it, it may enlighten you on how to actually spot llm writing. [1] https://en.wikipedia.org/wiki/Wikipedia:Sign
28.
by dgfl 5mo ago
The issue with most of these articles is that they seem to demonize the technology, and systematically use demeaning language about all of its facets. This one raises a lot of important points about LLMs, but the only real conclusion it see
29.
by dgfl 5mo ago
Some more serious critique of things I noticed within 30 seconds: - Text isn't selectable on the page. - The tooltip in the "day 1" to "day 14" cards gets cut off by the border (I see this mistake ALL the time with
30.
by dgfl 5mo ago
This is a pipe dream and I’m almost tempted to say a fever dream. The chemistry part seems somewhat sound, even though that’s outside of my field of expertise. But the entire readout process is questionable, and has clear signs of heavy AI

More ›