typ

5 ms·

1.
by typ 6d ago
I think it should apply to all industries. But for many (or most?) countries where power generation is privatized in the first place, this shouldn't be a problem that we need to fix. The trickier question might be about the grid, which
2.
by typ 6d ago
I am not against AI data centers. But it's a good thing that the electricity infrastructure expenditures for AI data centers' consumption are paid by the companies making money from AI training and inference, rather than being pai
3.
by typ 21d ago
Especially when all major labs are building their custom inference chips.
4.
by typ 29d ago
Saw a theory somewhere that, instead of raising the minimum wage, a policy that enables and incentivizes job hopping is what actually works for increasing the median wage level. The inverse implication of the theory is also interesting: any
5.
by typ 1mo ago
> give people anything except your words. I feel that everyone in this small AI bubble (compared to the "normies") is busy trying to take advantage of AI to surpass everyone else, while fearing being surpassed by everyone else.
6.
by typ 1mo ago
Me neither. But open weights are not open source in the first place. It wouldn't be surprising that the raw intelligence of an LLM model has little to do with the architecture (which is the part most published). The secret sauce, like
7.
by typ 1mo ago
Electricity becoming a commodity doesn't necessarily make nuclear reactors become commodities. And as we can see, the publication of open-weight models doesn't really diffuse the know-how of training SoAT models as we expected. Ev
8.
by typ 2mo ago
There are some benchmarks I personally trust. But the most reliable indicator other than public benchmarks is the quality of products people are working on, and the model they use for the work. Not a benchmark scoreboard or a one~few shot d
9.
by typ 2mo ago
Tokens will surely become commodities, but models don't need to. The point is that electricity becomes a commodity, rather than, say, nuclear reactors or gas turbines also need to be commoditized. Contrary to most people in the softwar
10.
by typ 2mo ago
Abstraction doesn't necessarily lead to a smaller binary. Much of the bloat in modern software is indeed due to (bad) abstractions.
11.
by typ 2mo ago
Unlike the belief that frontier AI is expensive due to a high margin, and going to be expensive if there is no competition. My understanding is that, under certain circumstances (which is most likely true), the price will be driven down jus
12.
by typ 2mo ago
I don't understand how knowledge, either public or private, could get damaged. Though the income of the individuals and businesses that rely on the expertise of the knowledge would be damaged. Is that what you meant? Edit: At this sta
13.
by typ 2mo ago
We cannot always want to capture only the (temporary) winners whenever we see a lucrative business and expect to share a free ride. I'd also assume that most of the revenue these AI labs are making is turned into depreciating fixed cap
14.
by typ 3mo ago
Low latency is nice. But it would be more interesting if they could demonstrate the efficiency of energy consumption.
15.
by typ 3mo ago
> an open training source model It's always funny to see people tempted to call open-blobs/open-weights, which are literally shareware like WinRAR or Adobe PDF Viewer, open source , and then need to invent a new term for what
16.
by typ 3mo ago
A thousand 90 IQ cannot do what a 145 IQ can do. Similarly, some bosses might believe that they can hire 100 cheap, unmotivated SWEs to replace Linus Torvalds or Fabrice Bellard and achieve something slightly worse. But in certain areas,
17.
by typ 3mo ago
It takes billions of investments for infrastructure, and a high-paying, top-notch team for R&D and operations. Not just a bunch of torrents of pirated books. Let alone the best model developers are not necessarily the ones pirating the
18.
by typ 5mo ago
I don't think that learning from textbooks to take an exam and learning from the answers of another student taking the exam are the same. Joking aside, I also don't believe that maximum access to raw Internet data and its quantity
19.
by typ 7mo ago
6% compared to the post-2000s is mediocre, especially given the low baseline. Not remarkably better than other high-income democratic countries like Japan and West Germany. Even the US can have ~4% growth at the time.
20.
by typ 7mo ago
American business leaders have (had?) an obsession with gross margin and tech "advancedness." They thought they would be the winner as long as they occupied the high-tech sectors in the supply chain. So they discarded the high-vo
21.
by typ 7mo ago
If that were the true secret sauce of the economic success in China, why had it not taken off before the 2000s? Like, they have been that "aligned" and "want the same thing" and "run by engineers" since the 50s
22.
by typ 7mo ago
The silicon shield became a slogan that has only been popularized in recent years. The potential crisis of war has been there for more than half a century (even before semiconductors became a thing). The real value proposition of the status
23.
by typ 7mo ago
I'd bet, on average, the quality of proprietary code is worse than open-source code. There have been decades of accumulated slop generated by human agents with wildly varied skill levels, all vibe-coded by ruthless, incompetent corpo
24.
by typ 8mo ago
> reduce energy requirement by 10-50 times This is only relevant to the compute productivity (how much useful work it can produce), but it's irrelevant to the heat dissipation problem. The energy income is fundamentally limited by t
25.
by typ 8mo ago
That should be better than a sphere. Though I imagine there could be some fancier 3D geometry designs. Even for a simple sphere, if we give it different surface roughnesses on the sun-facing side and the "night" side, it can have
26.
by typ 8mo ago
Assuming that we place an iron ball (ideal sphere-shaped and thermal conductivity) on the SSO (solar synchronous orbit), how hot can the object be? Given the solar constant 1361 W/m^2, you can calculate the temperature range based on t
27.
by typ 8mo ago
The radiator area is probably not what they need to worry about that much as we thought. When the energy input comes from solar 100%, they just need to optimize the ratio of the sectional area facing the sun over the total surface area of t
28.
by typ 8mo ago
Not sure about the effectiveness of a heat pump in this use case. >Heat radiation works better the higher the temperature? The power output is proportional to T^4 according to the Stefan-Boltzmann law.
29.
by typ 8mo ago
It makes sense to target a higher operating temperature, like 375K. At some point, the energy budget would reach an equilibrium. The Earth constantly absorbs solar energy and also dissipates the heat only by radiative cooling. But the equil
30.
by typ 8mo ago
The label 'open source' has become a reputation reaping and marketing vehicle rather than an informative term since the Hugging Face benchmark race started. With the weights only, we cannot actually audit that if a model is a) con

More ›