hackerlight

6 ms·

1.
by hackerlight 2y ago
P(correct) doesn't go down with token count if you have self-correction. It can actually go up with token count.
2.
by hackerlight 2y ago
It's quite fitting that the topic of this thread is self-correction. Self-correction is a trivial existence proof that refutes what LeCun is saying, because all the LLM has to say is "I made a mistake, let me start again".
3.
by hackerlight 2y ago
Mostly terrorists are dead and this killed far less civilians than the alternative ways of waging war (ground invasion or bombing campaign). This is the level of surgical operation that everyone was calling for since Hezbollah declared war
4.
by hackerlight 2y ago
You should start by outlining the definition of terrorism, but by that point it would be obvious it isn't terrorism and such a post would have been unnecessary.
5.
by hackerlight 2y ago
It's good we have different states/schools trying different things, all within the realm of sensible ideas. This creates natural experiments which will be studied in detail, and which will guide evidence-based policymaking. There&
6.
by hackerlight 2y ago
They should be allowed to have the same access to and benefit of AI as any regular American business or individual. That is, access through an API. It's the secret sauce that I believe should be kept under wraps as a state secret.
7.
by hackerlight 2y ago
They relied on the taxpayer to fund their de facto customer service. It's like aged care homes overusing a public ambulance service instead of hiring an on-call doctor or nurse. Or shops not hiring security and overusing police resourc
8.
by hackerlight 2y ago
chat.lmsys.org --> "Leaderboard" tab --> "Coding" drop-down selection Or the scale.ai private benchmarks
9.
by hackerlight 2y ago
Open sourcing benefits everyone equally. Given that the US is currently ahead, it's helping China to make gains relative to the US that would have been very difficult otherwise. It's leaking what should be state secrets without ev
10.
by hackerlight 2y ago
If it was liberal minded people like Deng as leader of China and Gorbachev as leader of Russia I would care a lot less and may even be in favor of open source despite their autocratic system. They'd be trending towards another Singapor
11.
by hackerlight 2y ago
US has to win the race because while it's true that it's no angel, it isn't an authoritarian dictatorship and there isn't an equivalence in how bad the world will end up for you and me if the authoritarian side wins the
12.
by hackerlight 2y ago
Well, Ilya doesn't think that. He's firmly in the Hinton camp, not the Lecun camp.
13.
by hackerlight 2y ago
China can not win this race and I hate that this comment is going to be controversial among the circle of people that need to understand this the most. It is damn frightening that an authoritarian country is so close to number one in the ra
14.
by hackerlight 2y ago
This is not a trivial point. Selective pressures will push AI towards unsafe directions due to arms race dynamics between companies and between nations. The only way, other than global regulation, would be to be so far ahead that you can af
15.
by hackerlight 2y ago
"French electricity prices turned negative as a drop in demand and surging renewables output prompted some nuclear reactors to power down." This is an issue with nuclear in a net zero scenario. Nuclear starts out at 90%+ c
16.
by hackerlight 2y ago
Which saves on labor and land use costs, which is why it's a big deal.
17.
by hackerlight 2y ago
Similar. Retail panels can go as low as $0.2/W for the end consumer, so assume that manufacturing costs are $0.1-0.16/W for standard solar panels. But these are translucent. They'll be put onto windows. So even if they'r
18.
by hackerlight 2y ago
Skeptical about (c), source please. She did say they don't have anything much better than GPT-4o currently, but GPT-5 likely only started training recently.
19.
by hackerlight 2y ago
Reminds me of the AlphaCode approach. Why do you say it's sampling programs from "training data"? With that choice of words, you're rhetorically assuming the conclusion. If he only sampled 20 programs, instead of 8000, w
20.
by hackerlight 2y ago
Winter being a problem really depends on location. Seasonal variability is much lower near the equator. Also batteries are becoming a solved tech. Also wind is anti correlated with solar, it's stronger in winter and at night. So you wa
21.
by hackerlight 2y ago
This got innocent people killed. In a just world, those responsible would be in prison, but instead they just got another $0.5bn contract.
22.
by hackerlight 2y ago
It's cost prohibitive, a small hybrid system costs $4000usd which exceeds the average annual income of many equatorial countries. But you are right that if somehow everyone could install this system (along with an AC and the constructi
23.
by hackerlight 2y ago
You can't install aircon into a shack. The cold air will escape.
24.
by hackerlight 2y ago
There are often blackouts while the sun is shining in lower income countries.
25.
by hackerlight 2y ago
Wet bulb events aren't that simple to deal with. Grid stability doesn't exist in any of the poor and hot equatorial countries. Many people don't even have airtight housing which rules out aircon. If it was too cold instead th
26.
by hackerlight 2y ago
AMD is at a much higher PE ratio. Is the market expecting AMD to up its game in the GPU sector? Or is the market expecting a pullback in GPU demand due to possibility for non-GPU AI solutions becoming the frontier or for AI investment to sl
27.
by hackerlight 2y ago
> The founders still get preferential access to it, but because they really have taken more risk It's not related to risk, at least not directly. It's related to the supply of entrepreneurship as a factor of production. Entrepr
28.
by hackerlight 2y ago
The $1M ARC prize is advertising, just like being #1 on the huggingface leaderboard. It won't matter for end consumers, but for attracting the best talent it could be valuable.
29.
by hackerlight 2y ago
Amazon Mechanical Turk workers, who might not be 100 average IQ but wouldn't be far off that.
30.
by hackerlight 2y ago
Why does the existence of ChatGPT reduce the risk of disintermediation?

More ›