rar00

195 ms·

1.
by rar00 8mo ago
> the researchers noticed a group of neurons that consistently signaled the wrong response. Instead of fading as learning improved, these neurons grew stronger, and occasionally even nudged the model toward an incorrect decision. > “
2.
by rar00 10mo ago
Really cool! An affective basis of homeostatic drive seems promising. Have you performed any basic evaluation / test of your approach? I'm also curious if there was any deliberation between pursuing "thinking" (language
3.
by rar00 10mo ago
typo? Rounding it up to 2 billion, 30% means 600 million per year
4.
by rar00 10mo ago
hmm, can't tell if complete bullshit or a work of genius. On the one hand, the approach overlaps a lot with my thinking, and has some original tweaks (like the emotionally valenced reward signals). Saying that as someone from a robotic
5.
by rar00 1y ago
I started reading two recent neuroscience books (elusive cures and natural neuroscience) that while have different goals both highlight the utility of systems neuroscience. In elusive cures the author presented a brief history of the evolvi
6.
by rar00 1y ago
"As [Essential AI Labs (founded in 2021 by Vaswani)] changes focus, Vaswani is asking investors for at least $150 million." expected, yet still funny. Noting that their initial aim was to capitalise on transformers to create busin
7.
by rar00 1y ago
https://archive.ph/pn5Tt
8.
by rar00 1y ago
I know people are pushing back, taking "only" literally, but from a reasonable perspective what causes LLMs (technically their outputs) to give that impression is indeed the crux of what holds progress back: how/what LLMs lea
9.
by rar00 1y ago
That's an orthogonal concern IMO. Running a batch in Europe is about tapping into another source of opportunities. There are plenty of founders that won't or aren't able to attend YC in SF
10.
by rar00 1y ago
disagree, there are a few organisations exploring novel paths. It's just that throwing new data at an "old" algorithm is much easier and has been a winning strategy. And, also, there's no incentive for a private org to a
11.
by rar00 1y ago
yep, even with greedy sampling and fixed system state, numerical instability is sufficient to make output sequences diverge when processing the same exact input
12.
by rar00 1y ago
This argument works better for state space models. A transformer would still steps context one token at a time, not maintain an internal 1e18 state.
13.
by rar00 1y ago
getting a billionaire to finance your startup with 9-figures for no equity... :D
14.
by rar00 1y ago
It is a sensible position. YC and VCs are backing businesses, not charitable causes or research initiatives. It is the founders' responsibility to liaise the two sides in order to signal that the pursuit of their particular purpose is
15.
by rar00 1y ago
the robot arm demonstration video jumps at the 00:28s mark...
16.
Develop Custom Physical AI Foundation Models with NVIDIA Cosmos Predict-2(developer.nvidia.com)
3 points by rar00 1y ago|1 comments
17.
by rar00 1y ago
Model weights already available in HF, code to be released shortly in GitHub ( https://github.com/nvidia-cosmos/cosmos-predict2 )
18.
Nvidia Announces Isaac GR00T N1 – Open Humanoid Robot Foundation Model(nvidianews.nvidia.com)
3 points by rar00 1y ago|0 comments
19.
by rar00 2y ago
aligns with (or is based on) Demis Hassabis' assessment from yesterday on missing cognitive capabilities for AGI: long-term memory, reasoning, hierarchical planning. He then goes on to suggest scientific creativity may be essential. h
20.
by rar00 2y ago
Says that new cognitive capabilities are needed to attain AGI: reasoning, hierarchical planning, long-term memory, inventive creativity. Interesting that LeCun also mentions the same needs in https://techcrunch.com/2025&#x2F
21.
Yann LeCun predicts "new paradigm of AI architectures" within 5 years(techcrunch.com)
20 points by rar00 2y ago|9 comments
22.
DeepMind's Demis Hassabis: Path to AGI, Deceptive AIs, Building a Virtual Cell [video](youtube.com)
2 points by rar00 2y ago|1 comments
23.
OpenAI funded independent math benchmark before setting record with o3(the-decoder.com)
56 points by rar00 2y ago|6 comments
24.
by rar00 2y ago
> However, we have a verbal agreement that these materials will not be used in model training. That'll do it... clearly no incentive to do otherwise. There should be some form of academic penalty for this kind of (feigned) naivety
25.
by rar00 2y ago
nice way to spoil the fight result to people. Because, of course, an athlete gaining more than its adversary is HN-worthy news...
26.
by rar00 2y ago
Paper: https://arxiv.org/abs/2501.00663
27.
by rar00 2y ago
They're planning to. The prime minister wrote some points on reducing bureaucracy in NHS/public services through AI his FT article: https://archive.ph/MpOOZ
28.
by rar00 2y ago
maybe it's worth specifying in the title this is written by UK's prime minister
29.
by rar00 2y ago
with human supervisors is the plan. Instead of X workers, they now have X agents + Y<<X supervisors to unblock (and collect additional data for) agents
30.
by rar00 2y ago
it's hard to escape the 'gimmickry' or narrow purpose in a cost-effective manner to allow the company to survive long enough and reach large-scale deployment. The reason is mixture of hardware and software constraints. You ne

More ›