keeeba

5 ms·

1.
by keeeba 9d ago
The elves left a long time ago, it’s difficult to see much virtue in what remains.
2.
by keeeba 1mo ago
Also interested
3.
by keeeba 3mo ago
This is not an attempt at affected nonchalance, but I’ve simply never come across the idea that Dostoevsky is particularly difficult to read. A somewhat gifted teenager will race through it, as will an average adult.
4.
by keeeba 5mo ago
Not hired Suleyman? Build his own research lab? Satya made moves early on with OpenAI that should be studied in business classes for all the right reasons. He also made moves later on that will be studied for all the wrong reasons.
5.
by keeeba 7mo ago
The gap between Anthropic and the other guys keeps growing
6.
by keeeba 7mo ago
Big respect Total humiliation for Hegseth, sure there will be a backlash
7.
by keeeba 7mo ago
To somewhat state the obvious - the problem isn’t the amount of data, it’s the algorithms. We need to discover the set of learning algorithms nature has, and determine whether they’re implementable in silicon
8.
by keeeba 8mo ago
Is everything OpenAI do/release now a response to something Anthropic have recently released? I remember the days when it was worth reading about their latest research/release. Halcyon days indeed.
9.
by keeeba 8mo ago
“ This is one of my fundamental beliefs about the nature of consciousness. We are never able to interact with the physical world directly, we first perceive it and then interpret those perceptions. More often than not, our interpretation ig
10.
by keeeba 9mo ago
I don’t have the experiments to prove this, but from my experience it’s highly variable between embedding models. Larger, more capable embedding models are better able to separate the different uses of a given word in the embedding space, s
11.
by keeeba 9mo ago
Doesn’t seem like this will be SOTA in things that really matter, hoping enough people jump to it that Opus has more lenient usage limits for a while
12.
by keeeba 10mo ago
As a fairly extensive user of both Python and R, I net out similarly. If I want to wrangle, explore, or visualise data I’ll always reach for R. If I want to build ML/DL models or work with LLM’s I will usually reach for Python. Often i
13.
by keeeba 10mo ago
Oh boy, if the benchmarks are this good and Opus feels like it usually does then this is insane. I’ve always found Opus significantly better than the benchmarks suggested. LFG
14.
by keeeba 10mo ago
Please don’t actually use these 5,6,7-way Venn diagrams for anything practical, they’re virtually useless and communicate nothing.
15.
by keeeba 11mo ago
I agree it is a profound question. My thesis is fairly boring. For any given clustering task of interest, there is no single value of K. Clustering & unsupervised machine learning is as much about creating meaning and structure as it is
16.
by keeeba 11mo ago
“Skills are a simple concept with a correspondingly simple format.” From the Anthropic Engineering blog. I think Skills will be useful in helping regular AI users and non-technical people fall into better patterns. Many power users of AI we
17.
by keeeba 1y ago
It came from nowhere to 1T tokens per week, seems… suspect.
18.
by keeeba 1y ago
What use-cases do you see for the 270M’s embeddings, and should we be sticking to token embeddings or can we meaningfully pool for sentence/document embeddings? Do we need to fine-tune for the embeddings to be meaningful at the sentenc
19.
by keeeba 1y ago
Anthropic say Opus is better, benchmarks & evals say Opus is better, Opus has more parameters and parameters determine how much a NN can learn. Maybe Opus just is better
20.
by keeeba 1y ago
How have you tested your recall in the long and short term? And what were the results?
21.
by keeeba 1y ago
Just checking my notes here. This is the same Sam Altman who abandoned OpenAI’s founding mission in favour of profit? No it can’t be
22.
by keeeba 1y ago
I want to believe that it wasn’t announced at that time, with that name, purely to detract from Google I/O. But it’s hard
23.
by keeeba 1y ago
https://arxiv.org/abs/2309.08632
24.
by keeeba 2y ago
Nice story - I’ve seen you on the leaderboard a few times. Good luck through the rest of Foundations III
25.
by keeeba 2y ago
Nice, also find small classifiers work best for things like this. Out of interest, how many, if any, of the 3million were labelled? Did you end up labelling any/more, or distilling from a generative model?
26.
by keeeba 2y ago
Thanks for linking - I know this is pedantic but one might think OpenAI’s models could make their content free of basic errors quite easily? “Conretely, let's define a routine to be a list of instructions in natural langauge (which we&