soVeryTired

12 ms·

1.
by soVeryTired 4d ago
Was it a marketing win though? My takeaway is: if you're doing groundbreaking work with openAI's models and they find out, at best they'll outspend you and scoop you. At worst they'll steal your chat history.
2.
by soVeryTired 6d ago
Yeah - I think he’s worried that we have a tool that’s almost an oracle that can just get straight to the heart of a given problem. The problems aren’t always that interesting in their own right. But the quest to solve them is often what
3.
by soVeryTired 15d ago
Out of interest, would you call BERT an LLM? It’s pre trained but not particularly large.
4.
by soVeryTired 15d ago
It’s neither large nor language-based. ARC-AGI-1 is grid-based and nonverbal. Use of a transformer is not necessary or sufficient to qualify as an LLM.
5.
by soVeryTired 1mo ago
Undetectable by a human reader. Come on, give the post a charitable reading.
6.
by soVeryTired 1mo ago
Yeah - otherwise it’s bizarre to have row vectors and column vectors.
7.
by soVeryTired 1mo ago
To that point, given a corpus of writing from person A and another from person B, I have no doubt it’s easy to train a classifier to determine who wrote what. In fact I believe law enforcement agencies already have these classifiers. The on
8.
by soVeryTired 1mo ago
Out of interest, do Musk's politics impact your decision on whether or not to use Grok? I'd be interested to know where folks lie on the (Agree / Disagree) and (Use / Don't use) axes.
9.
by soVeryTired 1mo ago
0000 in base pi. Oh Jeff.
10.
by soVeryTired 2mo ago
I mean yes but where does that get us? The great oxygenation event wasn't exactly good for the organisms that were alive at the time.
11.
by soVeryTired 3mo ago
No way is vocab size zipfian. Word counts from a corpus follow zipf's law, but not vocab sizes themselves. Otherwise the most common vocab size would be equal to one.
12.
by soVeryTired 3mo ago
Can anyone explain to me why Q and K are both needed? They only ever appear as a pair, so why can’t you just define a matrix A = QK and learn that directly?
13.
by soVeryTired 4mo ago
> On March 12, 2025, a search warrant was executed at Sohaib’s home in Alexandria. Agents grabbed plenty of tech gear but also turned up seven firearms and 370 rounds of .30 caliber ammunition. Given his former crimes, Sohaib should have
14.
by soVeryTired 4mo ago
I have a feeling taxes are possible to circumvent only because a government tends to have one arm that wants to collect taxes, and another that wants to reduce them to encourage certain outcomes (like having a business setting up shop withi
15.
by soVeryTired 5mo ago
Us consumers don't want moats. But to understand the investment you need to understand the moat: no sensible investor will throw this much money around without one. If you don't understand what is keeping new players from entering
16.
by soVeryTired 5mo ago
Whenever people bring this up I like to remind them that linear interpolation is a universal function approximator.
17.
by soVeryTired 5mo ago
The company is named after the evil telepathic orbs from lord of the rings. Wasn't that the first clue that everything might not be hunky dory?
18.
by soVeryTired 9mo ago
I'm sure some python devs care about cache misses too. I guess my point was that the big results will be picked over again and again to understand _exactly_ which conditions are needed for them to hold.
19.
by soVeryTired 9mo ago
In my experience those debates are usually between experts who deeply understand the difference between ABC and XYZ widgets (the example I'm thinking of in my head is whether manifolds should be paracompact). The decision between the t
20.
by soVeryTired 9mo ago
IMO it's not far off how most python or javascript devs don't care about registers or cache misses. Someone's thought deeply about those things so you don't have to. Mathematicians do care about how much "black magi
21.
by soVeryTired 9mo ago
Anyone have a good explanation for why elliptic curves have a 'natural' group law? I've seen the definition of the group law in R before, where you draw a line through two points, find the third point, and mirror-image. I fee
22.
by soVeryTired 10mo ago
The average density of matter in the universe is one proton per five cubic meters or so. We're very much the outlier!
23.
by soVeryTired 10mo ago
That's more like the false positive rate and false negative rate. If we're being literal, accuracy is (number correct guesses) / (total number of guesses). Maybe the folks at turnitin don't actually mean 'accuracy&#
24.
by soVeryTired 10mo ago
The word “some” in the quote from Box is doing a lot of heavy lifting. If a model is useful, I’d like to see it being used (outside academia, where there’s minimal penalty for complexity and a high emphasis on novelty). If models like the
25.
by soVeryTired 10mo ago
There's no place for you here you lunatic
26.
by soVeryTired 10mo ago
I didn't say it wasn't alarming, I said it wasn't civilization- or nation-ending. Unless you're a tiny island nation, in which case I'll happily retract what I'm saying. There are degrees of awfulness between &
27.
by soVeryTired 11mo ago
Ports get retrofitted, redesigned, and rebuilt. The AMOC collapsing is a serious thing, but I'm not saying climate change isn't real or isn't a threat. My original point is that three feet of sea level rise is manageable, if
28.
by soVeryTired 11mo ago
A metre of sea-level rise is painful for a rural cottage by the sea. But if you're in a city - particularly a wealthy city - it's something that can be engineered around. An expensive liability? Definitely. A civilization or natio
29.
by soVeryTired 11mo ago
He's comparing AGW, which drives a trend , with weather-based events, which are noise around the trend. He conveniently cuts his analysis off at the year 2100, by which we'll all probably be dead. But he's probably right tha
30.
by soVeryTired 11mo ago
It confused me a lot - I cancelled the denominators in my head too. But then I realised they're just plotting y/(x^2+y^2) - (x+1)/(x^2+y^2) = c and colouring by c (i.e. a heatmap, as others have mentioned in the thread). That

More ›