epups

6 ms·

1.
by epups 2y ago
Some important landmarks since GPT4 was first released (not in chronological order): - Vast cost reduction (>10x) - Performance parity of several open source models to GPT4, including some with far fewer parameters - Much better performa
2.
by epups 2y ago
Greenwald is an odd one, I'll give you that. He seems to see this issue from a libertarian perspective. He would also say that Germany banning Nazi speech is censorship, for example. It's worth nothing that his last professional o
3.
by epups 2y ago
A huge chunk of them were made public: https://apnews.com/article/brazil-twitter-elon-musk-x-censor... To the people disagreeing with my parent statement, could you find one non far right affiliated legal scholar who w
4.
by epups 2y ago
This is what the far right in Brazil wants you to believe, but it's not true. It's especially not true in regards to X, as they have repeatedly ignored judicial decisions that are very similar to those by European courts (ie, remo
5.
by epups 2y ago
This is partially the reason why we see LLM's "plateauing" in the benchmarks. For the lmsys Arena, for example, LLM's are simply judged on whether the user liked the answer or not. Truth is a secondary part of that proce
6.
by epups 2y ago
Intel seems 100% tied to its outcomes as a foundry now. If there is any disruption in chip prodution from Taiwan for example, I can see its stock doubling in price.
7.
by epups 2y ago
The graphs seem to indicate their model trades blows with Llama 3.1 405B, which has more than 3x the number of tokens and (presumably) a much bigger compute budget. It's kind of baffling if this is confirmed. Apparently Llama 3.1 relie
8.
by epups 2y ago
This article is borderline comical. The thin list of his accomplishments focus on increasing revenue ($15B to $70B) and launching or acquiring successful initiatives (Xbox, Skype, Azure). Then the rest is a recollection of his biggest embar
9.
by epups 2y ago
It seems that this would compete with Khan Academy for a similar space. Perhaps Karpathy will aim for adults instead?
10.
by epups 2y ago
> If we start with 2410 GWh in 2023 and grow with 59% per year that gives us 61.917 GWh in 2030. That would mean almost exactly 8 doublings in 2030. For context, the global electricity consumption in 2019 was around 23 TWh [1]. [1] http
11.
by epups 2y ago
The author is making the point that Alphafold 3 is not so impressive - it is simply regurgitating its train set, and it's not so good for inference. I think his central point is fair and interesting. The test train split is apparently
12.
by epups 2y ago
It would be simply stupid that we got so much worse at this technique in the past 10 years. You are welcome to post a link to your data source here, you already had two opportunities to do so.
13.
by epups 2y ago
No, it's actually only about 1% that do: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4302464/
14.
by epups 2y ago
The article makes it sound like it was ultimately a great decision, because now coal use is at historically low levels while renewables have been increasing. What it neglected to mention is that if nuclear had remained there, the share of c
15.
by epups 2y ago
This is the same dynamics we have seen before. How many national supermarket chains are there? Crossing Walmart or Amazon seem very analogous here. If anything, business in the past was more feudalistic, as people were bound to a given mark
16.
by epups 2y ago
If it's not about percentages, then what's the difference here? Walmart and Amazon are not fundamentally different. If the Apple Store can be compared to a mall, then we are in the same economic model we've been for decades.
17.
by epups 2y ago
I like Varoufakis in general and I find this analogy interesting. However, his answer to this question was not satisfactory in my opinion, as many commercial arrangements including malls, are also based on percentages: Q: A company like App
18.
by epups 2y ago
It is not always trivial to switch. There are realistically two companies dominating phone OS, and either one comes with their poisoned pills. More importantly, I think what he is referring to here is the economical subjugation of the rest
19.
by epups 2y ago
Sorry, could you expand on this a bit further? Are you saying that for a MoE, you want to train the exact same model, and then just finetune the feed forward networks differently for each of them? And you're saying that separately trai
20.
by epups 2y ago
A gun malfunction has a potentially lethal consequence. This bug caused a person to see a fake photo of herself with fake boobs out. Perhaps it's ok that the safety standards for the latter are lighter, no? You also didn't address
21.
by epups 2y ago
How is Anthropic moving so fast if it took them almost a year to produce a better model? And they have probably 1% of the market right now.
22.
by epups 3y ago
You write as if there is a finite supply of "entertainment" which comes out of thin air. If someone is consuming, then someone is supplying. You mentioned yourself that the ones supplying are the locals. So, in your analogy the lo
23.
by epups 3y ago
How many libraries were included in these 25 lines of code?
24.
by epups 3y ago
If the manager is responsible for hiring and managing the driver and the navigator, then obviously they can also be under stress, and will be held responsible for the outcome.
25.
by epups 3y ago
Wait, so progress on Stockfish would happen regardless of Alpha Chess? I always thought they were inspired by it in the newer versions, and got much improved rating from incorporating it.
26.
by epups 3y ago
I like the article, but I feel that it could have been written 50 years ago as well. Russia being led by a despotic leader, proxy conflicts, lack of social cohesion, those are all things we have seen before in the 70's and in other poi
27.
by epups 3y ago
The US has done a great deal of meddling in Congo, including plotting to kill their president and installing a dictator: https://en.m.wikipedia.org/wiki/CIA_activities_in_the_Democr...
28.
by epups 3y ago
Most likely they are worried about copyright and GDPR issues, not those concerning AI specifically (yet).
29.
by epups 3y ago
The scientific consensus is that they are clearly a separate species, but there are varying ways to define these boundaries. For a primer, you can read up more here: https://www.nhm.ac.uk/discover/are-neanderthals-same-
30.
by epups 3y ago
The main issue with populism and why people fall for it is a reliance on narratives over facts. If we discuss consolidated data instead of an anecdote, the conclusion is quite clear, and it shows that you are wrong: https://theco

More ›