typon

8 ms·

1.
by typon 2mo ago
I am using a model that runs on a 100 GB300s, near AGI, all bets are off, $10B training run on a 1GW cluster, and it can't realize that when I told it to "please implement v2 of feature X" that I mean delete v1, not support v
2.
by typon 2mo ago
If there really was a "simple" solution to Fermat's Last Theorem, Andrew Wiles wouldn't have achieved the important result he did, ending up making connections across disparate fields of math. The LLMs "sweeping up&
3.
by typon 2mo ago
Yes that's called Mythos 2 or GPT 6
4.
by typon 2mo ago
There is ton of room for improvement "down there". * Software inference optimizations * Heavy quantization * Chips with hardcoded transformer architecture * Much cheaper HBM * Much sparser models - 1T total with ~1-10B active para
5.
by typon 2mo ago
By early 2028, major players like Intel, AMD, QC will ship accelerators in consumer laptops capable of running ~1T MoE models at ~100 tok/s
6.
by typon 2mo ago
DinoV3 paper: https://arxiv.org/pdf/2508.10104#page=36 "we use a rough estimate of a total 9M GPU hours" From CoreWeave, at current prices (~$2.46/hr spot to ~$6.16/hr on demand) would correspond to
7.
by typon 3mo ago
I remember saving up for a year to buy the ATI Radeon 9600 XT (I think it was $200 MSRP) so I could play the game on high settings. Now we can play it inside a virtual machine on a crappy laptop. What a journey
8.
by typon 4mo ago
Always pains me to see all this innovation and cool software work being applies towards making a machine that extracts money from retail investors and makes a few people extremely wealthy. What a depressing and colossal waste of time.
9.
by typon 4mo ago
Actually I think AI will largely automate software and math and really not much else in the short to medium term. (speaking as a computer/math person)
10.
by typon 4mo ago
Next time there is a fire at your house I will say "he's an adult who should have been careful playing with dangerous things like fire, we shouldnt waste society's money and resources on saving his house"
11.
by typon 4mo ago
That part should be non negotiable - the tech companies should be funding the energy infrastructure. My bet is that they'd happily do it. They are starved for space and energy, not capital.
12.
by typon 4mo ago
Can someone explain to me why local governments are so against datacenters? It seems like a golden opportunity to build electric infrastructure that's paid for by corporations and if AI is a bubble at least that infrastructure will rem
13.
by typon 5mo ago
https://imgur.com/a/dV8gk3R can you find curves like this for any other power source? also batteries are getting exponentially cheap too
14.
by typon 5mo ago
What is the point of building energy outside of solar farms? I'm sincerely asking
15.
by typon 5mo ago
And the reason for _that_ is because of the callous way American society accepts the deaths of thousands of people who die due to the Healthcare Industrial complex (of which Brian Thompson was a key member of). Just because those deaths don
16.
by typon 6mo ago
You will be forced to watch Firefly for eternity. Millenials will rule the internet for a 1000 years (a millenia).
17.
by typon 6mo ago
Like an oasis in a desert of LLM slop. Thanks I enjoyed this README
18.
by typon 7mo ago
We will be old, not boomers. Boomers are a special generation at a special moment in world history - they made decisions based on the limited amount of knowledge they had about how the world works and while some think those decisions have d
19.
by typon 7mo ago
Even though it feels depressing right now, I think the post-boomer world is going to be an amazing place.
20.
by typon 8mo ago
Is this why Google Search has been getting better and better every year?
21.
by typon 8mo ago
The website design and content are much nicer than the "ideas" here. Just standard LLM slop once if you actually have read some of these books.
22.
by typon 9mo ago
https://en.wikipedia.org/wiki/WPS_Office 500 million users. Just because you haven't heard it doesn't mean an alternative doesn't exist.
23.
by typon 10mo ago
ideally you should get a deduction in later years
24.
by typon 10mo ago
have you considered not all ideas are good and maybe they shouldn't see the light of day?
25.
by typon 11mo ago
I often wonder whether neuroscience on LLMs is harder or humans?
26.
by typon 11mo ago
This xkcd comic doesn't apply anymore due to AI making generating automation code trivial.
27.
by typon 1y ago
This is terrible
28.
by typon 1y ago
Can't wait till ChatGPT responses look like this
29.
by typon 1y ago
This looks amazing. I love tech in Lindy products that actually works well.
30.
by typon 1y ago
When you call yourself "Open"AI and then turn around and backstab the entire open community, its pretty hard to recover from that.

More ›