Tier3r

6 ms·

1.
by Tier3r 2y ago
The feeling I'm getting is management took such a huge stance (the capex, the name change, etc) on it it'd be humiliating to turn 180 and ditch it now (they've spent 50 billion on Reality Labs so far). So they're quietly
2.
by Tier3r 2y ago
The only reason I can think that this atrocity got deployed was from an engineering perspective, creating AI profiles to engage theoretically gives FB a powerful lever to increase engagement, because you'd have this entire new field to
3.
by Tier3r 2y ago
I'd argue that it hasn't come to pass, but it is not wrong that its a better way to teach. Virtually all education has been set up in an industrial line style of pre-u education -> university -> companies -> profits ->
4.
by Tier3r 2y ago
I don't think the Biden admin can criticize Xi for cyber warfare with a straight face.
5.
by Tier3r 2y ago
In intelligence/performance. It's admittedly a fuzzy notion. Most benchmarks will probably show decreasing gains between generations. Similar to time/space complexity, trying to debate about what performance/intelligence
6.
by Tier3r 2y ago
We are likely going to get there. Similar to the steam/combustion engines (and other core technologies like computers, wireless transmission etc) there's first a massive rush to increase the power of it, at the cost of efficiency
7.
by Tier3r 2y ago
From the amount of data each successive generation used (which grew many orders of magnitude each time) to the decreasing, logarithmic performance, it's quite clear the steam is running out on shoving more data into it. If one plots th
8.
by Tier3r 2y ago
I fear not the man who has written 10,000 features once, but the man who has written 1 feature 10,000 times
9.
by Tier3r 2y ago
Something interesting I heard from a chip company that's huge in the space and work intimately with many automotive companies - why Chinese companies grow so fast is because their development cycle for a car is ~2-3 years, compared to
10.
by Tier3r 2y ago
If one gets into the weeds of the whole messy thing, the Shanghai Communique acknowledges the position of both sides (Taiwan and China) that there is one China, the 1982 Joint Communique acknowledged the Chinese position and said the US had
11.
by Tier3r 2y ago
There exists a third possibility where the US and China sign an under the table deal for China to invade, the US to saber rattle and China to allow the flow of chips to continue. The present direction seems to be the US is "de-risking&
12.
by Tier3r 2y ago
That is false equivalence, there's a class of things that should rightfully be discouraged from military use (chemical/biological weapons, land mines, phosphorous weapons) because of the significant harm/side effects they cau
13.
by Tier3r 2y ago
That seems like a good idea. I am puzzled by what benefit the RL has in OP. It seems like a well defined constraint optimisation problem that could be done without RL, for example in the way you mentioned.
14.
by Tier3r 2y ago
Google is getting enshittified. It's already visible in many small ways. I was just using Google maps and in the route they called X (bus) Interchange as X International. I can only assume this happened because they are using AI to sum
15.
by Tier3r 2y ago
I'm also wondering this. Two possibilities. One, find the first principles/root node/glue that holds many disparate concepts together in some causative way. Two, the specific procedure/step/concept that you keep reu
16.
by Tier3r 2y ago
The initial cram is an interesting concept. If you insert new things to learn at a constant rate, the repetition burden grows logarithmically. Assuming you have some fixed amount of time you can devote everyday optimally your repetition bur
17.
by Tier3r 2y ago
I'm dubious of its scale and effects. Tech creates exponential value because of aggressive focus, iteration and critical mass of talent. The reserves seems very far from this.
18.
by Tier3r 2y ago
I suspect the actual dollar value of AI from "companionship" far outstrips the value created from the endless junk like Gemini summaries.
19.
by Tier3r 2y ago
Starting from the basics, Ramanujan was known to spend huge amounts of time in the library pouring over mathematical texts. He was also personally and spiritually obsessed with mathematics, thinking it was an expression of divinity. So its
20.
by Tier3r 2y ago
As much as I love Anki there is enormous friction in creating the cards, especially as a beginner. And you very easily get overfitting when you keep seeing the same question.
21.
by Tier3r 2y ago
That is IMO already done by domain experts in the form of textbooks, courses, university classes etc. And with formal, tested relationships between various islands of knowledge. I'm not too sure how much I would trust an LLM to do this
22.
by Tier3r 2y ago
Same for Anki, Notion, Zettelkatsen etc. Even ignoring the setup cost, it costs as much effort to insert in something as it does to retrieve it. The value prop tends to be low for individuals.
23.
by Tier3r 2y ago
Perplexity has a dubious idea based around harvesting user chats -> making service better -> getting more user prompts. I am quite unconvinced that user prompts and stored chats will materially improve an LLM that is trained on a tril
24.
by Tier3r 2y ago
I'd chime in on a somewhat lesser known part of networks that in practice the real determinant of performance: congestion control. The effects can be on the scale of an order of magnitude or two. The problem of how decentralised nodes
25.
by Tier3r 2y ago
The number of cases AI is used for is too vast to cover, but I do have the same experience. I've a few heuristics about assessing how well AI will work. 1) AI's performance decreases exponentially with the sparsity of relevant exa
26.
by Tier3r 2y ago
Chinese startups have historically been the only ones to be able to move as fast as Musk. One very underrated ability of Tesla is they can develop new products in 2-3 years from conception to market. The only other car companies to do it a
27.
by Tier3r 2y ago
Such a service is the opposite of a flywheel (a brake?) in practice. Those tokens are extremely low quality data. 1) I strongly double if even one in a thousand people actually bothers to report the outcome of their result. I and every prog
28.
by Tier3r 2y ago
No truck on this robot vacuum race because I don't own one, but one an incredible name.
29.
by Tier3r 2y ago
Counterpoint: How much of these novels are imaginative paranoia driven by cynical consumers? The closest similar incident - the Tongan castaways (granted they were aged 13 - 19 instead of 6 - 12) had the boys create a more or less exemplary
30.
by Tier3r 2y ago
I wouldn't exactly buy into the article. Its brilliant in that it puts a lot of things in your heads about Mark stepping back, but Meta's lobbying in dollars hasn't ceased one bit (its the 2nd largest lobbying spender after A

More ›