Wheatman

6 ms·

1.
by Wheatman 2y ago
I guess It is less haha funny, and more depressing funny.
2.
by Wheatman 2y ago
Multi-billi9m industry sure, but it doesnt justify near trillions of spending and hype. AI is slightly behond search engines/internet in terms of usefulness, and even that was bubble, and the sad thing is we already had a few AI wonter
3.
by Wheatman 2y ago
Well, apparently it has ended up being true. The orion model underperformed expectations by a lot, and even fell beh8nd chatgpt-4 in programing tasks.
4.
by Wheatman 2y ago
Why does your reply feel like it was edited by an llm? Still, feels like we are at risk of another AI winter soon, especially with such a huge bubble being built around it this time. Here to hoping the US wont hit a recession bceause of it.
5.
by Wheatman 2y ago
Well uh, I dont know if this is bad news or good news but GPT-5 might never be released, their "Orion" model seems to be barely better if not worse than GPT-4. Here: https://the-decoder.com/openais-new-orion-model-r
6.
by Wheatman 2y ago
Interestingly enough, the new "Orion" model by OpenAI doesnt outperform, and even sometimes underperforms in programing tasks, when compared to GPT-4. There is an interesing discussion about it here: https://news.ycombin
7.
by Wheatman 2y ago
But why would you spend billions training an llm, when it barely shiws any improvement over the previous model. Unless OpenAI is willing to do something desperate, the best they have right now is what llm are, and so the cost would be in ma
8.
by Wheatman 2y ago
>Those GPUs also cost a bomb to run. LLMops isn't super easy, I am working with a large OEM manufacturer rn as a consultant and they are also experimenting internally with LLMs, but they have enough resources to run those models. I
9.
by Wheatman 2y ago
Open AI is already running a huge loss currently, and it isnt like o1 is cheap to run either. I wonder what price these llm's can be run in order to be profitable,and whether just running your own model would be worth it. Maybe it coul
10.
by Wheatman 2y ago
While There is money to be made in further integrations, hell thats where i see most of thr priductivity increase from these tools coming from, OpenAI has already spent billions developing these tools, money which they have to pay back in s
11.
by Wheatman 2y ago
The thing with AI isnt that it doesn't have a whole lot of use cases,it is thr fact that its use cases dont justify the hype or investment it has gotten. It is somewhere in between Crypto and dot.com as far as bubbles go, and as open m
12.
by Wheatman 2y ago
They are already bleeding money from what I'm aware, so they either have to jack up prices so much they could make up for 5bn in losses, or Sam Altman manages to convince investors to contribute to another funding round. Considering he
13.
by Wheatman 2y ago
It is just the kind of scifi trope that wouod get investors invessting. OpenAI barely has any moat, I Seriously wonder why no one is talking about hoq much open weighted models are getting to the closes source ones, they need invesotr cash
14.
by Wheatman 2y ago
How woukd you even put ads into an llm, especillay an open weighted one? Maybe thats why they are talking about a fully AI generated feed, despite how unpopular that is with users. Dont have to pay tge content creators a share if you produc
15.
by Wheatman 2y ago
Another thing this paper mentions is how Open models like llama are quickly closing in on Closed source ones. I wonder what kind of future llm have, since soon with a good enough GPU you can run your own model that is as good as the paid on
16.
by Wheatman 2y ago
This seems to be a prevalent problem that people bring up. I remember there was a forum post about it that got a lot of flack, but maybe they were onto something. Here it is: https://community.openai.com/t/did-chatgpt-4
17.
by Wheatman 2y ago
Cheked, it is True,I rarely see or hear about iphones, so i just heard they sold badly and made a connection. Though why was that fact never mentioned in the adverts? Or did i just not notice?
18.
by Wheatman 2y ago
My guess is that they changed it from our definition of AGI to their own: Artificial. Good enough. Intelligence. Besides, most people i know that use AI say they would get much more out of it with smaller more specifically trained models th
19.
by Wheatman 2y ago
It already is harming sales apparently, little to no of the reviews on the new iphone even mention AI even though they spent a lot of money marketing for it. It even seems to hurt its sales. I wouldn't bet on a full-on ai wonter soon,
20.
by Wheatman 2y ago
Note: This isn't to be confused with model collapse (the rapid deterioration of models trained on their own data), this paper talks about neural collapse (Read here: https://medium.com/ai-assimilating-intelligence/w
21.
The Persistence of Neural Collapse Despite Low-Rank Bias(arxiv.org)
1 points by Wheatman 2y ago|1 comments
22.
Length-Induced Embedding Collapse in Transformer-Based Models(arxiv.org)
3 points by Wheatman 2y ago|0 comments
23.
by Wheatman 2y ago
My honest guess is that they want to use AI generated content to lie more truthfully. I imagine 2 or 3 years from now, major social media companies are gonna keep claiming stuff like "Over 1 billion unique images uploaded each month&qu
24.
Meta CEO says AI will be the next big Category of social Media(fortune.com)
3 points by Wheatman 2y ago|2 comments
25.
by Wheatman 2y ago
My guess is that they counted each line of code made by an engineer using AI coding tools. Besides, even google employees write a lot of boilerplate, especially android IIRC, not to mention simple but essential code, so AI can prevent carp
26.
by Wheatman 2y ago
It is great for cheating at school, at least. And maybe boilerplate.
27.
by Wheatman 2y ago
2T is still ridiculous. My guess is that since they are so sure of AGI being achievable soon, that they think they can squeeze out any amount of money they want out of investors. After all, AGI would be worth way more thab 7T right?
28.
by Wheatman 2y ago
>"Open AI CFO". While i don't want to say completely ignore what she says based on her postion, the fact that she is the Chief "Financial" adviser should atleast raise a few red flags when considering her words o
29.
by Wheatman 2y ago
While i somewhat agree, the real sad thing is that 10% is real and usefull, yet it gets overshadowed by that 90% hype based products. Think of how mych money is being thrown at hype products that could have been allocated to the next Cancer
30.
by Wheatman 2y ago
Interesting read. I noticed something, you achieved near 100% accuracy on most domains in every domain but scientific which made me wonder, how much is that could be due to how "strict" and "profrssional" these papers co

More ›