4 ms·
This is fueled by the parabolic token usage. If token usage continues to grow parabolic, then these are the most genius deals made. If token usage declines bec
by returnInfinity 11mo ago
This is fueled by the parabolic token usage. If token usage continues to grow parabolic, then these are the most genius deals made.
If token usage declines because of high prices, look at what happened to SBF.
- Ianjit 11mo agoI notice that when I ask ChatGPT a question the answers I get back seem more verbose than they were a year ago. Where a 1-2 line response would be sufficient GPT delivers a sprawling essay. Overall the value of the answer has probably gone down, but tokens are up.
- noosphr 11mo agoYou can quite easily ask it to summarize the result in a sentence or paragraph. LLMs have no other way to compute than write text and the more text they write the more compute they do. You only care about the final output.
- Ianjit 11mo agoI do. It typically goes on to write a preamble about why it gave a long answer before finally providing a summary. Token stuffing.
- noosphr 11mo agoThis is akin to complaining about the overhead of radix conversion between decimal and binary in early computers. Unless you figure out how to talk in latent space directly to an llm the preamble is the cost you pay for getting the answer back in English.
- bmacho 11mo agoI've just set my (free) ChatGPT to "Robot" in style options, so far I like its style and level of detailedness
- re-thc 11mo ago> look at what happened to SBF SBF lacked funds to ride it out. If they survived for a bit longer, Bitcoin would have surged and they'd keep going. AMD, Nvidia etc all have income and funds to survive. This is just about finances unless you're implying there's some crime here too.
- munksbeer 11mo ago> SBF lacked funds to ride it out. If they survived for a bit longer, Bitcoin would have surged and they'd keep going. Yes and then maybe he'd never have been arrested and jailed for all his crimes.