6 ms·

Maybe it's not so sensible to offload the responsibility of clear thinking to AI companies? How is a chatbot supposed to determine when a user fools even thems

by 152334H 6mo ago

Maybe it's not so sensible to offload the responsibility of clear thinking to AI companies? How is a chatbot supposed to determine when a user fools even themselves about what they have experienced? What 'tough love' can be given to one who, having been so unreasonable throughout their lives - as to always invite scorn and retort from all humans alike - is happy to interpret engagement at all as a sign of approval?

isodev 6mo ago
> clear thinking Most humans working in tech lack this particular attribute, let alone tools driven by token-similarity (and not actual 'thinking').
- deleted 6mo ago
  [deleted]
kibwen 6mo ago
> Maybe it's not so sensible to offload the responsibility of clear thinking to AI companies? Markets don't optimize for what is sensible, they optimize for what is profitable.
- SlinkyOnStairs 6mo ago
  It's not market driven. AI is ludicrously unprofitable for nearly all involved.
  - cyanydeez 6mo ago
    The profit appears to be capturing the political class and it's associated lobbies and monied interests.
expedition32 6mo ago
It's almost as if being a therapist is an actual job that takes years of training and experience! AI may one day rewrite Windows but it will never be counselor Troi.
- duskdozer 6mo ago
  Well, unless insurance companies figure out they can make more money by pushing everyone onto AI [step-]therapy instead of actual therapy
- yarn_ 6mo ago
  Come on, I'm sure Dario can find a nice tight bodysuit for claude
- fsmv 6mo ago
  Implying that programming is not an actual job that takes years of training and experience To be clear I don't think the AI can do either job
rsynnott 6mo ago
> How is a chatbot supposed to determine when a user fools even themselves about what they have experienced? And even if it _could_, note, from the article: > Overall, the participants deemed sycophantic responses more trustworthy and indicated they were more likely to return to the sycophant AI for similar questions, the researchers found. The vendors have a perverse incentive here; even if they _could_ fix it, they'd lose money by doing so.
nicce 6mo ago
> Maybe it's not so sensible to offload the responsibility of clear thinking to AI companies? Maybe it’s not so sensible to offload the responsibility of tubacca addiction to tubacca companies?

by 152334H 6mo ago

isodev 6mo ago

> clear thinking Most humans working in tech lack this particular attribute, let alone tools driven by token-similarity (and not actual 'thinking').

deleted 6mo ago
[deleted]

kibwen 6mo ago

> Maybe it's not so sensible to offload the responsibility of clear thinking to AI companies? Markets don't optimize for what is sensible, they optimize for what is profitable.

SlinkyOnStairs 6mo ago
It's not market driven. AI is ludicrously unprofitable for nearly all involved.
- cyanydeez 6mo ago
  The profit appears to be capturing the political class and it's associated lobbies and monied interests.

expedition32 6mo ago

It's almost as if being a therapist is an actual job that takes years of training and experience! AI may one day rewrite Windows but it will never be counselor Troi.

duskdozer 6mo ago
Well, unless insurance companies figure out they can make more money by pushing everyone onto AI [step-]therapy instead of actual therapy
yarn_ 6mo ago
Come on, I'm sure Dario can find a nice tight bodysuit for claude
fsmv 6mo ago
Implying that programming is not an actual job that takes years of training and experience To be clear I don't think the AI can do either job

rsynnott 6mo ago

> How is a chatbot supposed to determine when a user fools even themselves about what they have experienced? And even if it _could_, note, from the article: > Overall, the participants deemed sycophantic responses more trustworthy and indicated they were more likely to return to the sycophant AI for similar questions, the researchers found. The vendors have a perverse incentive here; even if they _could_ fix it, they'd lose money by doing so.

nicce 6mo ago

> Maybe it's not so sensible to offload the responsibility of clear thinking to AI companies? Maybe it’s not so sensible to offload the responsibility of tubacca addiction to tubacca companies?