6 ms·

> The solution to uncertain information isn't more information, which the AI can certainly provide, it's better information, and AI cannot currently provide tha

> The solution to uncertain information isn't more information, which the AI can certainly provide, it's better information, and AI cannot currently provide that. I'd argue that AI _can_ currently provide that, but that it can't do it _reliably_, and that to non-experts it's impossible to differentiate, which makes it all the more dangerous.

margorczynski 3mo ago
Isn't that the case with human "experts"? If you had encounters with doctors, mechanics, etc. you'll know you can get a completely different diagnosis for the same problem which obviously means (in most cases) that the person you thought an expert is wrong. What is needed are studies that will take a cold look at the actual results because AI seems to be required to be perfect or it is useless. It just needs to be as good as a human for most stuff, but in the long run it will be much better. At least that what extrapolating current reality shows us.
- wwweston 3mo ago
  We have systems around humans that exist to manage expertise gaps, credibility signals, and accountability. This is part of what makes humans as good as they are, along with specialized training and some measure of meritocratic selection. We license and regulate and account and litigate to make a system that responds and improves. Some of this might be applicable to LLMs, but some isn’t and much of it would be resisted. This is one reason we’re not likely to get “as good as a human” because at some level we’re not optimizing for the outcomes; we’re optimizing for speed, convenience, some participant’s economics, and underlying beliefs.
  - malfist 3mo ago
    I've been going through PT for a hypermobility disorder related injury and I've use an AI to help me figure out "interview questions" to see if a PT knows anything about hypermobility or is willing to learn. I found it helpful to select a new PT after my first PT I trusted made things worse by prescribing stretches and no load progression from rest and recovery back to deadlifts
    - draftsman 3mo ago
      May I ask, is the hypermobility disorder you refer to EDS? If so, what was the injury?
      - malfist 3mo ago
        My doc didn't do the full set of test/exam for an hEDS diagnosis, so technically it's just generalized hypermobility spectrum disorder based on past medical history and a near "perfect" beighton score. It could be hEDS though, as a lay person reading the diagnostic criteria I either fit it, or are borderline. Injury was to my SI joint, I've historically always irritated it lifting, but I set a new PR for deadlifts and it was debilitating for 3 weeks before my other half made me stop being stubborn and see a doctor about it. I've also had my left shoulder joint surgically repaired after multiple dislocations.
    - kerabatsos 3mo ago
      People put a lot of faith in human “guardrails”, standards, etc. But the same argument could be made that trusting human experts without discernment is as dangerous as trusting AI or Google or whatever other non-human source. It’s always been the case.
      - malfist 3mo ago
        On the plus side, it's not like it was blind faith. Human judgement lead me to seek out another expert when I didn't like with the current PT was suggesting I do (no practicing hip hinge movements before moving to deadlift, advising against valsava for heavy lifts, ignoring feedback that a movement was causing pain, prescribing stretches to increase flexibility in a hypermobile person). The LLM also gave me a bunch of questions to ask a new PT but I didn't have the understanding to judge the responses so I did more research. One of the things the LLM wanted me to ask about was questions about form and force closure and ideally would get a response about the oblique sling across the back. My PT didn't give me that exact response, but explained it in much more lay person terms, but because I had done my research I was able to validate their response was directionally correct. And so far, my experience with this PT has been much better. We're doing block pulls at 70% of my prior deadlift weight, next week we're going to go way back on weight and lower it some to get closer to proper deadlifting and work in some asymmetric loading exercises.

margorczynski 3mo ago

Isn't that the case with human "experts"? If you had encounters with doctors, mechanics, etc. you'll know you can get a completely different diagnosis for the same problem which obviously means (in most cases) that the person you thought an expert is wrong. What is needed are studies that will take a cold look at the actual results because AI seems to be required to be perfect or it is useless. It just needs to be as good as a human for most stuff, but in the long run it will be much better. At least that what extrapolating current reality shows us.

wwweston 3mo ago
We have systems around humans that exist to manage expertise gaps, credibility signals, and accountability. This is part of what makes humans as good as they are, along with specialized training and some measure of meritocratic selection. We license and regulate and account and litigate to make a system that responds and improves. Some of this might be applicable to LLMs, but some isn’t and much of it would be resisted. This is one reason we’re not likely to get “as good as a human” because at some level we’re not optimizing for the outcomes; we’re optimizing for speed, convenience, some participant’s economics, and underlying beliefs.
- malfist 3mo ago
  I've been going through PT for a hypermobility disorder related injury and I've use an AI to help me figure out "interview questions" to see if a PT knows anything about hypermobility or is willing to learn. I found it helpful to select a new PT after my first PT I trusted made things worse by prescribing stretches and no load progression from rest and recovery back to deadlifts
  - draftsman 3mo ago
    May I ask, is the hypermobility disorder you refer to EDS? If so, what was the injury?
    - malfist 3mo ago
      My doc didn't do the full set of test/exam for an hEDS diagnosis, so technically it's just generalized hypermobility spectrum disorder based on past medical history and a near "perfect" beighton score. It could be hEDS though, as a lay person reading the diagnostic criteria I either fit it, or are borderline. Injury was to my SI joint, I've historically always irritated it lifting, but I set a new PR for deadlifts and it was debilitating for 3 weeks before my other half made me stop being stubborn and see a doctor about it. I've also had my left shoulder joint surgically repaired after multiple dislocations.
  - kerabatsos 3mo ago
    People put a lot of faith in human “guardrails”, standards, etc. But the same argument could be made that trusting human experts without discernment is as dangerous as trusting AI or Google or whatever other non-human source. It’s always been the case.
    - malfist 3mo ago
      On the plus side, it's not like it was blind faith. Human judgement lead me to seek out another expert when I didn't like with the current PT was suggesting I do (no practicing hip hinge movements before moving to deadlift, advising against valsava for heavy lifts, ignoring feedback that a movement was causing pain, prescribing stretches to increase flexibility in a hypermobile person). The LLM also gave me a bunch of questions to ask a new PT but I didn't have the understanding to judge the responses so I did more research. One of the things the LLM wanted me to ask about was questions about form and force closure and ideally would get a response about the oblique sling across the back. My PT didn't give me that exact response, but explained it in much more lay person terms, but because I had done my research I was able to validate their response was directionally correct. And so far, my experience with this PT has been much better. We're doing block pulls at 70% of my prior deadlift weight, next week we're going to go way back on weight and lower it some to get closer to proper deadlifting and work in some asymmetric loading exercises.