6 ms·

What makes people think companies like OpenAI can't just pay experts for verified true data? Why do all these "gotcha" replies always revolve around the idea th

• aprilthird2021 2y ago
  Because paying experts for verified true data in the quantities they need isn't possible. Ilya himself said we've reached peak data (https://www.theverge.com/2024/12/13/24320811/what-ilya-sutskever-sees-openai-model-data-training https://www.theverge.com/2024/12/13/24320811/what-ilya-sutsk...). Why do you think we are stupid? We work at places developing these models and have a peek into how they're built...
• nyrikki 2y ago
  You see a rowboat, and you need to cross the river. Ask a dozen experts to decide what that boat needs to fit your need. That is the specification problem, add on the frame problem and it becomes intractable. Add in domain specific terms and conflicts and it becomes even more difficult. Any nontrivial semantic properties, those without a clear T/F are undecidable. OpenAI with have to do what they can, but it is not trivial or solvable. It doesn't matter how smart they are, generalized solutions are hard.