Won’t this change though? > the present problem of reward hacking can be solved only by rigorous specification by domain experts. the time of domain experts is

Won’t this change though? > the present problem of reward hacking can be solved only by rigorous specification by domain experts. the time of domain experts is expensive. rigorous specification is itself a skill, demanding its own expertise outside of a given problem domain. even many skilled software engineers are bad at it. for the vast majority of domains, the intersection of domain experts and specification experts is ludicrously small.