More training data and token lengths seem to help, given how GPT-4 scores better on a lot of standardized tests than 3 and 3.5 do. We don’t necessarily need to

More training data and token lengths seem to help, given how GPT-4 scores better on a lot of standardized tests than 3 and 3.5 do. We don’t necessarily need to teach it not to lie, but just to improve accuracy through better training and training data. It (probably) won’t ever be 100% reliable, but what is? Google searches can be inaccurate, same with Wikipedia and other encyclopedias.