For getting a flavor of training LLMs without needing to be at one of the pre-training companies, it's very accessible to fine-tune a relatively small open sour

For getting a flavor of training LLMs without needing to be at one of the pre-training companies, it's very accessible to fine-tune a relatively small open source LLM such as Mistral 7B. (There are many tutorials.)