6 ms·

Any recommended starting points for LORA training llama 30B on a specific niche? Books, tutorials, videos are all appreciated. Thanks for your time!

• f_devd 3y ago
  Currently SOTA for specialization of LLMs is QLoRA: https://github.com/artidoro/qlora https://github.com/artidoro/qlora
  • ThorsBane 3y ago
    Thank you very much my friend. Be blessed in all that you do. <3