6 ms·
how does one finetune llama (or any other LLM) using mistral? is the flow like this? - take small dataset - generate bigger dataset using mistral (how this i
by itomatik 3y ago
how does one finetune llama (or any other LLM) using mistral?
is the flow like this?
- take small dataset
- generate bigger dataset using mistral (how this is this done?)
- run LoRA to fine tune gemma extended dataset.
- itomatik 3y agoI should have said "run LoRA or your favorite fine-tuning technique to produce your fine-tuned llama."