lvwerra

8 ms·

1. 1.▲
   by lvwerra 3y ago

   One of the authors here :) A note on model performance: indeed, the model is not great (yet) at many of the tasks. We released it mostly as part of a tutorial on RLHF to show case how to do the whole training loop and also because it often
2. 2.▲
   BigCode: Training LLMs for code in collaborative and responsible way(bigcode-project.org)

   2 points by lvwerra 4y ago|0 comments
3. 3.▲
   by lvwerra 5y ago

   We are releasing CodeParrot - my first project at Hugging Face! What is it? It is a code base to build large language models for code generation from scratch. It includes the code to clean up GitHub scale datasets, train GPT-2 style models
4. 4.▲
   CodeParrot: Train and evaluate your own CoPilot model(huggingface.co)

   2 points by lvwerra 5y ago|1 comments