joaogante

7 ms·

1. 1.▲
   by joaogante 3y ago

   > Couldn’t someone say prototype the entire product on some lower-quality LLM and occasionally pass requests to GPT4 to validate behavior? It can be done -- it is the basis for assisted generation and related work. It does require full a
2. 2.▲
   by joaogante 3y ago

   vs code: https://marketplace.visualstudio.com/items?itemName=HuggingF... vim: https://github.com/huggingface/hfcc.nvim
3. 3.▲
   by joaogante 3y ago

   A 3090 (or any GPU with >=20GB VRAM) can run StarCoder with int8 quantization at about 12 tokens per second, 33 with assisted generation -- which will come out for StarCoder in the coming days. When 4-bit quantization comes out, I would
4. 4.▲
   by joaogante 4y ago

   The models are on huggingface now -- https://huggingface.co/models?other=galactica
5. 5.▲
   by joaogante 4y ago

   Portuguese living in Lisbon here -- I deeply agree with the parent comment. Prior to covid, it was very common to hear stories where families were to put all their savings into new mortgages to buy more AirBnBs. I also see a bright future i
6. 6.▲
   by joaogante 4y ago

   > Pick your 10 favorite GitHub project with more than 10k stars and see who the primary contributors are. Hugging Face transformers has >60k stars and fewer than 30 employed maintainers, many sharing other responsibilities. Arguably,