6 ms·
Cool! Can webLLM handle inference of models with any meaningful size? Can I ask what model is used?
by skottenborg 3y ago
Cool! Can webLLM handle inference of models with any meaningful size?
Can I ask what model is used?
- hmdai 3y agoThanks! It's using Llama 2 7B, It supports bigger models but those take longer to download and also infer (if run at all depending on the device)