5 ms·
How did you get CrewAI working with Llama3? I have got it working by adding "num_predict=128" to the model ChatOllama(), but it's so slow! Any tricks or tips?
by sveinek 2y ago
How did you get CrewAI working with Llama3? I have got it working by adding "num_predict=128" to the model ChatOllama(), but it's so slow! Any tricks or tips?
- mtrofficus 2y agohey! I've started a repository here: https://github.com/neural-maze/crewai_llama3_arduino https://github.com/neural-maze/crewai_llama3_arduino I'll be refactoring it during this week and then I'll create an article in my blog and a video in my Youtube channel talking about it, in case you are interested :) https://www.youtube.com/channel/UCaixkLsW_TWWe_0yZNmvPaw https://www.youtube.com/channel/UCaixkLsW_TWWe_0yZNmvPaw https://neural-maze.github.io/blog/ https://neural-maze.github.io/blog/
- sveinek 2y agoThank you for sharing, absolutely interested!