How did you get CrewAI working with Llama3? I have got it working by adding "num_predict=128" to the model ChatOllama(), but it's so slow! Any tricks or tips?
I'll be refactoring it during this week and then I'll create an article in my blog and a video in my Youtube channel talking about it, in case you are interested :)
3 comments
[ 5.9 ms ] story [ 30.8 ms ] threadI'll be refactoring it during this week and then I'll create an article in my blog and a video in my Youtube channel talking about it, in case you are interested :)
https://www.youtube.com/channel/UCaixkLsW_TWWe_0yZNmvPaw
https://neural-maze.github.io/blog/