atharv_jaju
No user record in our sample, but atharv_jaju has activity below (stories or comments). Likely we have partial data — the full bulk-load will fill profiles in.
No user record in our sample, but atharv_jaju has activity below (stories or comments). Likely we have partial data — the full bulk-load will fill profiles in.
I have 8GB RAM. So I am able to run 7B 4bit at maximum. I used GGUF + llama.cpp. Will try out Ollama. Thanks for the info!
Oh my bad, I meant how to code it?
What is the best performing Codellama model on a Macbook with M1 chip? Will Gguf 7Bn 4bit quantized model be good to run locally on the Mac?
How do you count tokens per second?