agree
Cloudflare is playing a big game ...
I think jev points to an interesting way to fine-tune open models The goal isn’t to replace current models, it’s to train a model for a specific domain so it can handle multiple-choice and yes/no questions quickly,…
CI stands for Continuous Idling ....
Same boat, Mac mini M4 Pro 64GB. 25 tps is a bit slow for interactive coding. Any tricks that helped (quant, MLX vs llama.cpp, context size, thinking level)?
Looks free… until the bill hits.
[dead]
[flagged]
agree
Cloudflare is playing a big game ...
I think jev points to an interesting way to fine-tune open models The goal isn’t to replace current models, it’s to train a model for a specific domain so it can handle multiple-choice and yes/no questions quickly,…
CI stands for Continuous Idling ....
Same boat, Mac mini M4 Pro 64GB. 25 tps is a bit slow for interactive coding. Any tricks that helped (quant, MLX vs llama.cpp, context size, thinking level)?
Looks free… until the bill hits.
[dead]
[flagged]