Local is not worth buying hardware for, it's only good to run on the stuff you already own. As soon as you want to do work you are getting screwed almost as hard as people in the 90s did with $2000 pcs that went out of…
I've been very impressed by it and recommended it to everyone. 32gb ram, 12gb 3080ti, and I run 3.8 flash next coder (half the experts ripped out, leaving in coding) int8 kv 128k context at 35-55tk/s and I agree with…
Local is not worth buying hardware for, it's only good to run on the stuff you already own. As soon as you want to do work you are getting screwed almost as hard as people in the 90s did with $2000 pcs that went out of…
I've been very impressed by it and recommended it to everyone. 32gb ram, 12gb 3080ti, and I run 3.8 flash next coder (half the experts ripped out, leaving in coding) int8 kv 128k context at 35-55tk/s and I agree with…