Many assumptions, like just assuming our electricity comes from a fossil fuel source. Mine does not. Nuclear and Hydro in majority. Therefore 0 emissions regardless of model.
I guess they only tested 70B or 8B? Nothing in between?
Who even runs 70B anyway? Your common option of 2 gpus of 16GB each slots you into 32B nicely.
2 comments
[ 3.7 ms ] story [ 20.8 ms ] threadUnrelated, but amusing.
I guess they only tested 70B or 8B? Nothing in between?
Who even runs 70B anyway? Your common option of 2 gpus of 16GB each slots you into 32B nicely.
Llama 3.3 70B is suspiciously low.