1 comment

[ 0.40 ms ] story [ 13.3 ms ] thread
I haven't seen this GPU mentioned on HN. 24GB DDR6 @ ~$500 USD. Can we finally stop buying used RTX3090s if we wanna run LLMs at home at a reasonable price?

Any Chinese HN members able/willing to benchmark one of these with some open models and share the results?