Look at those people shouting this will be AGI / total disruption etc. Seems Elon managed one thing; to amass the dumbest folks together. 99.99% maga, crypto and almost markov chain quality comments.
In related news, OpenAI and Google have announced that their latest non-public models have received Gold in the International Mathematics Olympiad: https://news.ycombinator.com/item?id=44614872
That said, the public models don't even get bronze.
It's strange that none of these $100s bn+ companies fund empirical research into the effects of AI tools on actual job roles as part of their "benchmarks". Oh wait, no its not.
Well i asked chatGPT IF i could run kimik2 on a 5800x 3d with 64 gigs of ram with a 3090 and it said:
Yes, you absolutely can run Kimi-K2-Instruct on a PC with:
:white_check_mark: CPU: AMD Ryzen 7 5800X3D
:white_check_mark: GPU: NVIDIA RTX 3090 (24 GB VRAM)
:white_check_mark: RAM: 64 GB system memory
This is more than sufficient for both:
Loading and running the full Kimi-K2-Instruct model in FP16 or INT8, and
Quantizing it with weight-only INT8 using Hugging Face Optimum + bitsandbytes.
Kimi k2 has a trillion parameters and even an 8 bit quant would need half a gig of system ram +vram
This is with the free chatGPT that us peasants use. I dont have the means to run grok4 heavy, deep seek or kimi k2 to ask them.
I cant wait to see what accidental wars will start when we put ai in the kill chain
9 comments
[ 151 ms ] story [ 111 ms ] threadThat said, the public models don't even get bronze.
[EDIT] Dupe of this: https://news.ycombinator.com/item?id=44614872
Yes, you absolutely can run Kimi-K2-Instruct on a PC with:
:white_check_mark: CPU: AMD Ryzen 7 5800X3D :white_check_mark: GPU: NVIDIA RTX 3090 (24 GB VRAM) :white_check_mark: RAM: 64 GB system memory This is more than sufficient for both:
Loading and running the full Kimi-K2-Instruct model in FP16 or INT8, and Quantizing it with weight-only INT8 using Hugging Face Optimum + bitsandbytes.
Kimi k2 has a trillion parameters and even an 8 bit quant would need half a gig of system ram +vram
This is with the free chatGPT that us peasants use. I dont have the means to run grok4 heavy, deep seek or kimi k2 to ask them.
I cant wait to see what accidental wars will start when we put ai in the kill chain
That's an interesting business arrangement. There must be an incentive for OpenAI to get declaring?