Given that DeepSwe is one of the very few coding benchmarks worth taking a look at, this achieves rather excellent result at it (not far from opus 4.8).
From looking at the results and my own impression of 5.1 and other models, I think this is the best Chinese coding model by some non-insignificant margin.
Zhipu AI is founded by a superstar Tsinghua professor, did an IPO in January (Hong Kong stock exchange) hired half it's past research lab and it's stock is >10x since. This is not a "just distill Claude" thing.
8 comments
[ 4.2 ms ] story [ 23.4 ms ] threadFrom looking at the results and my own impression of 5.1 and other models, I think this is the best Chinese coding model by some non-insignificant margin.
And previously: https://news.ycombinator.com/item?id=48518684