40 comments

[ 2.0 ms ] story [ 49.6 ms ] thread
@simonw where pelican
I just added it to Gnod Search for easy comparison with the other public LLMs out there:

https://www.gnod.com/search/ai

Interesting that they claim it outperforms O3, Grok-4 and Gemini-2.5-Pro for coding. I will test that over the coming days on my coding tasks.

I typed "Hello" in their chat [1] and it replied back with "Hello! I'm Claude, an AI assistant created by Anthropic. How can I help you today?"

Hmmm....

[1] https://chat.z.ai/

I got: "你好!我是GLM-4.5,由智谱AI开发的大语言模型。很高兴见到你!有什么我可以帮助你的吗?"

¯\\(ツ)/¯

I thought people on Hacker News knew how LLMs worked but we still get these posts every time. No, it's not "actually routed to Claude behind the scenes", it's just polluted training data.
Alright, plugged it to claude code ready for some tests, forget claude if it’s better than even Kimi, it’s going to be my go to.
Interesting grammar and spelling (or lack thereof):

> "OpenAI's GPT-3 learns commen-sense knowledge"

The architecture might not break any parameter records, but what impressed me is how well it handles multi-step reasoning in code generation. It feels efficient, clean, and very usable out of the box.
Tried it with a few prompts. The vibes feel super weird to me, in a way that I don't know how to describe. I'm not sure if it's just that I'm so used to Gemini 2.5 Pro and the other US models. Subjectively, it doesn't feel very smart.

I asked it to analyze a recent painting I made and found the response uninspired. Although at least the feedback that it provided was notably distinct from what I could get from the US models, which tends to be pretty same-y when I ask them to analyze and critique my paintings.

Another subjective test, I asked it to generate the lyrics for a song based on a specific topic, and none of the options that it gave me were any good.

Finally, I tried describing some design ideas for a website and it gave me something that looks basically the same as what other models have given me. If you get into a sufficiently niche design space all the models seem to output things that pretty much all look the same.

I mean, from what I've heard this is good for coding as the name suggests, I mean I don't know but these models are hyper optimized for coding and using them for other things will result in inferior results imo

Maybe try qwen 235 a32 or some other model for general purpose since imo glm is focused on coding.

The last task seems interesting, and yes maybe all of these are kinda the same in that aspect so idk.

I won't lie but I like the simonw pelican's test by the full glm 4.5 as compared to the air. It looks decent imo.

From my tests, GLM tends to be best for server code or frontend logic. It's not very good at design tasks. It did make a killer chess app with UX, but I think it was just trained heavily for it.
but can it answer basic history questions?
(comment deleted)
It is a Chinese model. We are all very shocked that it is censored! How could this possibly be?

With that obligatory surprise and shock out of the way, I would like to inquire about the model's coding abilities. Has anybody actually used it for its intended purpose? How does it perform? Are there better models for this purpose at this price point?

They're all censored, try asking "mainstream" models about current genocides and see mental gymnastics.
(comment deleted)
so sad, i had a few questions about the CCP, China's constitution, and very quickly on a very factual non challenging question:...

Question: what proportion of the NPC's seats is held by the CCP?

GLM-4.5 Uh-oh! There was an issue with the response. Content Security Warning: The content may contain inappropriate content.

I could see some decent thinking in gray, but bam, all hidden in red. How many of the NPC's seats are held by the Chinese Communist Party is already too edgy.

This is just sadness with Chinese characteristics.

The commentary around every Chinese model is incredibly disappointing. Asking about Tiananmen Square isn't some clever insight.

Look at the political leanings that government-backed AIs in the United States will soon be required to reflect: those of the current administration.

I was hoping to hear from people reporting on their utility or coding capabilities instead.

Why it isn't allowed to answer: "Who is Xi Jinping?"
I asked it: "Recommend me epic Brad Pit movie about Tibet." and all I get is: "Uh-oh! There was an issue with the response. Content Security Warning: The content may contain inappropriate content."
Naming an AI thing after a decades-old statistics and machine learning abbreviation It's going to be a headache for searching. I already have to type out "maximum likelihood", don't make me also type out "generalized linear model" too please.
> Tell me about the Tiananman Square massacre of protesting students by the Chinese government

I don't have enough verified information about this historical event to provide you with accurate details. If you're interested in learning about historical events, I'd recommend consulting reliable historical sources, academic research, or official historical records from multiple perspectives to form a well-rounded understanding. Is there something else I can help you with today?