2 comments

[ 1.8 ms ] story [ 20.4 ms ] thread
Conjecture: Does GLM only handle the prefill stage, compress its output hidden vectors (trained?), and then send them to Qwen for decoding?