RWKV-8 ROSA – An attention-free neurosymbolic LLM (twitter.com)

"enabling LLMs to invent their own inner monologue languages"

They will become an even deeper black box?