Which language models can run on a RPI: Zero?

Hi! I want to run some LM's on my pi zero for a personal project[0]. AFAIK the pi zero is 32-bit, so I don't imagine most Large LM's would work.

My use-case isn't very complex, something like BERT-base or even smaller could conceivably work.

Any model recommendations / links / advice would be appreciated.

Thanks! Extasia

[0]. The program listens to your speech and emits funny quotations at you if it thinks you're feeling sad / blue / lost.