> hybrid Mamba/Gated linear attention layers, Do any large-scale architectures use mamba? I was under the impression that people don't use it yet due to lack of efficient implementations. > Training is also vastly more…
When sampling from an LLM people normally truncate the token probability distribution so that low-probability tokens are never sampled. So the model shouldn't produce really weird outputs even if they technically have…
> Generative models are probabilistic: the output will be less likely to satisfy complex requirements, particularly This is a misinformed 'critique' which always gets on my nerves, as someone who actually works with AI.…
My university made us learn to code 'close to the metal' and IMO this is a great way to gain an understanding of what is actually going on. Program in C, no IDE, no AI tools. The AI tools are incredibly helpful (and…
> hybrid Mamba/Gated linear attention layers, Do any large-scale architectures use mamba? I was under the impression that people don't use it yet due to lack of efficient implementations. > Training is also vastly more…
When sampling from an LLM people normally truncate the token probability distribution so that low-probability tokens are never sampled. So the model shouldn't produce really weird outputs even if they technically have…
> Generative models are probabilistic: the output will be less likely to satisfy complex requirements, particularly This is a misinformed 'critique' which always gets on my nerves, as someone who actually works with AI.…
My university made us learn to code 'close to the metal' and IMO this is a great way to gain an understanding of what is actually going on. Program in C, no IDE, no AI tools. The AI tools are incredibly helpful (and…