Apriel-H1: Towards Efficient Enterprise Reasoning Models (arxiv.org) 1 points by guiriduro 9mo ago ↗ HN
[–] guiriduro 9mo ago ↗ Apriel-H1-15b-Thinker-SFT uses incremental distillation from Apriel-Nemotron-15B-Thinker, selectively replacing less critical attention layers with linear Mamba blocks to reduce computational complexity while preserving reasoning quality.
1 comment
[ 3.4 ms ] story [ 12.1 ms ] thread