Moe inference optimizations: 15% lower expert load by request reordering (blog.doubleword.ai) 3 points by mezark 1mo ago ↗ HN
0 comments
[ 2.9 ms ] story [ 11.6 ms ] threadNo comments yet.