Microsoft releases a new open-weight model that tops the MTEB leaderboard for the largest model (27b), but also includes smaller models that are top of their respect "weight" classes (hah!) -- 0.6b (embedding size 1024) and 270m (embedding size 640).
All have best-in-class context length, and the numbers look very impressive. Very excited to see this release!
2 comments
[ 3.2 ms ] story [ 17.5 ms ] threadAll have best-in-class context length, and the numbers look very impressive. Very excited to see this release!