[–] brucethemoose2 2y ago ↗ It seems to perform best with 16K context, but works well with up to 32K context.This is interesting, especially coming from Amazon, as vanilla Mistral-Instruct is much better than llamav2 7B, and extremely fast on modest hardware.
1 comment
[ 2.9 ms ] story [ 14.5 ms ] threadThis is interesting, especially coming from Amazon, as vanilla Mistral-Instruct is much better than llamav2 7B, and extremely fast on modest hardware.