[–] brucethemoose2 3y ago ↗ There is even some untapped headroom, as they quantized to Q4 instead of using K-quant.Not to speak of the potential hooked up to a vector db, swapping out LORAs for different languages and such.
1 comment
[ 3.6 ms ] story [ 9.8 ms ] threadNot to speak of the potential hooked up to a vector db, swapping out LORAs for different languages and such.