OK, I appreciate your excitement and the work you've done here. Also; when presenting a benchmark it -needs- to be done as a comparative measure, i.e. how are those numbers on a vanilla 9b, let alone decent quant of 3.6-35b-a3b? What have you achieved here?
8 comments
[ 3.3 ms ] story [ 28.9 ms ] threadhttps://web.archive.org/web/20260629115602/https://haghiri75...