1 comment

[ 0.24 ms ] story [ 5.7 ms ] thread
Have you tried any vision tasks with this model? We've been serving these on our gateway [1], and the quants are quite terrible for vision. Curious to hear your experience.

[1] https://www.vlm.run/gateway