Whereas this is interesting with the (mac) models available today, it'll be a lot more interesting when the 512GB variety launches in October.
I wouldn't be surprised if there were (llm) models tuned specifically for this size of memory, MOE of course, the Mac doesn't do the dense variety very well. Still, there's a lot that can be done with MOE.
1 comment
[ 0.24 ms ] story [ 6.4 ms ] threadI wouldn't be surprised if there were (llm) models tuned specifically for this size of memory, MOE of course, the Mac doesn't do the dense variety very well. Still, there's a lot that can be done with MOE.