1 comment

[ 2.4 ms ] story [ 10.7 ms ] thread
I wonder why Apple haven’t looked at something like a branded and seamless p2p inference option for customers that have other Apple gear? Pretty sure there are a few open source options that do this now. vLLM and LocalAI.io