It's easier. Setting up a docker container[0] that replicates OpenAI's endpoints is faster than making an account from scratch with payment processing included.
Plus, I don't really trust OpenAI's data policies. Running the model locally gives me the option to airgap my inferencing machine if-needed, something OpenAI won't have until they offer on-prem.
5 comments
[ 3.4 ms ] story [ 12.4 ms ] threadPlus, I don't really trust OpenAI's data policies. Running the model locally gives me the option to airgap my inferencing machine if-needed, something OpenAI won't have until they offer on-prem.
[0] https://github.com/go-skynet/LocalAI