I've been experimenting recently with replacing Github Copilot with one of the open source and open weight alternatives. This post goes over how to set these up!
Actually self-hosting without using the cloud at all involves building a multi-gpu rig.
NIMs are just to try out the concept.
Honestly, doing it this way is still a bit more secure than using OpenAI or Anthropic directly because its a slight guard against your code being used in future training sets for the next iteration of their AI.
I've been trying to figure out how to change the color in my Hugo based static site generator, but its damn near impossible to locate the appropriate CSS
12 comments
[ 2.5 ms ] story [ 45.4 ms ] threadNIMs are just to try out the concept.
Honestly, doing it this way is still a bit more secure than using OpenAI or Anthropic directly because its a slight guard against your code being used in future training sets for the next iteration of their AI.
The first is the companies that are concerned about their IP (but comfortable enough using a cloud provider).
Then there's a smaller group of folks who don't want to train the next iteration of the product.