Ask HN: If you work at an enterprise, do you use Open Source LLM or GPT?

2 points by datacog ↗ HN
Question behind the question. I'm building a startup which offers "AI Compute Box", essentially Hardware loaded with a fine-tuned LLM model which will be deployed to enterprises. I am looking to understand whether (a) enterprises install models on their own rack, (b) deploy on AWS/Azure cloud, (c) use private instances offered by offered by AWS or Azure

2 comments

[ 2.8 ms ] story [ 9.5 ms ] thread
Due to privacy issues, I would as a company only ever use a finetuned LLM.
thanks for your response. would this be an open source fine-tuned?