Ask HN: Hosted LLMs to process personal data?
There are some good use cases for LLMs to process personal data (think paperless-ngx document scanning or semantic search for personal photos). However, this data should never be saved for future training as it's highly sensitive.
It's not always convenient to self-host LLMs as you'd need a beefy and costly GPU.
What's the best way to have access to good models with the guarantee that your datw won't be touched? AWS Bedrock? Self-host on an EC2 instance? Huggingface Pro?
0 comments
[ 4.0 ms ] story [ 11.9 ms ] threadNo comments yet.