Ask HN: Hosted LLMs to process personal data?

1 points by yboulkaid ↗ HN
There are some good use cases for LLMs to process personal data (think paperless-ngx document scanning or semantic search for personal photos). However, this data should never be saved for future training as it's highly sensitive.

It's not always convenient to self-host LLMs as you'd need a beefy and costly GPU.

What's the best way to have access to good models with the guarantee that your datw won't be touched? AWS Bedrock? Self-host on an EC2 instance? Huggingface Pro?

0 comments

[ 4.0 ms ] story [ 11.9 ms ] thread

No comments yet.