Suggest a low-end hosting provider with GPU

6 points by backend-dev-33 ↗ HN
I want to do zero-shot text classification with this model [1] or with something similar (Size of the model: 711 MB "model.safetensors" file, 1.42 GB "model.onnx" file ) It works on my dev machine with 4GB GPU. Probably will work on 2GB GPU too.

Is there some hosting provider for this?

My app is doing batch processing, so I will need access to this model few times per day. Something like this: start processing do some text classification stop processing Imagine I will do this procedure... 3 times per day. I don't need this model the rest of the time. Probably can start/stop some machine per API to save costs...

[1] https://huggingface.co/MoritzLaurer/roberta-large-zeroshot-v2.0-c

1 comment

[ 3.1 ms ] story [ 14.9 ms ] thread