Ask HN: An Offline ChatGPT Alternative?

2 comments

[ 2.6 ms ] story [ 15.8 ms ] thread

Been asked here before, but this was interesting:

You can see here the most downloaded models from the Hugging Face transformers hub: https://huggingface.co/spaces/huggingface/transformers-stats

If I'm not mistaken these will be some of the best sota language models to try:

- Flan-T5

- OPT

- Distilbert

- GPT-J

Look into PEFT to fit finetuning on a consumer-grade device. You'll have to roll your own RLHF though.. :)