"Censored" and "Uncensored" is kind of a red herring these days. There are like 1000 finetunes on huggingface that will have unspeakable conversations with you. New ones come out literally every day.
A few need a little poking in the prompt, that is all. Even base models like Llama and Mistral are basically unfiltered.
You can take a look at what others are hosting on the Horde for ideas/trends, as well as looking at communities like /r/localllama: https://lite.koboldai.net/
I wish they'd state the disk size of the models. Even the ones on GitHub don't have their file sizes listed, so you just have to cross your fingers and hope you have room.
5 comments
[ 3.4 ms ] story [ 24.6 ms ] threadDo you mind sharing a link to it?
A few need a little poking in the prompt, that is all. Even base models like Llama and Mistral are basically unfiltered.
OpenHermes is popular one now: https://huggingface.co/teknium/OpenHermes-2.5-Mistral-7B
You can take a look at what others are hosting on the Horde for ideas/trends, as well as looking at communities like /r/localllama: https://lite.koboldai.net/
Personally, I am running Yi-34B-200K with an alpaca lora because its brand new, it fits on my GPU and it has a huge context size: https://huggingface.co/LoneStriker/Yi-34B-200K-4.0bpw-h6-exl...