[–] iAkashPaul 2y ago ↗ I've quantised 2B & 7B Instruct models here https://huggingface.co/iAkashPaul/gemma-2b-it-gguf & https://huggingface.co/iAkashPaul/gemma-7b-it-gguf
[–] yogorenapan 2y ago ↗ How does this compare to Mixtral (especially the Dolphin and Orca fine tunes)? [–] not_really 2y ago ↗ Not great, even when compared to Mistral 7b
[–] ecmascript 2y ago ↗ I'm assuming it won't run on my GPU though since I am a white man [–] badrabbit 2y ago ↗ No, it is because you are too smart. [–] shapefrog 2y ago ↗ I'm ok, I self identify as a black woman. [–] [deleted] 2y ago ↗ (comment deleted)
7 comments
[ 2.5 ms ] story [ 17.0 ms ] thread