> Couldn’t someone say prototype the entire product on some lower-quality LLM and occasionally pass requests to GPT4 to validate behavior? It can be done -- it is the basis for assisted generation and related work. It…
vs code: https://marketplace.visualstudio.com/items?itemName=HuggingF... vim: https://github.com/huggingface/hfcc.nvim
A 3090 (or any GPU with >=20GB VRAM) can run StarCoder with int8 quantization at about 12 tokens per second, 33 with assisted generation -- which will come out for StarCoder in the coming days. When 4-bit quantization…
The models are on huggingface now -- https://huggingface.co/models?other=galactica
Portuguese living in Lisbon here -- I deeply agree with the parent comment. Prior to covid, it was very common to hear stories where families were to put all their savings into new mortgages to buy more AirBnBs. I also…
> Pick your 10 favorite GitHub project with more than 10k stars and see who the primary contributors are. Hugging Face transformers has >60k stars and fewer than 30 employed maintainers, many sharing other…
> Couldn’t someone say prototype the entire product on some lower-quality LLM and occasionally pass requests to GPT4 to validate behavior? It can be done -- it is the basis for assisted generation and related work. It…
vs code: https://marketplace.visualstudio.com/items?itemName=HuggingF... vim: https://github.com/huggingface/hfcc.nvim
A 3090 (or any GPU with >=20GB VRAM) can run StarCoder with int8 quantization at about 12 tokens per second, 33 with assisted generation -- which will come out for StarCoder in the coming days. When 4-bit quantization…
The models are on huggingface now -- https://huggingface.co/models?other=galactica
Portuguese living in Lisbon here -- I deeply agree with the parent comment. Prior to covid, it was very common to hear stories where families were to put all their savings into new mortgages to buy more AirBnBs. I also…
> Pick your 10 favorite GitHub project with more than 10k stars and see who the primary contributors are. Hugging Face transformers has >60k stars and fewer than 30 employed maintainers, many sharing other…