You can try Mixtral live at https://app.fireworks.ai/ (soon to be faster too) Warning: the implementation might be off as there's no official one. We at Fireworks tried to reverse-engineer model architecture today with…
In this experimental release with prebuilt binaries it’s about 5Mb per architecture. This includes all operators for inference (that is forward only). We’re working on selective compilation so that you can build a…
The recurrent network work is under way - we are revisiting the designs to consciously balance between performance and API niceness. We'll share more tech details in the upcoming days. Right now, this is an example RNN:…
Right now we're training models in server-side environment and run highly optimized inference on pre-trained model in products (with focus on inference optimization). The framework itself allows fine-tuning and training…
You can try Mixtral live at https://app.fireworks.ai/ (soon to be faster too) Warning: the implementation might be off as there's no official one. We at Fireworks tried to reverse-engineer model architecture today with…
In this experimental release with prebuilt binaries it’s about 5Mb per architecture. This includes all operators for inference (that is forward only). We’re working on selective compilation so that you can build a…
The recurrent network work is under way - we are revisiting the designs to consciously balance between performance and API niceness. We'll share more tech details in the upcoming days. Right now, this is an example RNN:…
Right now we're training models in server-side environment and run highly optimized inference on pre-trained model in products (with focus on inference optimization). The framework itself allows fine-tuning and training…