Whisper.CPP + llama.CPP = what you want??
Even deepseek r1 (70b) still flubs things ... Maybe if I try 640b but yeah I don't have the ram...
Tried that ... But competently writing rust is just not a priority for the llms I chat with
Not to be a doubter in llms being powerful ... Just that every time I try them ... They just don't do what I want....
Because a llm != a generally Intelligent mind... Whilst they are a massive Step forward ... We still have a long way to go for that... Why not try it yourself with ollama a large model and some rented hardware ... You…
Uhhhhh IIRC rust uses llvm under the hood so ... Change the back end and you are good?
Use mosh??
There is redox os
Whisper.CPP + llama.CPP = what you want??
Even deepseek r1 (70b) still flubs things ... Maybe if I try 640b but yeah I don't have the ram...
Tried that ... But competently writing rust is just not a priority for the llms I chat with
Not to be a doubter in llms being powerful ... Just that every time I try them ... They just don't do what I want....
Because a llm != a generally Intelligent mind... Whilst they are a massive Step forward ... We still have a long way to go for that... Why not try it yourself with ollama a large model and some rented hardware ... You…
Uhhhhh IIRC rust uses llvm under the hood so ... Change the back end and you are good?
Use mosh??
There is redox os