oh, hey, thanks! i wonder what was there, i like spicy comments...
I use llama.cpp mostly for working with code that i can't share with any online provider. Simple NDA stuff. Some refactors are easier to do via LLM than manually. It's a decent debugging duck too.
Read the README of the model. You'll probably find some benchmark metrics there that can tell you more-or-less how "good" the model is, but keep in mind that it's not that hard to artifically boost those scores, so…
>Yeah the mingw method on windows is a ludicrous thing to even think about Building most stuff on Windows is ludicrous, that's not something uncommon. I've chosen MSYS there as it's the easiest and least paninful way of…
If you're satisfied with ollama, I don't think there's a point to go "lower" and use llama.cpp directly. Unless you want to tinker.
Yeah, I should have mentioned that in the post because I know that not everyone likes to tinker as much as I do. I'll add a note about this site in a revision soon. However, I still find it useful to know how to do that…
I have spent unreasonable amounts of time building llama.cpp for my hardware setup (AMD GPU) on both Windows and Linux. That was one of the main reasons of writing that blog post for me. Lmao.
Hey, author of the blog post here. Check out avante.nvim if you're already a vim/nvim user, I'm using it as assistant plugin with llama-server and it works great. Small models, like Llama 3.2, Qwen and SmolLM are really…
Wow, i did not know about ccmake. I'll check it out and edit the post if it's really that easy to use, thanks.
Hey, one of the devs of Aerugo here! Thanks for feedback! You are absolutely right - at current state, this is not a safety-critical OS, however the project doesn't claim that explicitly - it's "safety-critical…
While our RTOS in fact doesn't care about it, because it's up to the user to implement the abstraction for the platform, the bigger issue is Rust support for more exotic architectures used in space - for example, SPARC…
Hello, one of the devs of Aerugo here. The rationale is rather simple - SAMV71 is used in critical applications (it has some functional safety certificates), and I have past experience of writing critical software for…
oh, hey, thanks! i wonder what was there, i like spicy comments...
I use llama.cpp mostly for working with code that i can't share with any online provider. Simple NDA stuff. Some refactors are easier to do via LLM than manually. It's a decent debugging duck too.
Read the README of the model. You'll probably find some benchmark metrics there that can tell you more-or-less how "good" the model is, but keep in mind that it's not that hard to artifically boost those scores, so…
>Yeah the mingw method on windows is a ludicrous thing to even think about Building most stuff on Windows is ludicrous, that's not something uncommon. I've chosen MSYS there as it's the easiest and least paninful way of…
If you're satisfied with ollama, I don't think there's a point to go "lower" and use llama.cpp directly. Unless you want to tinker.
Yeah, I should have mentioned that in the post because I know that not everyone likes to tinker as much as I do. I'll add a note about this site in a revision soon. However, I still find it useful to know how to do that…
I have spent unreasonable amounts of time building llama.cpp for my hardware setup (AMD GPU) on both Windows and Linux. That was one of the main reasons of writing that blog post for me. Lmao.
Hey, author of the blog post here. Check out avante.nvim if you're already a vim/nvim user, I'm using it as assistant plugin with llama-server and it works great. Small models, like Llama 3.2, Qwen and SmolLM are really…
Wow, i did not know about ccmake. I'll check it out and edit the post if it's really that easy to use, thanks.
Hey, one of the devs of Aerugo here! Thanks for feedback! You are absolutely right - at current state, this is not a safety-critical OS, however the project doesn't claim that explicitly - it's "safety-critical…
While our RTOS in fact doesn't care about it, because it's up to the user to implement the abstraction for the platform, the bigger issue is Rust support for more exotic architectures used in space - for example, SPARC…
Hello, one of the devs of Aerugo here. The rationale is rather simple - SAMV71 is used in critical applications (it has some functional safety certificates), and I have past experience of writing critical software for…