SteelPh0enix

4 ms·

1.
by SteelPh0enix 2y ago
oh, hey, thanks! i wonder what was there, i like spicy comments...
2.
by SteelPh0enix 2y ago
I use llama.cpp mostly for working with code that i can't share with any online provider. Simple NDA stuff. Some refactors are easier to do via LLM than manually. It's a decent debugging duck too.
3.
by SteelPh0enix 2y ago
Read the README of the model. You'll probably find some benchmark metrics there that can tell you more-or-less how "good" the model is, but keep in mind that it's not that hard to artifically boost those scores, so don&#
4.
by SteelPh0enix 2y ago
>Yeah the mingw method on windows is a ludicrous thing to even think about Building most stuff on Windows is ludicrous, that's not something uncommon. I've chosen MSYS there as it's the easiest and least paninful way of in
5.
by SteelPh0enix 2y ago
If you're satisfied with ollama, I don't think there's a point to go "lower" and use llama.cpp directly. Unless you want to tinker.
6.
by SteelPh0enix 2y ago
Yeah, I should have mentioned that in the post because I know that not everyone likes to tinker as much as I do. I'll add a note about this site in a revision soon. However, I still find it useful to know how to do that manually.
7.
by SteelPh0enix 2y ago
I have spent unreasonable amounts of time building llama.cpp for my hardware setup (AMD GPU) on both Windows and Linux. That was one of the main reasons of writing that blog post for me. Lmao.
8.
by SteelPh0enix 2y ago
Hey, author of the blog post here. Check out avante.nvim if you're already a vim/nvim user, I'm using it as assistant plugin with llama-server and it works great. Small models, like Llama 3.2, Qwen and SmolLM are really good
9.
by SteelPh0enix 2y ago
Wow, i did not know about ccmake. I'll check it out and edit the post if it's really that easy to use, thanks.
10.
by SteelPh0enix 3y ago
Hey, one of the devs of Aerugo here! Thanks for feedback! You are absolutely right - at current state, this is not a safety-critical OS, however the project doesn't claim that explicitly - it's "safety-critical applications
11.
by SteelPh0enix 3y ago
While our RTOS in fact doesn't care about it, because it's up to the user to implement the abstraction for the platform, the bigger issue is Rust support for more exotic architectures used in space - for example, SPARC (LEON3), wh
12.
by SteelPh0enix 3y ago
Hello, one of the devs of Aerugo here. The rationale is rather simple - SAMV71 is used in critical applications (it has some functional safety certificates), and I have past experience of writing critical software for it at N7.