LeBit

5 ms·

61.
by LeBit 1mo ago
https://xcancel.com/Alibaba_Qwen/status/2088280182356611304
62.
by LeBit 1mo ago
You shouldn’t have a Markdown document with 2 level 1 headings.
63.
by LeBit 1mo ago
Until hiding PII from the cloud LLM is a resolved issue, running local LLMs will remain a necessity. There are workplaces that refuse to use LLMs because they fear the devs will expose sensitive data without care.
64.
by LeBit 1mo ago
This guy knows speakers. I have a pair of Magneplanar speakers. They always impress people.
65.
by LeBit 1mo ago
I guess the reasons are that I feel (no data to back this up) that having a Python runtime available is much more probable than having a nodejs runtime around. I was going to say you cannot easily distribute a nodejs based CLI app, but that
66.
by LeBit 1mo ago
I always thought nodejs was a weird choice for CLI tools. For web stuff, sure. But for CLI, it never made sense to me. Especially when Python and Go exist.
67.
by LeBit 1mo ago
You could answer your own question really, really quickly.
68.
by LeBit 1mo ago
Same. Used the 12B, 26B A4B and 31B. No issues with llama.cpp.
69.
by LeBit 1mo ago
Thank you for what you are doing.
70.
by LeBit 1mo ago
The multiple accounts, the fanatcism. It’s… weird.
71.
by LeBit 1mo ago
The good thing is that there seems to be quite a lot. Let’s just wait a bit for this one.
72.
by LeBit 1mo ago
I refuse to use that product because of the parent company.
73.
by LeBit 1mo ago
Ollama is not competitive.
74.
by LeBit 1mo ago
This is a really bizarre thread. If you think Ollama is better, use it! People who have used them all converge on llama.cpp. You don’t have to.
75.
by LeBit 1mo ago
You are talking about leaving "everything" to the parents. Those are extreme positions. There are things where you want the government to intervene. There are things where you don’t want the government to intervene. What I do in m
76.
by LeBit 1mo ago
The whitelist managed by the government is not a bad idea. I’ve been thinking how to turn the table so that you could allow only certain parties to reach you if you allowed them to (say you are waiting for a call from the auto repair shop).
77.
by LeBit 1mo ago
You are being facetious.
78.
by LeBit 1mo ago
Because when you position yourself saying "people were hysterical", you indirectly categorize yourself as an expert.
79.
by LeBit 1mo ago
Thanks for the link to llama-swap. Didn’t know about it and will definitely install it.
80.
by LeBit 1mo ago
When that article was first published , I started looking into llama.cpp. With the help of an LLM I researched the knobs to turn that made most sense. Things went from "local models are useless unless you have a 512GB GPU I guess"
81.
by LeBit 1mo ago
I guess the client is American.
82.
by LeBit 1mo ago
Depending on the configuration, bubblewrap can substantially reduce the attack surface. It doesn’t change the fact a malicious process is still attacking the same kernel , but it can reduce what it can do to that vm.
83.
by LeBit 1mo ago
It uses fractal compression
84.
by LeBit 1mo ago
nono. Also fnox now does credentials proxying.
85.
by LeBit 1mo ago
You should research bubblewrap and nono.
86.
by LeBit 1mo ago
When the host is a Mac or window , docker always run in a VM anyway. On Linux, you can run docker directly on the host, but you can also very easily setup a vm with incus and run docker from there.
87.
by LeBit 1mo ago
What if you use tools like bubblewrap or nono inside the container? Say I want to use pi inside a container. If I wrap pi within a bubblewrap or within nono, how is that less secure than using a vm? Also, I think most people run containers
88.
by LeBit 1mo ago
Why do you say that? Eg, if used with Colima in macOS, it means I can run a devcontainer in an isolated VM and Nono inside the devcontainer can restrict a lot what can and cannot be done. You get credentials proxying and network outbound li
89.
by LeBit 1mo ago
I always find it confusing that a meaningful volume of the comments are saying "this reached parity with SOTA models. Best $/task." And a meaningful chunk of the comments are saying "this piece of garbage isn’t even at t
90.
by LeBit 1mo ago
J’utilise également une trackball à gauche de mon clavier à cause de douleurs à mon épaule droite. L’avantage de Lafayette est que toutes les touches sont dans les deux blocs 3x5 du clavier. C’est plus ergonomique, la gestion des accents es

More ›