roosgit

6 ms·

1.
by roosgit 2mo ago
I was wondering the same thing. Maybe it’s a licensing issue. Or the models are too big and there isn’t enough demand. But size is not a solid argument because they also don’t support Qwen3.6 27B and 35B-A3B, especially since they just adde
2.
by roosgit 2mo ago
Amazon, the first quadrillion-dollar company.
3.
by roosgit 3mo ago
Can LoRAs be used to increase the quality of these diffusion models? Nvidia mentions something about this https://huggingface.co/nvidia/Nemotron-Labs-Diffusion-8B#inf...
4.
by roosgit 4mo ago
Yeah, it should have been "Datacenter GPUs" or "Nvidia and AMD GPUs".
5.
by roosgit 5mo ago
I just hit that error a few minutes ago. I build my llama.cpp from source because I use CUDA on Linux. So I made the mistake of trying to run Gemma4 on an older version I had and I got the same error. It’s possible brew installs an older ve
6.
by roosgit 7mo ago
Have you tried other local models? The 14B Q4_K_M needs 9GB, but Q3_K_M is 7.3GB. But you also need some room for context. Still, maybe using `--override-tensor` in llama.cpp would get you a 50% improvement over "naively" offloadi
7.
by roosgit 7mo ago
I wasn't sure where I'd seen that "retiring" spiel before, but then I remembered someone was (still is) selling a handmade jewelry website claiming $4.3M revenue and $1.3M profit.
8.
by roosgit 9mo ago
I use an even older Macbook and an even older macOS. Of course, the browsers no longer work with the latest JS, so occasionally when I need to use some webapp I boot up a Linux VM and do what I need to do. With limited RAM even that's
9.
by roosgit 9mo ago
While on the subject, you can make a calendar in as little as 3 lines of CSS: https://calendartricks.com/a-calendar-in-three-lines-of-css/
10.
by roosgit 11mo ago
Can confirm. I was trying to send the newsletter (with SES) and it didn't work. I was thinking my local boto3 was old, but I figured I should check HN just in case.
11.
by roosgit 1y ago
I have an RTX 3060 with 12GB VRAM. For simpler questions like "how do I change the modified date of a file in Linux", I use Qwen 14B Q4_K_M. It fits entirely in VRAM. If 14B doesn't answer correctly, I switch to Qwen 32B Q3_K
12.
Why would anybody start a website?(daverupert.com)
5 points by roosgit 1y ago|0 comments
13.
Effort-Outcome Asymmetry(justinjackson.ca)
2 points by roosgit 1y ago|0 comments
14.
To Infinity but Not Beyond(meyerweb.com)
45 points by roosgit 1y ago|2 comments
15.
by roosgit 1y ago
# Runs the DB backup script on Thu at 22:00 -- I download the database backup for a few websites that get new data every week. I do this in case my host bans my account. # Runs the IP change check on Mon - Sun at 09:00, 10:30, 12:00, 20:00
16.
by roosgit 2y ago
I've known about this issue since Lllama 1. Tried it with Llama 2 and Mistral when those models were released. LLMs are not databases. The test I ran was to ask the LLM about an expired domain of a doctor (obstetrician). I no longer re
17.
by roosgit 2y ago
I can answer question 3. Prompt processing (how fast your input is parsed) is highly correlated with computing speed. Inference (how fast the LLM answers) is highly correlated with memory bandwidth. So a good CPU might read your question fa
18.
by roosgit 2y ago
Renting could be a good choice to get started. I used to rent a g4dn.xlarge instance from AWS (for Stable Diffusion, not LLMs). More affordable options are Runpod and Vast.ai. I started with a local system using llama.cpp on CPU alone and f
19.
by roosgit 2y ago
Start with r/LocalLLama and r/StableDiffusion. Look for benchmarks for various GPUs. I have an RTX 3060(12GB) and 32GB RAM. Just ran Qwen2.5-14B-Instruct-Q4_K_M.gguf in llama.cpp with flash attention enabled and 8K context. I get
20.
by roosgit 2y ago
How rich? You can get some inspiration from businesses for sale on Empire Flippers https://empireflippers.com/marketplace/ . As a rule of thumb for choosing the niche, pick from one of these https://support.g
21.
by roosgit 2y ago
I have a separate PC that I access through SSH. I recently bought a GPU for it, before that I was running it on CPU alone. - B550MH motherboard - Ryzen 3 4100 CPU - 32GB (2x16) RAM cranked up to 3200MHz (prompt generation in memory bound) -
22.
Sanding UI(blog.jim-nielsen.com)
1300 points by roosgit 2y ago|400 comments
23.
by roosgit 2y ago
I've never used it, but I think Google Colab has a free plan. As another option, you can rent a machine with a decent GPU on vast.ai. An Nvidia 3090 can be rented for about $0.20/hr.
24.
by roosgit 2y ago
I think Louie Mantia was an icon designer at Apple back then https://lmnt.me/ . Maybe Sebastiaan de With as well https://sdw.space/ .
25.
by roosgit 2y ago
I use it to help me write text. Don't use any tools. I run it from the command line: ./main -f ~/Desktop/prompts/multishot/llama3-few-shot-prompt-10.txt -m ~/Desktop/models/Meta-Llama-3-8B-Instru
26.
Pure CSS Logos from CodePen(freebiesupply.com)
1 points by roosgit 2y ago|0 comments
27.
Flow Charts with CSS Anchor Positioning(coryrylan.com)
163 points by roosgit 2y ago|66 comments
28.
Opinions for Writing Good CSS(andrewwalpole.com)
2 points by roosgit 2y ago|0 comments
29.
by roosgit 2y ago
I had a similar thing happen to one of my websites. In Varnish I used something like this: if (req.http.host ~ "^(?i)(example.com|www.example.com)") { #redirect to https } else { return(synth(403, "Not allowed.")); }
30.
by roosgit 2y ago
I noticed problems with it, as well.

More ›