clusterhacks

5 ms·

1.
by clusterhacks 1mo ago
Running locally for me is mainly about learning, maintaining control+privacy, and helping shift my coding+design process to leverage LLMs. I guess if you made me boil it down to a single word to justify the cost I would just say: tuition. S
2.
by clusterhacks 2mo ago
On the one hand, sure, why not have a default install throw a bunch of bells+whistles via skills and extensions. But I like pi precisely because it is so minimal. I want understand and work around the simplest possible agentic coding setup,
3.
by clusterhacks 3mo ago
This may be too naive, but I created a user on my linux box who doesn't have very many permissions. Then I sudo to that user, use firejail to start pi in a dev project directory, and let it have at it. My projects are usually very limi
4.
by clusterhacks 3mo ago
FTA's conclusion: "Is this decline a distinct change from the recent behavior of the labor share in the U.S.? Along the two key dimensions we investigate, our answer is no. <later> ... and they provide little evidence that i
5.
by clusterhacks 3mo ago
Huh. Same problem, and I run with llama.cpp. In my case, Gemma4-31B (4-bit quant though) will just stop sometimes.
6.
by clusterhacks 3mo ago
Gotcha. I'm past the point of having any confident thoughts about what happens to their share price at IPO. What about the idea that there is a high likelihood that the potential share price for OpenAI and Anthropic are both going to b
7.
by clusterhacks 3mo ago
I used to agree with you but now do not. I now think the floor for this market is probably no worse than the annual revenue of cell phone plans in the US market. So say, $250 billion. Now, that probably doesn't justify the valuations a
8.
by clusterhacks 4mo ago
--what this means for the valuation of the AI companies Probably nothing. Most users have no idea what an LLM is or how it runs. Anecdotally speaking, I see many LLM users default to whatever their day job provides to them. And even slightl
9.
by clusterhacks 5mo ago
Appreciate the anecdote and your other comments on HN. But I strongly suspect you are incredibly atypical based on your background and previous work experience in ways that would tremendously down weight the probability that any part of you
10.
by clusterhacks 5mo ago
Check out the Taulbee survey results: "In 2023–24, Bachelor’s degree production fell 5.5% compared to the previous year across CS, CE, and I departments. Among departments reporting both years, the decrease was 4.3%. Despite this drop,
11.
by clusterhacks 6mo ago
"I personally dropped $20k on a high end desktop . . . " This is where I think current hackers should be headed. I grew up with lots of family who were backyard mechanics, wrenching on cars and motorcycles. Their investment in too
12.
by clusterhacks 8mo ago
--> I can spot a person's social media app of choice is in 5 minutes. I find this sadly hilarious. What are the current tells you see? I'm similar in that I read a lot of HN and don't have other social media accounts. But
13.
by clusterhacks 8mo ago
Very cool - thanks for the info. That you are writing AI agents for a living is fascinating to hear. We aren't even really looking at how to use agents internally yet. I think local agents are incredibly off the radar at my org despi
14.
by clusterhacks 8mo ago
Good grief. I'm here cautiously telling my workplace to buy a couple of dgx sparks for dev/prototyping and you have better hardware in hand than my entire org. What kind of experiments are you doing? Did you try out exo with a dgx
15.
by clusterhacks 9mo ago
Wow, thanks for the link to Texerau. I had no idea a pdf was floating around and have wanted this book for some time. You video looks interesting, especially the part around Ronchi and Focault testing. I have 'Understanding Focault&#x2
16.
by clusterhacks 9mo ago
Watch your local craigslist or facebook marketplace. With a little patience, you will probably find a good 8" or 10" dobsonian at a great price. I picked up a lovely 8" dob for less than $200. Most of the generic 8" F&#x
17.
by clusterhacks 9mo ago
Sorry, I don't much track or keep up with those specifics other than knowing I'm not spending much per week. My typical scenario is to spin up an instance that costs less than $2/hr for 2-4 hours. It's all just explorato
18.
by clusterhacks 9mo ago
No, I don't blog. But I just followed the docs for starting an instance on lambda.ai and the llama.cpp build instructions. Both are pretty good resources. I had already setup an SSH key with lambda and the lambda OS images are linux pr
19.
by clusterhacks 9mo ago
I ran ollama first because it was easy, but now download source and build llama.cpp on the machine. I don't bother saving a file system between runs on the rented machine, I build llama.cpp every time I start up. I am usually just runn
20.
by clusterhacks 9mo ago
You know, I haven't even been thinking about those AMD gpus for local llms and it is clearly a blind spot for me. How is it? I'd guess a bunch of the MoE models actually run well?
21.
by clusterhacks 9mo ago
All those choices seem to have very different trade-offs? I hate $5,000 as a budget - not enough to launch you into higher-VRAM RTX Pro cards, too much (for me personally) to just spend on a "learning/experimental" system. I&
22.
by clusterhacks 10mo ago
>whole point of the time compression is to spread the grades out I suspect that is true for standardized tests like the SAT, ACT, or GRE. I suspect in classroom environments that there isn't any intent at all on test timing other
23.
by clusterhacks 10mo ago
Sure, but that answer doesn't address the questions of the value of time limits on assessment. What if instead we are talking about a paper or project? Why isn't time-to-complete part of the grading rubric? Do we penalize a studen
24.
by clusterhacks 10mo ago
I share your paranoia. My kids use personal computing devices for school, but their primary platform (just like their friends) is locked-down phones. Combining that usage pattern with business incentives to lock users into walled gardens, I
25.
by clusterhacks 10mo ago
Why? How strong is the argument that a student completing a test in 1 hour with the same score as a student who took 10 hours that the first student performed "better" or had a greater understanding of the material?
26.
by clusterhacks 10mo ago
I started my career as a software performance engineer. We measured everything across different code implementations, multiple OS, hardware systems, and in various network configurations. It was amazing how often people wanted to optimize
27.
by clusterhacks 10mo ago
I was playing around with Qwen3-VL to parse PDFs - meaning, do some OCR data extraction from a reasonably well-formated PDF report. Failed miserably, although I was using the 30B-A3B model instead of the larger one. I like the Qwen models
28.
by clusterhacks 10mo ago
I never looked at short videos and couldn't understand how my friends and family would open their phones given even a minute of quiet time for these things. I viewed some Youtube shorts (maybe the least effective short video provider i
29.
by clusterhacks 10mo ago
That's interesting. While I suspect the pricing will lean heavily into enterprise sales rather than personal licenses, I personally like the idea buying models that I then own and control. Any steps from companies that make that more p
30.
by clusterhacks 10mo ago
I wish I could just pay for the model and self-host on local/rented hardware. I'm incredibly suspicious of companies totally trying to capture us with these tools.

More ›