Greenpants

6 ms·

1.
by Greenpants 19d ago
Reminds me of letting an LLM generate a strong password in the first place. Very practical, very quick, no terminal commands needed! I'm sure some have done exactly this. But then you realise your password is always shared with your LL
2.
by Greenpants 2mo ago
Alternatively, what I tend to do after receiving generated code is a lot of asking "why?". I've learned things I wouldn't otherwise have learned because I hadn't considered using the tools the LLM recommends. It&#x2
3.
by Greenpants 2mo ago
Agent-related files should've been dot-files at least to minimize human error. In fact, I'd been discussing: shouldn't agent instructions exist on a per-developer basis, and thus be an IDE setting for each individual, removed
4.
by Greenpants 2mo ago
The way I see it, it's the incessant stimuli you get through these apps. There's just no point where the screen stays quiet, stimulus free. Moving elements capture our attention naturally, especially when the entire screen keeps m
5.
by Greenpants 2mo ago
And those installed programs could have vulnerabilities that just a non-root user account could still take advantage of. Perhaps not likely for an LLM to do, but more so if you let them loose on the internet and they end up coming across pr
6.
by Greenpants 2mo ago
Though I'm in the camp "people should really know to sandbox by now and be careful", I'd say we should also be mindful of how far from everyone has deep knowledge of the systems and tools they use. This behaviour of a to
7.
by Greenpants 3mo ago
I specifically chose a Mac Studio 128GB as my home server that's also running LLMs to be always online, in part due to the minimal idle power consumption and mostly fan-less operation. It's definitely expensive, especially nowaday
8.
by Greenpants 3mo ago
Up to the point where consumers notice and decide to stop using these models because of it. Might be why we're already rarely seeing models output an "I don't know".
9.
by Greenpants 3mo ago
That's precisely why my agent use is IDE-agnostic: I run Pi in any terminal. Often use it with the terminal inside VSCodium, though sometimes in a terminal outside an IDE if I don't expect to edit any files myself (e.g. for small
10.
by Greenpants 3mo ago
I'm afraid I'd have to agree. That is, unless you have 512GB+ RAM sitting on a shelf and run the much larger SOTA-comparable local models.
11.
by Greenpants 3mo ago
I'm glad you're asking. I already started writing a blog post on how to best make use of local models. I'll share it as soon as I have a complete enough list. If anyone else reading this would like to chime in with their tips
12.
by Greenpants 3mo ago
I get that it's a deal breaker to some; it definitely requires patience. In Pi, /new is my best friend and most-used command for sure. For simple tasks (I decompose complex ones anyway since I don't trust small local LLMs to
13.
by Greenpants 3mo ago
The other upside of running local LLMs is that there's no cloud provider to suddenly charge more for the same, or even less, model use. It's personal, but I prefer CapEx over OpEx for this. If you can purchase a device upfront tha
14.
by Greenpants 3mo ago
Some of the work I do, I do for an (EU) organisation that doesn't have clear rules or guidelines on the use of AI yet. Though I have seen colleague-developers blatantly putting source code into external Claude-like models, I stay true
15.
by Greenpants 3mo ago
Let me put it like this. I started with local LLMs when ChatGPT still used GPT-3.5. I was amazed how my MacBook with 8GB RAM could run openhermes2.5-mistral: a 7b parameter model that could generate short stories that sort of made sense. In
16.
by Greenpants 3mo ago
I'm actually quite sure that directly retrying the tool call would often fix the edit-call already. But these models have been trained to "think" for a while for any problem solving, so they'll presume the problem of the
17.
by Greenpants 3mo ago
I have! I care about data privacy and LLMs being free. I'm using the Pi coding harness but containerized and sandboxed, to make sure it's running completely offline. On my Mac Studio with 128GB RAM (or MacBook with 36GB RAM) I&#x2
18.
Ten Years of Having a Personal Website(blog.greenpants.net)
2 points by Greenpants 3mo ago|0 comments
19.
by Greenpants 3mo ago
I've dabbled a bit in GitHub Copilot using Claude Opus and Sonnet models via work, but I couldn't shake the thought that we weren't allowed to use this on any of our clients' codebases. Having been a fan of Ollama, I wan
20.
The Future of Advertising Is in Personalized Website Layouts(blog.greenpants.net)
1 points by Greenpants 4mo ago|0 comments
21.
AI Etiquette(blog.greenpants.net)
3 points by Greenpants 6mo ago|0 comments
22.
by Greenpants 7mo ago
People choose the path of least resistance. If you can quickly swap out an old phone battery with one you can purchase in a store, it's as easy as doing groceries. If on the other hand you need to hand off your phone to a third party f
23.
by Greenpants 8mo ago
https://blog.greenpants.net – my actively maintained blog where I write about my thoughts on AI given my Master's, share personal stories, tutorials and more. Lots of drafts coming up soon, like the ideal home server archit
24.
by Greenpants 11mo ago
The TODOs really help me get my logic sorted out first in pseudocode. Glad to inspire someone else with it! I've read that GPT-OSS:20b is still a very powerful model, I believe it fits in your Mac's RAM as well and could still be
25.
by Greenpants 11mo ago
I got a personal Mac Studio M4 Max with 128GB RAM for a silent, relatively power-efficient yet powerful home server. It runs Ollama + Open WebUI with GPT-OSS 120b as well as GLM4.5-Air (default quantisations). I rarely ever use ChatGPT any
26.
by Greenpants 11mo ago
You might want to read "The Circle" if you haven't already. The reader gets to see an open-minded perspective of exactly this. Given your prior, I'd be curious what you think of it after reading.
27.
by Greenpants 1y ago
I really like this analogy! Many real-world tasks that we'd like to use AI for seem infinitely more complex than can be captured in a simple question/prompt. The main challenge going forward, in my opinion, is how to let LLMs ask
28.
by Greenpants 1y ago
I've had this phone as my main device for half a year and now using a Pixel 9 Pro Fold sometimes in "laptop" folded mode. So far, neither of these devices come close in my typing speed to a proper keyboard. The F(x)tec was gr
29.
by Greenpants 2y ago
You may be interested in the "binary step" activation function. This does what you're suggesting. In general, complex behaviour really takes a hit though using this for the activation function of a neuron (though I'm als
30.
by Greenpants 3y ago
Simply put, ten years ago the ads on YouTube were fine, we used adblockers back then as well, and Google still made a profit. What we see today can only be described as greed.

More ›