mongrelion

7 ms·

1.
by mongrelion 19d ago
Congrats on the launching of your product. I will be taking it for a spin to compare it with these other products that seem to be competing directly with what you have to offer: - https://github.com/ENTERPILOT/GoModel
2.
by mongrelion 21d ago
I think my inexperience using Claude Code or Codex makes a difference but what would you expect to be different here as opposed to using pi or opencode? Pi is my main driver so switching between all these models is a no brainer. No matter w
3.
by mongrelion 21d ago
> Even OpenAI and Anthropic aren't bad enough that they claim literal ownership of your inputs and outputs. In this case you are placing your trust in OpenAI and Anthropic. I'm not sure about Anthropic but OpenAI has changed th
4.
by mongrelion 5mo ago
letting the market set prices ensures that the chips go to the critical markets and uses. Can you please elaborate what you mean by "critical market"? Edit: formatting
5.
by mongrelion 5mo ago
llama.cpp moves too quickly to be added as a stable package. Instead, you can get it directly from AUR: https://aur.archlinux.org/packages?O=0&K=llama.cpp There are packages for Vulkan, ROCm and CUDA. They all work.
6.
by mongrelion 5mo ago
I have been so far happy with the value that Copilot brought but for the past few weeks I have felt the chokehold on the number of requests. I have had the chance to test the main Chinese models through OpenRouter but the Pay-as-you-go mode
7.
by mongrelion 6mo ago
It's clear to me that the maintainer is referring to "shushtain" and those type of people > when they take that tone with you. This makes it sound as if you took it personally?
8.
by mongrelion 6mo ago
Having a bad day does not entitle you to take it out on others
9.
by mongrelion 6mo ago
You should totally post this on the original thread just for adjustment :-)
10.
by mongrelion 6mo ago
I am definitely looking forward to TurboQuant. Makes me feel like my current setup is an investment that could pay over time. Imagine being able to run models like MiniMax M2.5 locally at Q4 levels. That would be swell.
11.
by mongrelion 6mo ago
Not the answer that you are looking for, but I am a fellow AMD GPU owner, so I want to share my experience. I have a 9070 XT, which has 16GB of VRAM. My understanding from reading around a bunch of forums is that the smallest quant you want
12.
by mongrelion 6mo ago
What is this 10€ per month subscription that you are talking about?
13.
by mongrelion 6mo ago
I don't understand why I'm getting downvoted. I am legitimately curious about the parameters that the person used for running the model locally to get the results they got because I am myself currently experimenting with running m
14.
by mongrelion 6mo ago
At what temperature did you run it and what was your context limit?
15.
by mongrelion 6mo ago
Apparently there is a whole science behind running models. I have seen the instructions that unsloth publishes for their quants and depending on the model they'll tweak things like the temperature, top k, etc. The size of the quantizat
16.
by mongrelion 6mo ago
What front-end framework did you use? I find the UI so visually appealing
17.
by mongrelion 6mo ago
Which quantization are you running and what context size? 32tok/s for that model on that card sounds pretty good to me!
18.
by mongrelion 6mo ago
It might be that the system prompt sent by codex is not optimal for that model. Try with open code and see if your results improve
19.
by mongrelion 6mo ago
By anyone do you mean a well-established business or any entity willing to serve you?
20.
by mongrelion 7mo ago
> [...] _but not necessarily use the right format._ This has also been my experience. But isn't the harness sending the instructions on how to invoke a tool? Maybe it is missing the formatting part. What do you think?
21.
by mongrelion 7mo ago
Through my Kagi subscription I get access to quite a few models [1] but I tend to rely on Qwen3 (fast) for quick questions and Qwen3 (reasoning) when I want a more structured approach, for example, when I am researching a topic. I have trie
22.
by mongrelion 7mo ago
Great idea of inferbench (similar to geekbench, etc.) but as of the time of writing, it's got only 83 submissions, which is underwhelming.
23.
by mongrelion 7mo ago
> [...] it's much easier to fine-tune a "general" model into performing some very specific custom task (like classifying text, or translation, etc) Is this fine-tunning process similar to training models? As in, do you nee
24.
by mongrelion 7mo ago
> But are we really at the point yet where people are running local models without knowing what they are running them on..? I can only speak for myself: it can be daunting for a beginner to figure out which model fits your GPU, as the mo
25.
by mongrelion 7mo ago
Apparently there are a few more similar communities like the one from the post https://tildeverse.org/members/
26.
by mongrelion 7mo ago
Pi ships with powerful defaults but skips features like sub-agents and plan mode Does anyone have an idea as to why this would be a feature? don't you want to have a discussion with your agent to iron out the details before moving on
27.
by mongrelion 7mo ago
I agree with you, especially with this: They paid for the access the same as any other. If anything, this makes them more legit than Anthropic because they are paying for the content, whereas Anthropic just stole *all* the data they got a
28.
by mongrelion 7mo ago
The article touches a bit on how Sega basically lost. There is literally a whole documentary about this: Console Wars, where they go deep into how Sega lost the battle: https://en.wikipedia.org/wiki/Console_Wars_(film)
29.
by mongrelion 7mo ago
Hello. I am happy to take this for a spin. I see that not all models available in my Github subscription are available (all models should be visible). Further, is it possible to use openrouter with the current implementation? I couldn'
30.
by mongrelion 7mo ago
This is definitely a cool finding. Have you investigated more on this topic? like, anything similar in concept that competes with Serena? if so, have you tested it/them? what are your thoughts?

More ›