nodja

6 ms·

31.
by nodja 5mo ago
Anyone familiar with the literature knows if anyone tried figuring out why we don't add "speaker" embeddings? So we'd have an embedding purely for system/assistant/user/tool, maybe even turn number if i.e.
32.
by nodja 6mo ago
You can charge $10 on the account and get unlimited requests. I abused this last week with the nemotron super to test out some stuff and made probably over 10000 requests over a couple of days and didn't get blocked or anything, expect
33.
by nodja 6mo ago
It's probably another ASR model that focuses on benchmarks and simple uses instead of more challenging real use cases. I upload edited gameplay vods of twitch streams on youtube, and use whisper-large-v3 to provide subtitles for access
34.
by nodja 6mo ago
This blog post looks to be partially AI generated as well...
35.
by nodja 6mo ago
If anyone at anthropic is reading this and wants more logs from me add jfc.
36.
by nodja 6mo ago
NVIDIA's GPU drivers on windows 100% do this https://i.imgur.com/c0a3vUy.png
37.
by nodja 6mo ago
IDK how it did but it detected my LM studio downloaded models I have on a spinning drive (they're not in the default location).
38.
by nodja 7mo ago
> It's like people let their hate of AI and LLM bubble blind them, and their brains can't compartmentalize good from bad news anymore. DLSS is also AI and people like it. People don't like framegen because the manufacturer
39.
by nodja 7mo ago
Doing some math in my head, buying the GPUs at retail price, it would take probably around half a year to make the money back, probably more depending how expensive electricity is in the area you're serving from. So I don't know w
40.
by nodja 7mo ago
> A year or more ago, I read that both Anthropic and OpenAI were losing money on every single request even for their paid subscribers, and I don't know if that has changed with more efficient hardware/software improvements&#x2F
41.
by nodja 7mo ago
There is https://huggingface.co/spaces/hf-audio/open_asr_leaderboard but it hasn't been updated for half a year.
42.
by nodja 8mo ago
> My <device> already comes with built in <software> why would I install anything else? Top voted comment on hacker news btw. Ok that was probably unnecessarily snarky I hope you don't take offense, but it seems the hack
43.
by nodja 8mo ago
I've been programming since ~1999 and anecdataly don't remember programmers having a culture of paying for their dev tools. On linux everything's free, and on windows I've used a plethora of freeware IDEs/compilers&
44.
by nodja 8mo ago
https://www.youtube.com/watch?v=JhBtg-lyKdo - 10 AIs Play Mafia https://www.youtube.com/watch?v=GMLB_BxyRJ4 - 10 AIs Play Mafia: Vigilante Edition https://www.youtube.com/watch?v=OwyUGkoLgwY
45.
by nodja 8mo ago
I think you need to either feed it all of ./docs or give your agent access to those files so it can read them as reference. The MEMORY.md file you posted mentions ./docs/CANONICAL_STYLE.md and ./docs/LLM_CORE_SUBSET
46.
by nodja 8mo ago
It's insane to me that in 2008 a bunch of pervs decentralized storage and made hentai@home to host hentai comics. Yet here we are almost 20 years later and we haven't generalized this solution. Yes I'm aware of the privacy is
47.
by nodja 9mo ago
I've run the first of the sample images through 3 captioning models, an old old ViT based booru style tagger, a more recent one and qwen 3 omni. All models successfully identified visual features of the image with no false positives at
48.
by nodja 9mo ago
On one hand, it has made json more ubiquitous due to it's frozen state. On another hand, it forces everyone to move to something else and fragments progress. It would be much easier for people to move to json 2.0 rather than having hun
49.
by nodja 9mo ago
I think a lot of commenters here are missing the point. Looking at performance numbers is important regardless if it's python, assembly or HDL. If you don't understand why your code is slow you can always look at how many cycles t
50.
by nodja 9mo ago
Cool site, I noticed the 3090 is on there twice. https://inferbench.com/gpu/NVIDIA%20GeForce%20RTX%203090 https://inferbench.com/gpu/NVIDIA%20RTX%203090
51.
by nodja 9mo ago
> Reportedly the inter-layer transfer sizes are in kilobyte ranges and PCIe x1 is plenty or something. Not an expert, but napkin math tells me that more often that not this will be in the order of megabytes—not kilobytes—since it scales
52.
by nodja 9mo ago
It's an alternate architecture of LLMs, they actually predate modern LLMs. An encoder-decoder model was actually the model used in the "Attention if all you need" paper that introduced the transformer and essentially gave bir
53.
by nodja 10mo ago
The current prices are a response to future stock, not current. It's 100% retailers price gouging with their current stock that they got for cheap because they know there will be limited stock in the near future. Asian retailers may be
54.
by nodja 10mo ago
Because success for them doesn't mean it works, it means it works much better than what they currently have. If a 1% improvement comes at the cost of spending 10x more on training and 2x more on inference then you're failing at ru
55.
by nodja 10mo ago
> Genuine question: How is it possible for OpenAI to NOT successfully pre-train a model? The same way everyone else fails at it. Change some hyper parameters to match the new hardware (more params), maybe implement the latest improvement
56.
by nodja 10mo ago
Pre-training is just training, it got the name because most models have a post-training stage so to differentiate people call it pre-training. Pre-training: You train on a vast amount of data, as varied and high quality as possible, this wi
57.
by nodja 10mo ago
I'm pretty sure davinci resolve does this already, you can even track it, idk if it's available in the free version.
58.
by nodja 10mo ago
Count down i from 100 to 0 and do 1/i at the end of the loop :)
59.
by nodja 10mo ago
Windhawk mods are distributed as source code and WH itself compiles it. It works the same way usescripts work with tampermonkey/violentmonkey on browsers. If a mod includes malware it'll be very obvious as mods are usually small.
60.
by nodja 10mo ago
All they have to do is market the fact you don't have to pay for online. PS5 + 3 years of PS Plus = $740 Steam Machine = $700 Add/remove more years of PS Plus if the SM turns out to be more/less expensive. If you add the fact

More ›