anonymoushn

7 ms·

1.
by anonymoushn 5mo ago
I couldn't reproduce this behavior with Sonnet 4, and Sonnet 3.7 has been deprecated since I messed with this stuff. You can try tokenizing the string "<hello> </hello>" I think the correct tokenization of th
2.
by anonymoushn 5mo ago
That's " 'd ".strip(), an english contraction suffix. it's 1 token, but using this echo approach you will be served the apostrophe and the subsequent letter for the first time in different steps.
3.
by anonymoushn 5mo ago
You can't reliably obtain correct token boundaries with this method. For example, "'d" is 1 token, but the API will return "d" stuck to the next token. Weirdly this seems to be specific to the letter "d&qu
4.
by anonymoushn 5mo ago
their old tokenizer performed some space collapsing that allowed them to use the same token id for a word with and without the leading space (in cases where the context usually implies a space and one is not present, a "no space"
5.
by anonymoushn 5mo ago
Is this the wrong URL? this seems to be a blog post from October 2025 called "Introducing: Local Browser AI"
6.
by anonymoushn 5mo ago
How do you guys decide which settings should be configurable via environment variables but not settings files and which settings should be configurable via settings files but not environment variables?
7.
by anonymoushn 5mo ago
> On of our product principles is to avoid changing settings on users' behalf Ideally there wouldn't be silent changes that greatly reduce the utility of the user's session files until they set a newly introduced flag. I h
8.
by anonymoushn 6mo ago
Oh, can you post some benchmarks? I didn't know that parser throughput per core would change with the amount of data like that.
9.
by anonymoushn 6mo ago
why
10.
by anonymoushn 6mo ago
are those tools known for their fast json parsers?
11.
by anonymoushn 7mo ago
ideally users could be banned for posting LLM outputs as if they were authored by humans https://www.pangram.com/history/49335ddf-118d-43e4-9340-a58a...
12.
by anonymoushn 8mo ago
Hello, the part about canonical filtering in https://openreview.net/pdf?id=DFybOGeGDS doesn't seem to try to account for pretokenization. For example, if you receive " 天天中彩票APP" in o200k, it means there has t
13.
by anonymoushn 8mo ago
use claude code if you want to use opus
14.
by anonymoushn 8mo ago
what does "logprobs look off" mean
15.
by anonymoushn 8mo ago
Hello, a couple years ago I participated in a contest to count word frequencies and generate a sorted histogram. There's a cool post about it featuring a video discussing the tricks used by some participants. https://easyper
16.
by anonymoushn 9mo ago
requires fully deterministic inference, which turns out to be unusual, but for this sort of thing it's probably fine if you do really slow inference on cpu. cool idea.
17.
by anonymoushn 9mo ago
please write your own posts from now on
18.
by anonymoushn 9mo ago
i love stemming, i love searching for "anime" and getting "animal"
19.
by anonymoushn 9mo ago
so sad to hear that about Streaming SIMD Extensions
20.
by anonymoushn 10mo ago
This is true economically but in reality if you have much larger cost savings than that for sale then these companies mostly say "we would be happy to buy that for $0 while we pay you a million a year to move to the united states"
21.
by anonymoushn 10mo ago
If they had, they would know that it involves many weeks of arguing with support, of course
22.
by anonymoushn 10mo ago
The framing in this post is really weird. Automated evals can be much more informative than unit tests because the results can be much more fine grained. A/B testing in production is not suitable for determining whether all of one&#x27
23.
by anonymoushn 11mo ago
it is frustrating that the post opens by describing latency and then saying that it is called throughput.
24.
by anonymoushn 11mo ago
fwiw i thought the previous async based on whole-program analysis and transformation to stackless coroutines was pretty sweet, and similar sorts of features ship in rust and C++ as well
25.
by anonymoushn 11mo ago
Arrays of length 0 also exist in json?
26.
by anonymoushn 11mo ago
Hello, it's probably better to add leading spaces before all of the words rather than none of them
27.
by anonymoushn 11mo ago
I don't really know what you mean by "preserve semantic meaning at the word level." The significant misunderstanding about tokenization present elsewhere in the article is concerning, given that the proposed path forward is t
28.
by anonymoushn 11mo ago
hello. it would be great because it celebrates the total destruction of the search capabilities of the tool, just like the article does.
29.
by anonymoushn 1y ago
well, most of the users are aarch64
30.
by anonymoushn 1y ago
you can have some vector registers n_acc, ns, idx_acc, idxs, then you can do // (initialize ns and idxs by reading from the array // and adding the apropriate constant to the old value of idxs.) n_acc = min(n_ac

More ›