RandomBK

4 ms·

1.
by RandomBK 24d ago
It's worth noting that you need both uniqueness and some form of stability. If you consistently show up as a diffent fingerprint every time you visit or for every different site, then that is a form of privacy as well.
2.
by RandomBK 2mo ago
Laziness and weak connections makes sense as differentiators. However I'm not sure Excel is such a great illustration in that case, as it's neither lazy nor weakly connected; at least at the surface.
3.
by RandomBK 2mo ago
One thing I've never fully grokked is how this differs from an observable pattern where one can publish new values to inputs, propagate that through the computation, and push newly computed values to listeners. I guess there's pro
4.
by RandomBK 2mo ago
I'm curious to hear what bottlenecks you encountered in the traditional path. Of all the compute and data shuffling involved in LLM inference, I would have thought shuffling the raw input/output around would have been a trivial pa
5.
by RandomBK 4mo ago
As someone who uses gradle largely out of inertia, I'm curious what you would pick as a better alternative.
6.
by RandomBK 4mo ago
I've found swearing at a model to be quite effective in getting it to rethink and correct its mistakes. This seems to apply across Codex, Claude, Qwen, and Gemma/Gemini. I don't know if the model is picking up on a "need
7.
by RandomBK 4mo ago
> context with 2.1 bits of entropy per token Can you elaborate on this? I'm seen estimates of ~1.5bit per English letter , and tokens encode a lot more than that - sometimes full words, with multimodal even more. If KV cache embedd
8.
by RandomBK 5mo ago
VPS comes at the cost of potential for oversubscription - even from more reputable vendors. You never really know if you're actually getting what you're paying for.
9.
by RandomBK 5mo ago
One annoyance (I don't know if they've since fixed it) was that Docker Hub would count pulls that don't contain an update towards the rate limit. That ultimately prompted me to switch to alternate repositories.
10.
by RandomBK 7mo ago
How well do we understand the tokenization for Claude? I'd posit that the exact human-representation of this markup is likely irrelevant if it's all being converted into a single token.
11.
by RandomBK 7mo ago
Code length will itself become a problem. The instruction cache is limited in size and often quite small. Bloating instruction counts with lots of duplicated code will eventually have a negative effect on performance. Ultimately, there&#x27
12.
by RandomBK 8mo ago
Additionally, so long as we can be sure the human's output is not actively adversarial , we can xor it into the entropy pool. Entropy can only increase this way.
13.
by RandomBK 9mo ago
I'm reminded of a diagram from the pitch doc for the original Diablo [0] that made its rounds across the web recently. The dungeon/town split was particularly sharp back then, but the broad design has stuck with modern ARPG design
14.
by RandomBK 11mo ago
Good catch; it was somewhat ambiguous in the report.
15.
by RandomBK 11mo ago
I see a lot of discussion in this thread stemming from some confusion+not reading the actual report[0]. Some key points: 1. The Camera+Card was encased in a separate enclosure made of titanium+sapphire, and did not seem to be exposed to ext
16.
by RandomBK 11mo ago
> Getting on the public suffix list is easier said than done [1]. Can you elaborate on this? I didn't see anything in either link that would indicate unreasonable challenges. The PSL naturally has a a series of validation requiremen
17.
Show HN: Open-source Voice Cloning at 16x real-time: Porting Chatterbox to vLLM(github.com)
3 points by RandomBK 1y ago|0 comments
18.
by RandomBK 1y ago
My 2c is that it is worthwhile to train on AI generated content that has obtained some level of human approval or interest, as a form of extended RLHF loop.
19.
by RandomBK 1y ago
It reminds me of the early days of Typescript rollout, which similarly focused on a smooth on-boarding path for existing large projects. More restrictive requirements (ie `noImplicitAny`) could be turned on one at a time before eventually f
20.
Show HN: Kernel-level LLM inference via /dev/llm0(github.com)
2 points by RandomBK 1y ago|0 comments
21.
Claude Plays Pokémon, a Visual Guide(excalidraw.com)
2 points by RandomBK 2y ago|0 comments
22.
by RandomBK 2y ago
The way the question was framed, it was ambiguous whether "draw again" only applied to B, or whether A would draw again as well. I'm assuming the 'infinity' answer applies only to the former case?
23.
by RandomBK 2y ago
> IEEE754 is not great for pure maths, however, it is fine for real life. Partially. It can be fine for pretty much any real-life use case. But many naive implementations of formulae involve some gnarly intermediates despite having fai
24.
by RandomBK 2y ago
The entire frontpage was just 468KB, 91KB compressed, and most of that was the search index. Very neat!
25.
by RandomBK 2y ago
You mean $2/customer? That doesn't actually sound that bad, and is in line with many other marketing efforts.
26.
by RandomBK 2y ago
Yup. I was referring to the 1.58B quant which seemed to be performing alright and would be the smallest real-DeepSeek model. That requires ~140GB, which is just barely doable on a 128GB RAM + 24GB VRAM setup + a lot of patience. Others have
27.
by RandomBK 2y ago
The only 32B distill I'm aware of is `DeepSeek-R1-Distill-Qwen-32B`, which would be a base model of `Qwen-32B` distilled (further trained) on outputs from the full R1 model.
28.
by RandomBK 2y ago
Reminder: DeepSeek distilled models are better thought of as fine-tunes of Qwen/Llama using DeepSeek output, and are not the same as actual DeepSeek v3 or R1. This unfortunate naming has sown plenty of confusion around DeepSeek's
29.
by RandomBK 2y ago
On the other hand, 3B1B's audience tends to heavily bias towards the tech crowd. I'm at a FAANG, and a decent number of our senior engineers know the channel. I agree it's not enough to directly push policy, but the impact is
30.
by RandomBK 2y ago
Depending on how you count, the ratio might not be that small. A lot of hot code are written in hand-coded inline assembly, so in terms of CPU cycles run it's probably non-negligible. i.e. take a look at the glibc implementation of &

More ›