lcampbell

6 ms·

1.
by lcampbell 1mo ago
> Do all other providers somehow overcharge by that much? This, I think. Cached inputs have an opportunity cost (keeping the KV cache until use) but a hit is basically free. “Basically” - if the cache is offloaded to system RAM or NVMe t
2.
by lcampbell 1mo ago
You're gonna want a custom vLLM build. Here's a runbook: https://github.com/local-inference-lab/rtx6kpro/blob/master/... If the newer builds aren't working, you might try running the old v
3.
by lcampbell 2mo ago
> Aggregate token throughput is about 30% lower (122 vs 170 tok/s at 16 users) Is that actually the aggregate throughput? 8xB300 (with 4TB/s/GPU bandwidth) is only pushing 8 tg/s/session? That seems… incredibly
4.
by lcampbell 2mo ago
More than that, the AI disclaimer itself is a hallucination: > Gemini 4 helped with the editing. There is no Gemini 4, unless the author is writing from the future.
5.
by lcampbell 2mo ago
FWIW, you can get a 16x RTX 6000 Pro setup running for significantly less than that. Even considering the electrical hookup fees (it’s a lot of power and cooling). Home ownership might push you into the original quote though.
6.
by lcampbell 2mo ago
> The fix that worked is a schema transform at the provider boundary. For OpenAI-family models only, we rewrite every optional property to be required but nullable, using anyOf: [T, null], which gives the model an explicit way to say “no
7.
by lcampbell 3mo ago
I don't think llama.cpp supports any of the LongCat models, actually. They haven't posted weights/inference solutions for LongCat-2.0 [1], but LongCat-Next had transformers support, which I assume means it works with vLLM&#x2
8.
by lcampbell 3mo ago
At UVA many years ago, one of my roommates was one of the unfortunate 20 or so annually expelled -- the only outcome of being convicted of breaking the "no cheating, stealing, or lying" honor code. It didn't take repeat offen
9.
by lcampbell 3mo ago
> I want to be careful here. was the giveaway for me
10.
by lcampbell 6mo ago
The reasoning generally isn't kept in the context, so after choosing the secret word in the first reasoning block, the LLM will have completely forgotten it in the second and subsequent requests. So, it technically didn't change t
11.
by lcampbell 11mo ago
Epic Anti-Cheat fully supports Linux[1]. I believe what the GP comment means is that the Fortnite publishers opted not to tick the “allow Linux” checkbox on the developer portal website. There is probably more nuance behind that decision th
12.
by lcampbell 1y ago
Without knowing anything about Tor, I'd guess you've got it backwards. I imagine Tor leaks your OS through TCP/IP fingerprinting, and whether that fingerprint matches your `navigator.platform` is probably a factor into whethe
13.
by lcampbell 2y ago
If you're given a button to click, your browser has successfully passed the environment integrity checks and you have not been flagged as a bot. You'll be flagged as a bot if your browser configuration has something "weird&qu
14.
by lcampbell 2y ago
Interestingly, not only do both versions emit the same assembly, but clang both autovectorizes and unrolls the loop: https://godbolt.org/z/qxsKWfz9s
15.
by lcampbell 2y ago
This looks like it, I think: https://searchfox.org/mozilla-central/source/toolkit/xre/dll...
16.
by lcampbell 2y ago
> what if someone turns [password authentication back] on sshd_config requires root to modify, so you've got bigger problems than weak passwords at this point.
17.
by lcampbell 2y ago
Less than skips over, utility based shopping is explicitly derided: > The narrative that you just told me [about utility shopping] is “I am a very analytical person who only has book smarts and no emotions”. And that narrative is boring!
18.
by lcampbell 3y ago
This is briefly mentioned in the article, but from the report[1]: > It should be noted that the scope of the code reviewed within this audit is relatively narrow. In particular, while we audited cURL’s use of the third-party libraries ng
19.
by lcampbell 3y ago
Given the exploit vector looks like yet another iMessage attachment bug, > The target iOS device receives a message via the iMessage service, with an attachment containing an exploit. and that one of the effects of Lockdown Mode is >
20.
by lcampbell 4y ago
> banned by Microsoft for breach of TOS, whatever that might have been FWIW, I had the same thing happen and found out the ban reason was "fraud (please insert phone number)".
21.
by lcampbell 4y ago
I believe GP is referring to the multiple AI-driven vtubers on Twitch (vedal987 and motherv3 I think?). They're not yet 24/7 because they still require human supervision for reasons -- vedal987 was recently banned for holocaust de
22.
by lcampbell 4y ago
Probably just an extension to existing ETSI legal interception interfaces[1] that I believe are required to be implemented by all service providers of a certain size in the EU. Your personal email server and private IRC network are probably
23.
by lcampbell 4y ago
> but prohibitions on Congressmen remain in force [i.e. 2020 congressional insider trading] Is it really "in force" when, despite much ado, no charges were brought in the linked scandal [1][2]? I don't really have a hors
24.
by lcampbell 4y ago
Are you using the no-javascript version (“HTML” version), by any chance? If so, you might find the “fully-featured” version has better^W results, at the cost of requiring Javascript and all that entails.
25.
by lcampbell 4y ago
As a regular user of the Javascript-less page, several months ago it started returning wildly different results than the “fully featured” version for the same queries. My uneducated guess is that it’s using a different index. There also app
26.
by lcampbell 4y ago
This might make more sense in the situation where multiple hosts share the same IP, as in a CARP[1] setup. There’s probably other useful use-cases but that’s the one that comes to my mind. [1] https://en.wikipedia.org/wiki&#
27.
by lcampbell 5y ago
Direct link: https://www.youtube.com/watch?v=5eo8nz_niiM Really enjoyed the video, thanks for the suggestion!
28.
by lcampbell 5y ago
Anything over a network is going to have layer 2 framing overhead. Something like a serial port would do the trick.
29.
by lcampbell 6y ago
Doesn't seem like it. The GPU module required for training CNNs is sold separately[1]: > A GPU capable special SOD release which is not available to the public is required in order to train your own CNN model. There are some bits in
30.
by lcampbell 7y ago
> Bread takes about 10 minutes I've been using the newbie friendly NYT no knead bread[1] for years, and it's that easy. The only gotcha is that you have to prepare it the night before, but that isn't really a big deal in p

More ›