vrm

7 ms·

1.
by vrm 2mo ago
good luck running a 2.4T model on any local hardware. it’s not gonna happen. the arrow is to specialized hardware at least for the smartest models
2.
by vrm 4mo ago
TBH it's intended only for internal use (we don't even publish it as a crate at this point) so I don't particularly mind it being low-key. But I appreciate it!
3.
by vrm 4mo ago
If you don't need a ton of throughput I think `absurd` (and our Rust derivative `durable`) are very nice options that keep the client side extremely simple. It's also lightweight enough that a coding agent can keep the entire thin
4.
by vrm 4mo ago
Since DBOS doesn't support Rust, we implemented a very minimal Rust version of this at https://github.com/tensorzero/durable . It has been quite stable and extensible but of course you need to be very careful with
5.
ATLAS: Autoformalized Textbook Library At Scale(github.com)
32 points by vrm 4mo ago|4 comments
6.
by vrm 4mo ago
It’s really not a concept you can express in idiomatic Python very easily. This comes from the actual generated assembly involving copies from global GPU memory into registers (slow, bandwidth saturates quickly) and back in between the cosi
7.
by vrm 4mo ago
One question I have here: I think this type of thing would be trivial to do in Rust with constructors, private fields, and newtypes. What am I getting on top of it?
8.
Stop comparing price per million tokens: the hidden LLM API costs(tensorzero.com)
3 points by vrm 5mo ago|2 comments
9.
Ask HN: What do you recommend for test observability?
3 points by vrm 1y ago|0 comments
10.
Improving Cursor Tab with RL(cursor.com)
6 points by vrm 1y ago|0 comments
11.
by vrm 1y ago
that is earnings (net income) not revenue (top line) so these are wildly different and incomparable numbers
12.
by vrm 1y ago
a 6:1 parameter ratio is too small for specdec to have that much of an effect. You'd really want to see 10:1 or even more for this to start to matter
13.
by vrm 1y ago
This is neat! I think in general there are really deep connections between semantically meaningful diffs (across modalities) and supervision of AI models. You might imagine a human-in-the-loop workflow where the human makes edits to a parti
14.
Automatically Evaluating AI Coding Assistants with Each Git Commit(tensorzero.com)
3 points by vrm 1y ago|0 comments
15.
Wider or Deeper? Scaling LLM Inference-Time Compute with Adaptive Tree Search(arxiv.org)
3 points by vrm 1y ago|0 comments
16.
by vrm 1y ago
if you haven't check out our repo -- it's free, fully self-hosted, production-grade, and designed for precisely this application :) https://github.com/TensorZero/tensorzero
17.
by vrm 1y ago
I definitely see different prompts based on what I'm doing in the app. As we mentioned there are different prompts for if you're asking questions, doing Cmd-K edits, working in the shell, etc. I'd also imagine that they custo
18.
by vrm 1y ago
we're doing the latter! Cursor lets you configure the OpenAI base URL so we were able to have Cursor call Ngrok -> Nginx (for auth) -> TensorZero -> LLMs. We explain in detail in the blog post.
19.
by vrm 1y ago
wireshark would work for seeing the requests from the desktop app to Cursor’s servers (which make the actual LLM requests). But if you’re interested in what the actual requests to LLMs look like from Cursor’s servers you have to set somethi
20.
by vrm 1y ago
We're working on an OSS industrial-grade version of this at TensorZero but there's a long way to go. I think the easiest out of the box solution today is probably OpenAI RFT but that's a partial solve with substantial vendor
21.
by vrm 1y ago
This is very neat work! Will be interested in how they make this sort of thing available to the public but it is clear from some of the results they mention that search + LLM is one path to the production of net-new knowledge from AI system
22.
by vrm 1y ago
would it be possible to fuzz an arbitrary JSON schema with this? I’ve been looking for such a lib for a while now
23.
Think of LLM Applications as POMDPs – Not Agents(tensorzero.com)
2 points by vrm 2y ago|0 comments
24.
An experimental design perspective on model-based reinforcement learning(blog.ml.cmu.edu)
3 points by vrm 4y ago|0 comments
25.
by vrm 5y ago
OP here: I saw the spinlaunch video and got really excited that this was completely tractable in simplified form with basic physics. So I did the math expecting to see a huge savings in fuel mass and....it was basically negligible. I'm
26.
Spinlaunch with Basic Physics [pdf](virajrmehta.com)
2 points by vrm 5y ago|2 comments
27.
by vrm 5y ago
Yeah so the paper I linked on contextual bayesian optimization ( https://papers.nips.cc/paper/2019/hash/7876acb66640bad41f1e1... ) does a combination of controlling for beta and optimizing linear MHD stability
28.
by vrm 5y ago
will repost my comment from the other one: Papers I would recommend from our collaboration on control of normalized plasma pressure: https://papers.nips.cc/paper/2019/hash/7876acb66640bad41f1e1 ... plasma prof
29.
by vrm 5y ago
I need to redo my website, just getting into the more public part of my PhD. Papers I would recommend from our collaboration on control of normalized plasma pressure: https://papers.nips.cc/paper/2019/hash/787
30.
by vrm 5y ago
like I said above, we certainly hope so! It has been slow progress so far but applying modern ML / control techniques to tokamaks is one of the truly exciting applications of the current generation of AI in my opinion. Biased because t

More ›