anerli

6 ms·

1.
by anerli 5mo ago
In my experience it's actually very doable to do reliable tool calling with a generic response format across models. You just need to disable native tool calling completely and provide a clearly defined response/tool format that c
2.
by anerli 1y ago
yup, we've been using this approach with our product to make composing different integrations easier for the LLM and also give it the flexibility of code. Main difference is we use quick-js instead of v8 isolates. Seeing a TS interface
3.
Show HN: Magnitude MCP – vision-first browser interaction for Claude Code(github.com)
2 points by anerli 1y ago|0 comments
4.
Pure-vision browser agent scores 94% on WebVoyager (SOTA)(github.com)
5 points by anerli 1y ago|1 comments
5.
by anerli 1y ago
Hey HN, Anders and Tom from Magnitude (YC S25) here. On our last Show HN post about our open-source browser agent, someone left a comment - "there are multiple similar projects like this posted here daily, and this one likely isn'
6.
by anerli 1y ago
So there’s a very big difference in the sort of vision approach that browser-use does vs. what we do browser-use is still strongly coupled to the DOM for interaction because of the set-of-marks approach it uses (for context - those little r
7.
by anerli 1y ago
^ syncthing is nice
8.
by anerli 1y ago
We do believe in a hybrid approach where a fast/deterministic representation is saved - but think there is a more seamless way were the framework itself is high level and manages these details by caching the underlying actions that can
9.
by anerli 1y ago
Hey, curious about your use cases for a chrome extension, care to share more? To answer your question - BAML is as DSL that helps to define prompts, organize context, and to get better performance on structured output from the LLM. In theor
10.
by anerli 1y ago
Only one that's worth using ;)
11.
by anerli 1y ago
I think the difficulty with this approach is (1) you want a good "lookup" mechanism - given a task, how do you know what cache should be loaded? you can do a simple string lookup based on the task content, but when the task might
12.
by anerli 1y ago
Yeah, I think its a little tricky to do this well + automatically but is essentially our goal - not necessarily literally writing a script but storing the actions taken by the LLM and being able to repeat them, and adapt only when needed
13.
by anerli 1y ago
For context, we have no affiliation with KeysToHeaven (though we appreciate his comment). We do think our vision-first approach gives us a significant edge over other browser agents, though we probably could’ve made that aspect clearer in t
14.
by anerli 1y ago
Both of them are "visually grounded" - meaning if you ask for the location of something in an image - they can output the exact x/y pixel coordinates! Not many models can do this, especially not many that are large enough to
15.
by anerli 1y ago
Yeah we've though about this approach a lot - but the problem is if your final program is a brittle script, you're gonna need a way to fix it again often - and then you're still depending on recurrently using LLMs/agents
16.
by anerli 1y ago
Glad you were able to get it set up quickly! We currently are optimizing for reliability and quality, which is why we suggest Claude - but it can get expensive in some cases. Using Qwen 2.5-VL-72B will be significantly cheaper, though may n
17.
by anerli 1y ago
I think depends a lot on how much you value your own time, since its quite time consuming to write and update playwright scripts. It's gonna save you developer hours to write automations using natural language rather than messing aroun
18.
by anerli 1y ago
Try it out and report back!
19.
by anerli 1y ago
Exactly :)
20.
by anerli 1y ago
Hey! To have a framework that can effectively control browser agents, you need systems to interact with the browser, but also pass relevant content from the page to the LLM. Our framework manages this agent loop in a way that enables flexib
21.
Show HN: Magnitude – Open-source AI browser automation framework(github.com)
145 points by anerli 1y ago|40 comments
22.
Parallel Scaling Law for Language Models(arxiv.org)
2 points by anerli 1y ago|1 comments
23.
by anerli 1y ago
Qwen team shows how parallel streams of inference-time thinking tokens could be far more efficient than a serial stream. Compared to scaling parameters alone, the same performance increase using their technique may be achieved with 22x less
24.
by anerli 1y ago
The small VLM (Moondream) decides when interface changes / its actions no longer line up. We say 100% open source because all of our code (test runner and AI agents) is completely open source. It’s also completely possible to run an en
25.
by anerli 1y ago
This is definitely top of mind for us! A lot of ways to potentially approach it. We want to make sure the test case execution works really well so our focus is there but also want to think about test case generation going forward. Recording
26.
by anerli 1y ago
Huh that’s an interesting use case. Yeah using an AI driven system definitely opens up some cool possibilities that aren’t possible with playwright alone. Would be curious to hear more about what you’re trying to test this way with audio.
27.
by anerli 1y ago
Looks cool! Thanks for sharing! The idea of having a hybrid framework for component unit testing + end to end testing is neat. Will definitely consider how this might be applicable to magnitude.
28.
by anerli 1y ago
Definitely a good question. Using an actual LLM as the execution layer allows us to more easily swap to the planner agent in the case that the test needs to be adapted. We don’t want to store just a selector based test because it’s difficul
29.
by anerli 1y ago
So the problem is if we cache the coordinates and click blindly at the saved positions, there's no way to tell if the interface changes or if we are actually clicking the wring things (unless we try and do something hacky like listen f
30.
by anerli 1y ago
Hey! We can add this pretty easily! We find that Gemini Pro 2.5 works the best as the planner model by a good margin, but we definitely want to support a variety of providers. I'll keep this in mind and implement soon! edit: tracking h

More ›