okwasniewski

5 ms·

1.
Show HN: Unbox-AI Visualize your AI traces like a JavaScript bundle(github.com)
2 points by okwasniewski 23d ago|0 comments
2.
by okwasniewski 3mo ago
We found gemini 3 flash to be the best model as of now, when it comes to bang for the buck, GPT 5.5 is also a bit more expensive than 5.4, if we run tests at scale it has to be affordable. Once a newer model that fits into the criteria is r
3.
by okwasniewski 3mo ago
We've been doing quite a lot of context engineering and optimizations to make sure it's not as expensive. The subsequent runs are faster because we cache the trajectory of the agent (not the whole test run yet, as we want to keep
4.
by okwasniewski 3mo ago
Currently, only iOS, but we can add iPadOS too!
5.
by okwasniewski 3mo ago
Happy to hear that!
6.
by okwasniewski 3mo ago
Yeah, we have all of them. I saw it too where in bigger companies our emails were going straight to spam. Will migrate to it soon
7.
by okwasniewski 3mo ago
Unfortunately from our experience tests don’t scale as well as code. First of all, static tests are very brittle: you rely on selectors, need wait times, and can’t really test a lot of dynamic content (think AI chats/interactions). The
8.
by okwasniewski 3mo ago
Our approach is heavily focused on agents, both for executing tests and for managing the platform. We want to provide the best and simplest way to conduct agentic testing, with a strong focus on details. It looks like their platform also re
9.
by okwasniewski 3mo ago
We support both web and mobile, which is what a lot of companies prefer, just one agent for both. Also, I'm pretty sure Revyl relies only on vision models, which tend to be slower. We built the platform around a hybrid approach that co
10.
by okwasniewski 3mo ago
Unfortunately from our experience tests don’t scale as well as code. First of all, static tests are very brittle: you rely on selectors, need wait times, and can’t really test a lot of dynamic content (think AI chats/interactions). The
11.
by okwasniewski 3mo ago
I feel like new AI model releases will only allow our agents to do more in-depth testing; the space still has a lot of room to grow. Quality assurance is way more complicated than just clicking around a UI. Regarding the other question: not
12.
by okwasniewski 3mo ago
Thank you! That's the goal
13.
by okwasniewski 3mo ago
We use agents to navigate the app, making real-time decisions based on its state. I prefer to compare it more to a manual QA engineer than to static e2e tests. We spent a lot of time on the harness to make sure the results are reliable. Thi
14.
by okwasniewski 3mo ago
Thank you!
15.
by okwasniewski 3mo ago
We are thinking whether to change this.. We also have testerarmy.com/.ai
16.
by okwasniewski 3mo ago
Yes! We spent quite a lot of time on this, and we are currently creating a test plan based on PR changes and sending an agent to verify it. We have some customers who are only using this feature.
17.
by okwasniewski 3mo ago
Unfortunately from our experience tests don’t scale as well as code. First of all static tests are very brittle, you rely on selectors, need wait times and can’t really test a lot of dynamic content (think AI chats/interactions). Then
18.
by okwasniewski 3mo ago
Yes, it works for any framework. We just get the built native binary and run it in the cloud. Regarding pricing, the self serve options are currently only for lower usage. We will add more plans further down the line. Currently the most pop
19.
Launch HN: TesterArmy (YC P26) – Agents that test web and mobile apps(tester.army)
132 points by okwasniewski 3mo ago|69 comments
20.
Lessons from Building an Autonomous QA Agent(tester.army)
3 points by okwasniewski 5mo ago|0 comments