jtsaw

7 ms·

1.
by jtsaw 1y ago
there's also some open source ways to share spatial data as a website from QGIS like LizMap [1], MapStore [2], and Mundi [3] [1] https://www.lizmap.com/en/ [2] https://docs.mapstore.geosolutionsgroup.co
2.
by jtsaw 1y ago
I’d say it’s more like Waymo’s world model. The main actor uses a latent vector representation of the state of the game to make decisions. This latent vector at train time is meant to compress a bunch of useful information about the game. S
3.
Ethical Challenges Related to the NeurIPS 2024 Best Paper Award(var-integrity-report.github.io)
2 points by jtsaw 2y ago|0 comments
4.
by jtsaw 2y ago
I'm not sure they are highly correlated. A committee uses the same LLM with the same input context to generate different outputs. Given the same context LLMs should produce the same next token output distribution (assuming fixed model
5.
by jtsaw 2y ago
yea. We're definitely concerned about hallucinations and are using a variety of techniques to try and mitigate it (there's some existing discussion here, but using committees and sub-agents responsible for smaller tasks has helped
6.
by jtsaw 2y ago
one thing we're experimenting to help with the hallucinations/error rate issue is using a committee framework where we take a majority vote. If the error rate of 1 expert is 5%, then for a committee of 10 experts, the probability
7.
by jtsaw 2y ago
which website doesn't load for you?
8.
by jtsaw 2y ago
The product will automatically execute runbooks for you. So far we've focused on using runbooks customers already have, since they know they work for them. We've also added the ability to turn of automatic execution for cases like
9.
by jtsaw 2y ago
yea, we'd like to actually create these issues on a real cluster, but we couldn't figure out a good way of doing it at scale. The best alternative that we could think of was using an LLM that knows the root cause and could hopeful
10.
by jtsaw 2y ago
We're not using our AI Agent to determine if your answers are correct or not. We're just using something off the shelf.
11.
by jtsaw 2y ago
try to be as detailed as possible. With text sometimes it's hard to determine how close your answer was to the correct one.
12.
by jtsaw 2y ago
hmmm, not sure where the latency is coming from, might need to up the resources.
13.
by jtsaw 2y ago
We're hoping to expand the dataset into other SRE tasks that aren't kubernetes related. It's just what we've focused on for right now.
14.
by jtsaw 2y ago
yeah that makes sense. While the tech develops, our focus is on building an AI agent that can determine the root cause of an issue, which itself is an import step in fixing things.
15.
SREBench Competition(sreben.ch)
75 points by jtsaw 2y ago|25 comments