Y
HN Search
Hacker News Search
new
|
comments
|
top
|
jobs
shikhar
searching Neon…
1.
▲
2.
▲
3.
▲
4.
▲
5.
▲
6.
▲
5 ms
·
1.
▲
Show HN: Async NFS client library for Rust, without an OS mount point
(github.com)
4 points
by
shikhar
2mo ago
|
0 comments
2.
▲
Opbox: Real-time sync for plaintext files
(opbox.dev)
2 points
by
shikhar
2mo ago
|
0 comments
3.
▲
Serving Local AI on My Jetson Through Durable Streams
(s2.dev)
3 points
by
shikhar
3mo ago
|
0 comments
4.
▲
by
shikhar
4mo ago
OpenReplay is much more mature and full-featured, RePlaya is just the core session capture, listing, and replay functionality. OpenReplay has more dependencies, so self-hosting means running a full stack: Postgres, ClickHouse, Redis, and it
5.
▲
by
shikhar
4mo ago
Thanks! And agreed, session replays can be really useful to understand user behaviour such as product edge cases. On cost, it's running the collector Node app (I'd expect a few $ per month at low volume), and the S2 stream backend
6.
▲
Show HN: RePlaya – self-hosted browser session replay with live tailing
(github.com)
50 points
by
shikhar
4mo ago
|
8 comments
7.
▲
Shareable text box
(txt.box)
4 points
by
shikhar
4mo ago
|
0 comments
8.
▲
by
shikhar
5mo ago
I agree that future seems inevitable. We work on plumbing for that, s2.dev - would be very happy to collaborate.
9.
▲
Video Conferencing with Durable Streams
(s2.dev)
3 points
by
shikhar
6mo ago
|
0 comments
10.
▲
Coordinating Adversarial AI Agents
(s2.dev)
2 points
by
shikhar
7mo ago
|
0 comments
11.
▲
by
shikhar
8mo ago
KV store in Rust, backed by a disaggregated, replicated journal https://github.com/s2-streamstore/s2-kv-demo
12.
▲
by
shikhar
8mo ago
We run a copy using https://github.com/gabe565/ascii-movie , you can `nc starwars.s2.dev 23` It's our favorite way of demoing s2.dev, https://x.com/jrdi/status/2014318511120670859
13.
▲
by
shikhar
8mo ago
> Personally I'd add an application level hash to protect the integrity of the records but that's just me. The durability is for being able to replay the stream, a hash will not let you reconstruct the original message(s). If y
14.
▲
by
shikhar
8mo ago
Yes, that is a reasonable way to think about it! And as s2-lite is designed as a single-node system, there is a natural source of truth on what the latest records are for consuming in real-time.
15.
▲
by
shikhar
8mo ago
> Can this be used as an embedded lib instead of a separate binary as an API? Did not architect explicitly for that, but should be viable. You could use the `Backend` directly, is what the REST handlers call https://docs.rs&#x
16.
▲
by
shikhar
8mo ago
Very cool! Looking forward to catching up. Also checkout https://s2.dev/blog/kv-store
17.
▲
by
shikhar
8mo ago
We wanted S2 to be one API. Started out with gRPC, added REST - then realized REST is what is absolutely essential and what most folks care about. gRPC did give us bi-directional streaming for append/read sessions, so we added that as
18.
▲
by
shikhar
8mo ago
> Is this for like "making your own Twitch" or something, where streams have to scale to thousands-to-millions of consumers? Yes, this can be a good building block for broadcasting data streams. s2-lite is single node, so to sc
19.
▲
by
shikhar
8mo ago
This is fair question. A stream here == a log. Every write with S2 implementations is durable before it is acknowledged, and it can be consumed in real-time or replayed from any position by multiple readers. The stream is at the granularity
20.
▲
by
shikhar
8mo ago
It seems SL8 supports writing the WAL to local disk already https://github.com/slatedb/slatedb/issues/162 Will look into how to enable that option from s2-lite
21.
▲
by
shikhar
8mo ago
Shoutout to CodesInChaos for suggesting that instead of a mere emulator, should have an actually durable open source implementation – that is what we ended up building with s2-lite! https://news.ycombinator.com/item?id=42487
22.
▲
Show HN: S2-lite, an open source Stream Store
(github.com)
77 points
by
shikhar
8mo ago
|
20 comments
23.
▲
by
shikhar
8mo ago
Very cool! Would you consider making the streaming backend pluggable? s2.dev could make a lot of sense as a serverless option, and a self-hostable OSS implementation of the API is also coming soon. S2 is great for agent session-level stream
24.
▲
by
shikhar
9mo ago
It seemed like the kind of Jepsen outcome where folks would be considering alternatives, but yeah maybe it was not appropriate to plug here.
25.
▲
by
shikhar
9mo ago
The cloud offering is self-serve, no need to get on a call at all. An open source, self-hosted option is in progress https://github.com/s2-streamstore/s2?tab=readme-ov-file#s2-l...
26.
▲
by
shikhar
9mo ago
We do deterministic simulation testing https://s2.dev/blog/dst https://s2.dev/blog/linearizability We have also adopted Antithesis for a more thorough DST environment, and plan to do more with it.
27.
▲
by
shikhar
9mo ago
If you are looking for a serverless alternative to JetStream, check out https://s2.dev Pros: unlimited streams with the durability of object storage – JetStream can only do a few K topics Cons: no consumer groups yet, it's
28.
▲
by
shikhar
11mo ago
Postgres is a way better fit than Kafka if you want a large number of durable streams. But a flexible OLTP database like PG is bound to require more resources and polling loops (not even long poll!) are not a great answer for following live
29.
▲
by
shikhar
1y ago
multiplayer wall (iykyk) for HN: https://s2.dev/demos/y-s2?room=neon-canyon-7857
30.
▲
by
shikhar
1y ago
Yes, currently it has its own /fetch endpoint that then makes S3 GET(s) internally. One potential gotcha depending on how you are using it, an exact byte "Range" header is always required so that the request can be mapped to
More ›