dm03514

18 ms·

1.
Show HN: SQLFlow (DuckDB for streaming data) Go Rewrite 10x Throughput(turbolytics.io)
2 points by dm03514 16d ago|0 comments
2.
by dm03514 1mo ago
<3 duckdb run realtime analytics pipeline using a (moderately popular) stream processing engine I built on top of DuckDB. Looking forward to what duckdb provides in terms of perf out of the box! https://github.com/turboly
3.
by dm03514 6mo ago
Working on chain of custody for financial transactions! Our first offering is OrderProof which records Shopify transaction evidence and generates PDF to help merchants streamline chargeback disputes. https://turboops.io/prod
4.
LLM as an Engineer vs. a Founder?
2 points by dm03514 7mo ago|1 comments
5.
by dm03514 8mo ago
https://on-systems.tech/
6.
by dm03514 9mo ago
TurboOps.io - a workflow engine for humans! https://turboops.io/platform/public-tracker Our first offering is a tracker for makers, small businesses and contractors to show job status. Create a real time status page fo
7.
Show HN: Tools for Humans – Public Tracker for Workflows(turboops.io)
7 points by dm03514 9mo ago|0 comments
8.
by dm03514 9mo ago
Ha Yes! A pipeline assumes a "batch" of data, which is backed by an ephemeral duckdb in memory table. The goal is to provide SQL table semantics and implement pipelines in a way where the batch size can be toggled without a change
9.
by dm03514 9mo ago
Oh yes!! I've seen this a couple times. I am far from an expert in tributary so please take with a grain of salt. Based on the tributary documentation, I understand that tributary embeds kafka consumers into duckdb. This makes duckdb t
10.
by dm03514 9mo ago
Stream to stream joins are NOT currently supported. This is a regularly requested feature, and I'll look at prioritizing it. SQLFlow uses duckdb internally for windowing and stream state storage :), and I'll look at extending it t
11.
Show HN: DuckDB for Kafka Stream Processing(sql-flow.com)
77 points by dm03514 9mo ago|13 comments
12.
Show HN: Librarian: A Modern Alternative to Kafka Connect(github.com)
3 points by dm03514 10mo ago|0 comments
13.
by dm03514 10mo ago
Great Article! This is also timely for me, I spent all last week deep in the postgres documentation learning about replication (wish I had this article). I'm building kafka connect (i.e. Debezium) compatible replication: https:/&
14.
by dm03514 10mo ago
Still hacking on some data tools: DuckDB for stream processing: https://github.com/turbolytics/sql-flow Lightweight kafka stream processing using DuckDB as the execution engine. 300MiB runtime can easily handle thousan
15.
by dm03514 1y ago
How are you defining “B2C businesses on Main Street.” The reason I’m wondering is because it’s striking how much more financially challenged my Main Street is compared to Vc texh. I see so much opportunity for a small medium business consul
16.
by dm03514 1y ago
Productionizing duckdb :) I built a streaming tool around duckdb that allows for high performance stream processing and a rich connector ecosystem: https://github.com/turbolytics/sql-flow Building a company around a to
17.
Show HN: Stream Kafka into Ducklake
2 points by dm03514 1y ago|0 comments
18.
by dm03514 1y ago
Built a stream processing engine using duckdb https://github.com/turbolytics/sql-flow It has some interest, unfortunately building tools as a business strategy is rough. Beginning to work on first actual product! More
19.
by dm03514 1y ago
I just started using hurl a couple months ago. For my uses it's great that it has both test suite mode and individual invocation mode. I use it to execute a test suite of HTTP requests against a service in CI. I'm not a super big
20.
by dm03514 1y ago
Looked forward to move out day at state university in early 2000s. The university would rent dumpsters and place in the common outdoor areas. The dumpsters had the end door that would open so it was easy to walk inside of them without climb
21.
by dm03514 1y ago
Me too :) - state university in early 2000s , would take the textbooks from the trash walk them over to the textbook exchange and pocket ~$100 for ~3 hours of work
22.
by dm03514 1y ago
Duckdb for streaming data! https://github.com/turbolytics/sql-flow I think the industry lacks lightweight fully featured stream processing solutions. I think it’s either heavyweight jvm or bespoke custom solutions Sqlf
23.
by dm03514 1y ago
For the us, I feel like it’s late stage individualism. This is what happens I think when people prioritize themselves over their communities, I think we have less dependence on our communities than ever thanks to the internet and being able
24.
by dm03514 1y ago
Yes here too, and I’m guilty of the focus on family over friends, but also my peers are too and it creates a bunch of people that used to be close that never really see each other because they prioritize their immediate family
25.
by dm03514 1y ago
I def agree that there is a pattern to most data pipelines: - read from an input (source) - perform some sort of processing - write the data to some output (sink) This may either be batch or continuous (stream). The inputs may change, the o
26.
by dm03514 1y ago
Congratulations, second streaming acquisition in recent memory, after benthos. Arroyo on paper looks amazing, high performance, advanced streaming primitives like windows and joins. I think / hope the foundations provide a long term al
27.
by dm03514 1y ago
“The most common diagnosis associated with sudden cardiac arrest was coronary artery disease.” I wonder the fitness levels of the people that experienced cardiac arrests. Like were these first time runners that signed up to run a marathon?
28.
by dm03514 1y ago
“That single gram of silica gel could have an internal surface area of eight hundred square meters—the size of almost two basketball courts.“ Can someone help explain this? I’m having a hard time wrapping my head around this. The tiny packe
29.
by dm03514 1y ago
In my experiences of living in suburbs for 30 years, I’ve seen the default is to ignore neighbors. I don’t really get this. Our communities have so much in common and so much overlap, we shop at the same stores, go to the same parks, get st
30.
by dm03514 1y ago
Amazing! Thank you for the update, this will be huge

More ›