pauldix

6 ms·

1.
Duck Hunt: Moving Bauplan from DuckDB to DataFusion(bauplanlabs.com)
17 points by pauldix 10mo ago|1 comments
2.
by pauldix 11mo ago
I believe you could do this effectively with COBS (COmpact Bit Sliced signature index): https://panthema.net/2019/1008-COBS-A-Compact-Bit-Sliced-Sig... It's a pretty neat algorithm from a paper in 2019 for the app
3.
by pauldix 1y ago
I've been following this team's work for a while and what they're doing is super interesting. The file format they created and put into the LF, Vortex, is very welcome innovation in the space: https://github.com&#x
4.
LF AI and Data Hosts Vortex Project for Data Access for AI and Analytics(linuxfoundation.org)
19 points by pauldix 1y ago|1 comments
5.
by pauldix 1y ago
InfluxDB Founder & CTO here. We worked hard to support InfluxQL in 3.x and it supports the v1 write API. Admittedly, it will be a migration to move and we haven't yet built the tooling, but we felt it was important to get the 3.0 r
6.
by pauldix 1y ago
Right now this is just in the AI Studio web UI. I have a few command line/scripts to put together a file or two and drop those in. So far I've put in about 450k of stuff there and then over a very long conversation and iterations
7.
by pauldix 1y ago
My experience so far with Opus 4 is that it's very good. Based on a few days of using it for real work, I think it's better than Sonnet 3.5 or 3.7, which had been my daily drivers prior to Gemini 2.5 Pro switching me over just 3 w
8.
10 Years of Stable Rust: An Infrastructure Story(rustfoundation.org)
13 points by pauldix 1y ago|2 comments
9.
InfluxDB 3 Core and Enterprise GA(influxdata.com)
5 points by pauldix 1y ago|1 comments
10.
by pauldix 1y ago
We're very excited about this release, over 4 years in the making. Over that time we adopted, contributed to, and helped lead parts of what we're calling the FDAP stack: Apache Arrow Flight, DataFusion, Arrow, and Parquet. We wrot
11.
by pauldix 2y ago
Blog post author and InfluxDB creator and CTO here. Happy to answer any questions here or provide more technical detail.
12.
by pauldix 2y ago
Our intention with InfluxDB Core is that it's useful to large audience. Just not the group of people seeking a historical TSDB. It's a collector, processor, and recent data TSDB. If you're familiar with the TICK stack from ou
13.
by pauldix 2y ago
Core doesn't index the metadata so it uses less RAM for higher cardinality data. However, if you have 100M series and you're writing to all of them at the same time, you're going to need some amount of RAM just to buffer it a
14.
by pauldix 2y ago
I talk a little bit more about this comment on a different submission of this post: https://news.ycombinator.com/item?id=42704526 Can you say more about your use case?
15.
by pauldix 2y ago
2.0 was single server. Our paid offering of that is a usage based cloud platform that’s highly available and managed.
16.
by pauldix 2y ago
We're open core and have been since 2016. We've deliberately limited the scope of what the open source project is supposed to do. It should be great at this use case of collecting processing, storing, and querying recently buffere
17.
by pauldix 2y ago
Post author, cofounder and creator of InfluxDB here. Happy to answer questions in this thread. I'm guessing there will be questions about the 72 hour limit. There are two things we're looking at: First, we're considering givi
18.
by pauldix 2y ago
That's right, compaction is the way to solve for performance over longer time ranges. This is what we have in our commercial Enterprise product.
19.
by pauldix 2y ago
We think that Core will fill some of the use cases of previous OSS versions of InfluxDB, but not all. But we also expect that Core will be useful in many more places that previous OSS versions of InfluxDB were not. So Core isn't intend
20.
by pauldix 2y ago
The data is persisted as Parquet files on object storage (or locally attached disk) and is queryable from any tool that can read Parquet. It isn't evicted by the DB, the 72 hour limit is just what is visible by the running database pro
21.
by pauldix 2y ago
Creator of InfluxDB and cofounder and CTO here. Happy to answer any questions. We're very excited to finally have this release in public. It's been years in the making and we hope to iterate quickly on any feedback.
22.
by pauldix 2y ago
Second this one, it's incredible in the level of research and detail.
23.
by pauldix 2y ago
Great Fortune, a book about the making of Rockefeller Center is one of my favorites.
24.
CMU Database Building Blocks Seminar Series – Fall 2024(db.cs.cmu.edu)
2 points by pauldix 2y ago|0 comments
25.
FDA advisors voted against MDMA therapy – researchers are still fighting for it(bbc.com)
9 points by pauldix 2y ago|0 comments
26.
How Good Is Parquet for Wide Tables (Machine Learning Workloads) Really?(influxdata.com)
3 points by pauldix 2y ago|0 comments
27.
Bento: Open-source fork of the project formerly known as Benthos(warpstream.com)
219 points by pauldix 2y ago|68 comments
28.
Using Parquet's Bloom Filters(influxdata.com)
53 points by pauldix 2y ago|7 comments
29.
by pauldix 2y ago
DataFusion, a SQL parser, planner, optimizer, and execution engine written in Rust, is now a top level Apache project! This shows the continued growth and momentum of the project and community. We've been building InfluxDB v3 on DataFu
30.
Apache Arrow DataFusion Is Now Apache DataFusion(arrow.apache.org)
2 points by pauldix 2y ago|1 comments

More ›