grammr

6 ms·

1.
Three Sales Mistakes Software Engineers Make(pipelinedb.com)
3 points by grammr 8y ago|0 comments
2.
by grammr 8y ago
Performance depends heavily on the complexity of your continuous queries, which is why we don't really publish benchmarks. PipelineDB is different from more traditional systems in that not all writes are all created equal, given that c
3.
by grammr 8y ago
How aggregations are performed are determined entirely by your own continuous view definitions [0]. In this case I'm guessing you'd want to include a time-based column in the aggregation GROUP BY clause. And since PipelineDB is a
4.
by grammr 8y ago
PipelineDB co-founder here--I think this is a pretty fair take! I would also like to point out that the aggregate data stored in PipelineDB can still be further aggregated, processed, JOINed on etc. on demand as well. Since a continuous vie
5.
by grammr 8y ago
Sure! So stream-stream JOINs actually haven't been requested by users as much as you'd think. Users have generally been able to get what they need by using topologies of transforms [0], output streams, and stream-table JOINs. Cont
6.
by grammr 8y ago
I'm Derek, one of the co-founders--excellent question! The former. PipelineDB performs aggregations in memory on microbatches of events, and only merges the aggregate output of each microbatch with what's on disk. This is really
7.
by grammr 8y ago
This is precisely why PipelineDB has rich support for data structures such as HyperLogLog [0]. HLL's allow you to track distincts information using fixed-size HLLs that only grow to about 14KB while encoding uniques counts for billions
8.
by grammr 8y ago
The most impactful thing you can do here is ask the RDS team for this. If enough users ask them for it they'll eventually begin seriously considering it :)
9.
by grammr 8y ago
I'm Derek, one of the co-founders--great questions! > So you create a table, insert into it, and it's always empty. Is that right? That is correct. Streams can only be read by continuous queries (e.g. you can't even run a
10.
by grammr 8y ago
I'm Derek, one of the co-founders--that's an interesting way to frame it, I think that makes a lot of sense at a high level. We're in contact with the TSDB founders (awesome and super smart guys!) and are in the early stages
11.
by grammr 8y ago
I'm Derek, one of the co-founders--thank you! We're super happy with where Stride is at! We've continued to onboard customers in a few AWS regions and the infrastructure is rock solid at this point. Most users are ingesting 1
12.
by grammr 8y ago
We haven't looked too far into integrations with any existing systems at this point, but if there was significant user demand for it on both ends we'd definitely be open to it. One thing I will mention here is that we do have plan
13.
by grammr 8y ago
Hi there! I'm one of the PipelineDB founders. This description is correct. The unique thing about PipelineDB is that it doesn't store granular data. Once all aggregates are incrementally updated, the raw input rows as discarded an
14.
by grammr 10y ago
If you're open to sharing, I'd love to hear more about your potential use case. Please email me!
15.
by grammr 10y ago
Hello! I'm Derek, one of the PipelineDB co-founders. The way using PipelineDB feels to users has always been a principal consideration to us and how we make design decisions, so a psychological benefit isn't a second-class citiz
16.
PipelineDB 0.9.7 – Delta Streams and Towards a PostgreSQL Extension(pipelinedb.com)
87 points by grammr 10y ago|10 comments
17.
by grammr 10y ago
> Pipelinedb is annoying though in that it is a fork and not an extension. Hi, I'm one of the PipelineDB co-founders--thanks for using our product! Making PipelineDB an extension is the most consistent piece of feedback we've r
18.
by grammr 10y ago
Stride is a realtime analytics API built for scale and performance. It allows you to construct networks of continuous processing nodes that either materialize results (think high-throughput aggregation) or fire webhooks ("when this agg
19.
by grammr 10y ago
(Hi! I'm one of the founders of PipelineDB) PipelineDB will be a standard PostgreSQL extension[0] by release 1.0.0. Currently we're about to release 0.9.7, and each release after that will incrementally factor out PipelineDB into
20.
Announcing Stride – A Realtime Analytics API(pipelinedb.com)
8 points by grammr 10y ago|0 comments
21.
by grammr 11y ago
Author here. The post is pretty high level so I'm more than happy to answer any questions or elaborate on anything here.
22.
PipelineDB's Engineering Workflow(pipelinedb.com)
26 points by grammr 11y ago|3 comments
23.
by grammr 11y ago
There was a bug in the example. Fixed, thanks!
24.
by grammr 11y ago
We just updated http://www.pipelinedb.com/download/0.7.7/osx . Please shoot me an email (I'm Derek) if you have any issues installing this package. Thanks for your patience!
25.
by grammr 11y ago
Sorry about that, OSX packaging is a bit finicky right now. We'll publish a package with more sensible defaults very shortly.
26.
by grammr 11y ago
Hey Chad, PipelineDB co-founder here. PipelineDB certainly isn't intended to be the only tool in your data infrastructure. But whenever the same queries are being repeatedly run on granular data, those are the types of situations in wh
27.
by grammr 11y ago
Founder @ PipelineDB here (hi Slava!) Currently continuous views must read from a stream. However, in the very near future it will possible to write to streams from triggers, which would probably give you enough flexibility to model the beh
28.
by grammr 11y ago
PipelineDB (YC W14) | Systems Engineers and Frontend Engineers | San Francisco | Full time | jobs@pipelinedb.com We're on a mission to build a new type of database for a modern world in which information is constantly moving, and movin
29.
by grammr 12y ago
PipelineDB | Systems Engineer | San Francisco | Full time | jobs@pipelinedb.com We're on a mission to build a new type of database for a modern world in which information is constantly moving, and moving fast. PipelineDB runs SQL queri
30.
by grammr 12y ago
PipelineDB (YC W14) We are on a mission to build a new type of database for a modern world in which information is constantly moving, and moving fast. PipelineDB runs SQL queries continuously on large volumes of streaming data, giving compa

More ›