djk447

9 ms·

1.
by djk447 4y ago
NB: I work at Timescale. TimescaleDB is a PostgreSQL extension, just to be clear.
2.
by djk447 4y ago
Disclosure, I work at Timescale. We are kindred spirits I think! I did this too [0] a while back at a previous company and it actually served as part of the inspiration for our compression work! It's fun, but a bit difficult to query a
3.
by djk447 4y ago
Disclosure, I work at Timescale. Though I didn't write this post, I'd imagine at least part of it is that it's already nearly 4000 words and a 15 minute read and we just didn't want to add another set of things to it, to
4.
by djk447 4y ago
And glad you liked the article!
5.
by djk447 4y ago
NB: Post author So we thought about doing something like that with multinode where each of the nodes would maintain their own materialization but abandoned it for that very reason it’s very, very difficult to maintain any sort of consistenc
6.
by djk447 4y ago
NB: Post author Yes. this is generally handled automatically, there may be times though where you want to essentially pause refreshing the view for a while while you do some backfilling and then eventually let it catch up, especially if you
7.
by djk447 4y ago
NB: Post author I'm not 100% sure I understand what you're asking, but essentially something that would look for data modifications and at query time run the query over the older regions as well? If that's what you're as
8.
by djk447 4y ago
NB: post author here! Thanks yes! Totally true, was thinking about including some of that but it felt like it opened a can of worms about join types and why certain things would be included and others not (ie inner join needs to see that it
9.
by djk447 4y ago
NB - Timescale person here. Totally true! It's also a much harder problem :) One of the things that we try to focus on at Timescale is figuring out how we can simplify problems based on the specific needs of time-series data. Postgres
10.
by djk447 5y ago
Totally fair and something that I'm actually forming a team to work on! We're starting with some very foundational material [1], that may well be review and it's not as formal / professional as Mongo University or the li
11.
by djk447 5y ago
(NB: Post author here) Glad you liked it! Please do give us feedback especially about how it is to use with your library…will be intrigued to see how they interact. Also , cool to hear about the library more generally, any particularly good
12.
by djk447 5y ago
(NB: Post author here!) This is all true! We have a bit more info on that choice in this post [1]. But in general the Toolkit extension [2] is meant to have a bit of a lighter touch than the core TimescaleDB extension [3], it's meant
13.
by djk447 5y ago
Sorry I missed before was out grabbing lunch, answered above!
14.
by djk447 5y ago
(NB Post author) Kinda. It's close to that, except in order to make it do that we had to actually make the functions return special types so it's more equivalent to something like SELECT device_id, apply(sum, apply(abs, apply(delt
15.
by djk447 5y ago
Oh yeah, and building on this, this is also the source of the ability to actually store the pipeline element in the database, say in a column and apply it later that I mentioned in a comment below. That's one of the cool mind-bending t
16.
by djk447 5y ago
The docs have a bit more on it [1]. The $$ is really just a dollar quoted string[2], you can use any sort of string in there, but dollar quoting just makes it a lot easier to read. On your other question, not right now, but if it's som
17.
by djk447 5y ago
(NB: post author here) Yep! you got it exactly right! We're doing it for syntax first and then hopefully go back and start doing interesting performance optimizations on top. There are definitely some things we're thinking about.
18.
by djk447 5y ago
(NB: Post author here) Yeah. It's a bit mind bending I guess. Will try to explain but might just need a longer format thing and we will probably do a piece on this in the future. Essentially, each function returns a special "Pipel
19.
by djk447 5y ago
(NB: Post author here) This is in the TimescaleDB Toolkit extension [1] which is licensed under our community license for now and it's not available on DO. It is available on our cloud service fully managed. You can also install it and
20.
by djk447 5y ago
(NB: post author here) We're planning on providing various outputs, json is definitely one format we'd want to support, want to file a github issue with the layout that you'd want and we can start getting some feedback to imp
21.
by djk447 5y ago
(NB: Post author here) We're thinking about doing a post on them at some point in the future! Any specific questions we should answer?
22.
by djk447 5y ago
(NB: Post author here) Yeah. CTEs definitely make it a bit easier to read, though some people get more confused by them, especially because they don't exist in all SQL variants. And totally agree with that last bit! We want to see if i
23.
by djk447 5y ago
(NB: Post author here) So this is a great question and we may do a whole post on this at some point in the future. There are definitely ways to shoot yourself in the foot, but hopefully we can avoid at least some of them. The main way this
24.
by djk447 5y ago
(NB: Post author here) Totally understand the concern, for now, it’s just for a particular datatype, all of the other operations are happening normally inside your query and you can still use window functions... And btw, I love window funct
25.
by djk447 5y ago
(NB: Post author here) Yes! You can use the `delta()` element followed by a `filter()` with a lambda for looking for negative numbers I think!
26.
by djk447 5y ago
(NB: Post author here) We don't have many Haskell programmers, we mostly work in Rust, C and Go, but we're always open to new things... This is pretty Postgres specific. From the beginning Postgres has focused on extensibility and
27.
by djk447 5y ago
Thanks! messed up the formula but had it right in the text :( Fixed now.
28.
by djk447 5y ago
Thanks! Will get that fixed!
29.
by djk447 5y ago
NB: Post author here. Interesting will have to take a look! Thanks for sharing!
30.
by djk447 5y ago
NB: Post author here. Glad you liked it! I was so excited to actually be able to get to use Desmos for something work wise, I've been wanting to do it for years!

More ›