Y
HN Search
Hacker News Search
new
|
comments
|
top
|
jobs
zombodb
searching Neon…
1.
▲
2.
▲
3.
▲
4.
▲
5.
▲
6.
▲
6 ms
·
1.
▲
Tin: A Text INdex for Postgres
(planetscale.com)
15 points
by
zombodb
1d ago
|
0 comments
2.
▲
by
zombodb
1y ago
Shout out to grapeseed oil
3.
▲
by
zombodb
2y ago
Yup. Just under a 501c3 to help ensure pgrx outlives us. Huge thanks to TCDI (www.tcdi.com) for continuing to fund development.
4.
▲
by
zombodb
2y ago
Y'all have built something cool. I'm excited to see where it goes from here. If there's anything the pgrx team can do to help, just let us know.
5.
▲
by
zombodb
2y ago
If you build it, they'll come. The only limit is yourself!
6.
▲
by
zombodb
3y ago
Nice deck, Ryan! And thanks for the mentions. ;)
7.
▲
by
zombodb
3y ago
I think maybe what you’re really looking for are the files here: https://github.com/pgcentralfoundation/pgrx/tree/c2eac033856... Those are the internals we currently expose as unsafe “sys” bindings. As we&#x
8.
▲
by
zombodb
3y ago
I don’t think we even expose the TableAM APIs? They are incredibly hard to generate bindings for from the C headers — lots of inline functions and complex #define macros. We have an ambitious goal with pgrx and it’s going to take many year
9.
▲
by
zombodb
3y ago
Thank you. I’ll pass this on to the team.
10.
▲
by
zombodb
3y ago
If you’re aware of bugs that fall within plrust’s domain we’d appreciate any and all reports via GitHub!
11.
▲
by
zombodb
4y ago
Always nice to see pgx being used in the wild! Awesome work.
12.
▲
by
zombodb
5y ago
I don’t pay any attention to what the cloud providers are doing. I have no control over them so….. eh. ZDB is still alive and well but I have a real job now too.
13.
▲
by
zombodb
5y ago
I can definitely reword that if it's confusing.
14.
▲
by
zombodb
5y ago
> Doing so would require ElasticSearch to reach consensus on every read/write ZomboDB only requires that ES have a view of its index that's consistent with the active Postgres transaction snapshot. ZDB handles this by ensuring
15.
▲
by
zombodb
5y ago
I wonder what the ZomboDB developers are up to now? What great text-search-in-postgres things could they be secretly working on?
16.
▲
by
zombodb
6y ago
https://github.com/zombodb/pgx/releases/tag/v0.0.7 !boom!
17.
▲
by
zombodb
6y ago
I'd be inclined to agree. That said, it'd be easy to prototype with pgx, assuming that compression library exists in the Rust ecosystem too?
18.
▲
by
zombodb
6y ago
I've noodled the idea of a pl/pg_rust, but the whole "Cargo.toml" and downloading dependencies from the internet seems bad. I see what you're saying about no_std tho. Could be doable.
19.
▲
by
zombodb
6y ago
That is interesting. pgx does a lot of that too, but for only pg10/11/12. And then it post-processes the bindings and builds a "common.rs" for symbols that are identical across versions. That way you can target all thre
20.
▲
by
zombodb
6y ago
blush
21.
▲
by
zombodb
6y ago
Sure! Top is Postgres, bottom is pgx, after running each 5 times... test=# SELECT count(*) FROM (SELECT generate_series(1, 10000000)) s; count ---------- 10000000 (1 row) Time: 399.630 ms test=# SELECT
22.
▲
by
zombodb
6y ago
Yes there is. It's not documented/example'd yet tho. There's a derive macro called #[derive(PostgresType)]. Combine that with serde's Serialize, Deserialize, and you're gtg. I'm going to be working on mo
23.
▲
by
zombodb
6y ago
Fair. With pgx, however, Rust "panic!"s are translated into standard Postgres "ERROR"s, such that instead of crashing, only the current transaction aborts. So while you're pretty much correct in general, pgx handle
24.
▲
by
zombodb
6y ago
That's a great question, and one probably best answered over on pgx's GitHub page. But! I plan on adding a command to "cargo-pgx" to package up the extension for you into a directory structure (or tarball, maybe). The i
25.
▲
by
zombodb
6y ago
One more follow-up... The top one is pgx, the bottom is Postgres. So there's a little room for improvement here with pgx, but that's okay for a v0.0.3 release. test=# select count(*) from srf.generate_series(1, 10000000);
26.
▲
by
zombodb
6y ago
Thank you! If you decide to jump into it, definitely let us know any pain points you have. It takes a bit of time to work out the kinks in a thing like this.
27.
▲
by
zombodb
6y ago
As a follow-up. Here's what Postgres' "generate_series" function looks like with pgx: https://github.com/zombodb/pgx/blob/0803bd3aa2f8ef2bd80d2e03... And here's what you'd have
28.
▲
by
zombodb
6y ago
re: v0.0.3 -- sure. I just published it last night. We've been working on it since November last year, and have now fully ported ZomboDB to it. It's proving out nicely, but keep in mind that Postgres' internals are infinitel
29.
▲
by
zombodb
6y ago
I've looked into them. It seems they're designed to work within a single process, and it's not quite clear to me how sharing the underlying data files across postgres backends (even with proper Postgres locking) would work.
30.
▲
by
zombodb
6y ago
Yeah, "rich data types" is a good point. pgx provides a #[derive(PostgresType)] macro that lets you represent any normal Rust struct (that serde_cbor can (de)serialize) as a Postgres type. You write no code. It even generates all
More ›