34 ms·
pg_flo looks like a very interesting project we might end up using. I like the archival to s3 and cheap versions of tools that get done at lower scale like GBs
by 2000swebgeek 2y ago
pg_flo looks like a very interesting project we might end up using. I like the archival to s3 and cheap versions of tools that get done at lower scale like GBs instead of TBs worth of data (Which is what I think Debezium does and something I can easily test locally)
The work/effort I need to put in with kafka etc., w/ Debezium is a short term effort, but evaluating the hassle.
Other solutions being evaluated by my team is peerdb - https://docs.peerdb.io/why-peerdb https://docs.peerdb.io/why-peerdb
- shayonj 2y agoThanks for checking it out - Curious are you syncing/storing the data in some specific format in s3?
- mritchie712 2y agopeerdb was acquired by clickhouse, so if you're syncing to a destination other than clickhouse, you may see support for it wane
- bzzzt 2y agoThere's a standalone version of Debezium nowadays which can publish directly to a NATS queue. No Kafka required anymore.