conormccarter

8 ms·

1.
by conormccarter 12d ago
> having never written a storage engine before AFAIK The guy is currently a micro-celebrity for the storage engine he wrote: https://cursor.com/blog/git-at-any-scale
2.
Building table-aware, partition-aware physical replication for Iceberg tables(prequel.co)
7 points by conormccarter 20d ago|0 comments
3.
Turbopuffer crossed $100M run-rate in March(twitter.com)
3 points by conormccarter 4mo ago|0 comments
4.
Ex-GitHub CTO on Git internals(twitter.com)
2 points by conormccarter 5mo ago|0 comments
5.
by conormccarter 7mo ago
I fully agree in spirit, but in practice, read-replica's have some edge cases that are hard to control for. Namely, the incentives aren't fully aligned between the database host and consumer, and that dynamic can lead to some diff
6.
by conormccarter 8mo ago
Hydrargyrum medium-src iodide lamps are an alternative (artificial sun lights for movie sets), but you'll want a good AC unit in your office
7.
by conormccarter 1y ago
Congrats on the launch! I'm one of the cofounders of Prequel (I saw our name in the feature grid - small nit: we do support self-hosting). This is definitely a problem worth solving - the market is still early and I'd bet the risi
8.
Building cross-cloud identity federation in Go for secure data sharing(prequel.co)
17 points by conormccarter 3y ago|0 comments
9.
by conormccarter 3y ago
Prequel | https://prequel.co | Senior Software Engineer | Full Time | GoLang, Postgres, Typescript, React, K8s | $150k-$180k + equity | ONSITE in NYC Prequel is an API that makes it easy for B2B companies to connect and sync dat
10.
ConfigDB: From chaos to confidence with our unified app config stack(plaid.com)
1 points by conormccarter 3y ago|0 comments
11.
Material Security Uncovered a Vulnerability in the Gmail API(material.security)
2 points by conormccarter 3y ago|0 comments
12.
Optimizing HDFS with DataNode Local Cache for High-Density HDD Adoption(uber.com)
2 points by conormccarter 3y ago|0 comments
13.
by conormccarter 4y ago
Hey HN -- Conor here, aka the guy from the demo. Happy to answer any questions you have!
14.
by conormccarter 4y ago
Oh, yeah, it probably does make sense for the warehouses to make that part easier, at least for the more popular transactional db choices. You may have seen Google/BigQuery recently announced their off the shelf replication service for
15.
by conormccarter 4y ago
Hey Ian, great to hear from you – thanks for the note, and hope you're doing well!
16.
by conormccarter 4y ago
Just saw and sent you a note – would love to hear more!
17.
by conormccarter 4y ago
Snowflake has made it really easy to share to other Snowflake instances, and the other major cloud data warehouses are working on similar warehouse specific features as well. This makes sense because it can be a major driver of growth for t
18.
by conormccarter 4y ago
Thanks for watching and for the kind words! Re 1. – it’s definitely on the roadmap – we’re planning on getting to it in Q4/Q1, but we can move it up depending on customer need. Re 2. – for tables without a tenant ID column, we suggest
19.
by conormccarter 4y ago
Re: scale – we do handle billions of rows! As you can imagine, exact throughput depends on the source and destination database (as well as the width of the rows) but to give you a rough sense – on most warehouses, we can sync on the order o
20.
by conormccarter 4y ago
Thank you! And exactly right – Postgres, Snowflake, BigQuery, Redshift, and Databricks are the sources we support today. We also have some streaming sources (like Kafka) in beta with a couple pilot users. At this point, it's fairly neg