bitsondatadev

5 ms·

1.
by bitsondatadev 2y ago
Is there any market or industry that you would like to work in? Like the domain itself is interesting to work in?
2.
by bitsondatadev 4y ago
Trino is a nice query engine solution if you want to not just run SQL on Elasticsearch but also want to be able to join data from Elasticsearch with data in other systems Trino supports. It also supports raw elasticsearch queries that are s
3.
by bitsondatadev 4y ago
Check out Trino Summit 2022 to learn more about the federated query engine and "Federate 'em all". Talks include Lyft, Shopify, Astronomer, Starburst, and much more to be announced in the coming weeks! Trino (formerly PrestoS
4.
Apache Iceberg creator, Ryan Blue, on Trino and Iceberg(trino.io)
2 points by bitsondatadev 4y ago|2 comments
5.
by bitsondatadev 4y ago
In this episode of Trino Community Broadcast, we interview Ryan Blue to discuss the latest innovations in Apache Iceberg, why choose Apache Iceberg, latest Trino innovations and much more. Disclaimer: I am a Trino contributor.
6.
Test data pipelines with Great Expectations and Trino(trino.io)
8 points by bitsondatadev 4y ago|0 comments
7.
Trino and dbt: excellent fit for cross-database ELT(towardsdev.com)
2 points by bitsondatadev 4y ago|0 comments
8.
Open source distributed SQL query engine turns ten years old(trino.io)
7 points by bitsondatadev 4y ago|0 comments
9.
by bitsondatadev 4y ago
Yeah, though a lot of Fivetran customers are likely the type that would go all in on paying for a conventional data warehouse where people using open source stacks may be the ones that are using open ingestion alternatives. We see a pretty
10.
by bitsondatadev 4y ago
Also, you can keep track of all the BQ progress here: https://github.com/trinodb/trino/issues/6867
11.
by bitsondatadev 4y ago
For managing difrerent workloads, check out this blogs and this videos from Shopify, Salesforce, Goldman Sachs, and Electronic Arts, respectively: - https://engineering.salesforce.com/how-to-etl-at-petabyte-sc... - https:&
12.
by bitsondatadev 4y ago
Clickhouse is a realtime system where Trino is a batch-oriented system. There are tradeoffs for doing realtime vs batch. Realtime is generally more expensive to run as you process every individual row as it comes, batch is when you can deal
13.
by bitsondatadev 4y ago
Thanks for the shoutout! :) If you want to get started with Trino, here's a repo I created to do so: https://github.com/bitsondatadev/trino-getting-started
14.
by bitsondatadev 4y ago
If you want to try an SaaS Athena alternative that's backed by Trino you can check out Starburst Galaxy: https://www.starburst.io/platform/starburst-galaxy/ Full disclosure I work at Starburst.
15.
by bitsondatadev 4y ago
Check out this PR. I believe we may have tackled this one but you'd need to try it out on Trino: https://github.com/trinodb/trino/pull/1415
16.
by bitsondatadev 4y ago
I mean, the hive migration path is one thing. Now that Iceberg is taking over the old Hive model, data lakes are all the rage again. The other thing I would say is that Trino and Presto are not one-trick ponies or just hive replacements. Th
17.
by bitsondatadev 4y ago
<3
18.
by bitsondatadev 4y ago
btw, if you want to know the backstory on why Presto is now called Trino, here's the article: https://trino.io/blog/2022/08/02/leaving-facebook-meta-best-...
19.
by bitsondatadev 4y ago
Ah this makes sense. This is similar to what Elasticsearch shards do.
20.
by bitsondatadev 4y ago
Why is this just near real-time? If we're talking about Flink + Kafka, isn't that considered really real-time? Maybe near real-time is just considering ingestion and query latency?
21.
by bitsondatadev 4y ago
Yup, I would say Athena is the most commonly used version of Trino/Presto out there. Also, if anyone is reading this wondering which version Athena comes from, it's a release that was common to both Presto and Trino before the for
22.
by bitsondatadev 4y ago
It’s a query engine that can talk to multiple databases and run join queries across tables from multiple sources. It also runs as a faster alternative to Hive.
23.
by bitsondatadev 4y ago
Starburst employee here so take my view for what it’s worth. A few points: Starburst spun out from some contributors working on Teradata’s Presto distro in 2017. The Presto creators left Facebook in late 2018 and worked on building the new
24.
by bitsondatadev 4y ago
That’s exactly the point of the post too. Sometimes business and open source align and other times they do not. Trino was created as the project and community the puts community and individuals that contribute as the owners. It’s not bad or
25.
by bitsondatadev 4y ago
The latter tree-no like neutrino and the website is https://trino.io lol.
26.
by bitsondatadev 4y ago
Yeah, I think that was one of the reasons why Facebook enforcing the trademark ended up being a blessing in disguise. It at least made the forks clearer. Now Trino is gaining more momentum but it takes a while for the brand recognition to s
27.
by bitsondatadev 4y ago
Hah! It may have very well looked like that given the time constraints they were working with.
28.
by bitsondatadev 4y ago
Facebook has their own internal reviews for their own internal projects and forks of open source projects. I think the issue came down to Facebook adding anyone working on the project to have the ability to merge code to the open source pro
29.
by bitsondatadev 4y ago
I'm curious to know if this is anyone's first time hearing about Trino?
30.
by bitsondatadev 4y ago
Here's the renaming article that clarifies this... https://trino.io/blog/2020/12/27/announcing-trino.html Months after this consolidation, Facebook decided to create a competing community using The

More ›