atwong

13 ms·

1.
by atwong 1y ago
Hmm... US has 330 million. JP has 120 million in the size of california. They have a long way to go.
2.
Data lakehouse Onehouse nabs $35M to capitalize on GenAI revolution(techcrunch.com)
9 points by atwong 2y ago|1 comments
3.
by atwong 2y ago
One company looking to capitalize on this is Onehouse, a three-year-old Californian startup founded by Vinoth Chandar, who created the open source Apache Hudi project while serving as a data architect at Uber. Hudi brings the benefits of da
4.
by atwong 2y ago
The idea of running workloads on the cheapest compute platform is interesting.
5.
by atwong 2y ago
Location: Irvine, CA Remote: Preferred, but Hybrid fine within 20 miles of Irvine, CA Willing to Relocate: No Technologies: Strongest in Java, Kubernetes, MongoDB, SQL, Kafka, Data Lakehouse (Wrote Java apps as a developer lead at IBM, was
6.
by atwong 3y ago
Data-warehousing becomes ubiquitous and open-source with Iceberg. Powerful open-source RTA (real-time-analytics) engines like ClickHouse are designed for crunching numbers as fast as possible. How can you use Iceberg and ClickHouse together
7.
by atwong 3y ago
Hm... I'm not sure if I see anything more than I can get from https://ossinsight.io/analyze/StarRocks/starrocks#overview
8.
Ask HN: Looking for recommendations on Analytics tools for user behavior
1 points by atwong 3y ago|0 comments
9.
Ask HN: Tool to compare OSS communities to each other
3 points by atwong 3y ago|4 comments
10.
by atwong 3y ago
intake of 450,000 entries per second, and a daily data volume of 12TB * Query performance improved 4x. * Query P90 time improved from 500ms to 150ms. * The cluster size reduced from 60+ nodes to less than 10 nodes. * Data storage volume red
11.
by atwong 3y ago
It is my belief that data lakehouse analytics will replace data warehouse analytics in the future. Data lakehouses offer a number of advantages over traditional data warehouses
12.
by atwong 3y ago
Before we start, what is TPC-H and TPC-DS and why are they important? TPC-H and TPC-DS are important because they are industry standard benchmarks for measuring the performance of data warehouse and big data systems. They are widely used by
13.
by atwong 3y ago
It only works with Clickhouse... ugh.
14.
by atwong 3y ago
Scale. DuckDB chokes at a certain point (just like sqlite isn't the same as mysql or postgresql in terms of scalability). That's why they're building a better/bigger version.
15.
by atwong 3y ago
Lots of other options in this space. https://atwong.medium.com/top-open-source-alternatives-to-ol...
16.
by atwong 3y ago
MongoDB did something similar. It's open source for you to extend and host yourself but you can't build a cloud service for it.
17.
by atwong 3y ago
Lots of other competitors like Apache Pinot, Apache Druid and StarRocks are fighting in that default analytics space.
18.
by atwong 3y ago
All the main players in Clickhouse's space like Apache Pinot, Apache Druid, StarRocks, PrestoDB all have mindshare and unicorns using their products. It sounds like you haven't seen whats happening in this space.
19.
by atwong 3y ago
Here's a list of other open source OLAP systems out there. Clickhouse is on the list along with others like StarRocks. https://atwong.medium.com/top-open-source-alternatives-to-ol...
20.
by atwong 3y ago
There are other databases today that do real time analytics (ClickHouse, Apache Druid, StarRocks along with Apache Pinot). I'd look at the ClickHouse Benchmark to see who are the competitors in that space and their relative performanc
21.
by atwong 3y ago
As a database engineer, people ask me all the time, “What is the hottest area of database design” right now. It’s using SIMD which stands for Single instruction, multiple data, to process a lot of data very, very fast.
22.
by atwong 3y ago
Looking at https://landscape.cncf.io/card-mode?category=database , here’s a list of the online analytical processing (OLAP) that are CNCF members
23.
What are the top OLAP databases that are CNCF member and their ref customers?(atwong.medium.com)
7 points by atwong 3y ago|1 comments
24.
Querying Data on Apache Hudi with StarRocks – Apache Hudi MAY2023 Community Call(youtube.com)
3 points by atwong 3y ago|0 comments
25.
by atwong 3y ago
CH timeouts using joins on TPCH test data. https://celerdata.com/blog/clickhouse-vs.-starrocks-a-detail...
26.
by atwong 3y ago
You could argue that it's an addon. OLAP databases just allow you to do SQL for analytical use cases.
27.
by atwong 3y ago
not really. CH times out on TPCH join scenarios. https://celerdata.com/blog/clickhouse-vs.-starrocks-a-detail...
28.
by atwong 3y ago
not really. CH clusters timeout on join testing on TPCH. https://celerdata.com/blog/clickhouse-vs.-starrocks-a-detail...
29.
by atwong 9y ago
Maybe not 100% but it did influence the decision on working for an open source company.
30.
The CIO’s Alternative Using Red Hat(redhat.com)
2 points by atwong 12y ago|0 comments

More ›