cmollis

18 ms·

1.
by cmollis 2mo ago
yeah.. i just to a daily cost alert.. it was only 23 trillion dollars this month. i thought, hmm seems kind of high this month.
2.
by cmollis 3mo ago
when I was young, we lived with my grandparents after my parents divorce. My grandfather worked in a factory in trenton, NJ; in fact, both of my grandfathers did..now there are no factories. Nevertheless, he had a garage full of tools, vi
3.
by cmollis 6mo ago
amazing.
4.
by cmollis 6mo ago
yes, so bored. yada yada.. i've been 'obsolete' for 36 years and counting.
5.
by cmollis 11mo ago
i have the most bare-bones plan with an HSA.. for me and my three kids, it was 19K per year.. and that was basically nothing more than catastrophic insurance.. I don't think my provider actually paid for anything in the last 4 years ex
6.
by cmollis 11mo ago
It seems to me that if I were actually the Antichrist, the first thing I would do is identify the antichrist as someone else. Then, I would give a lot of pseudo scientific reasons why I think that the antichrist is someone other than me, s
7.
by cmollis 11mo ago
have your kid suffer through measles because you believe some clown on tv.. when you could completely prevent it if you had your kid get the same vaccine you yourself got.
8.
by cmollis 1y ago
can i run a distributed computation in pola.rs cloud on my own AWS infra? or do I need to run it on-prem?
9.
by cmollis 2y ago
spark is getting a bit long in the tooth.. interesting to see duckdb integrated with Ray for data-access partitioning across (currently) 3FS. probably a matter of time before they (or someone) supports S3. It should be noted that duckdb
10.
by cmollis 2y ago
...and that's why he spent 250MM on the election. (SpaceX contracts coming soon).
11.
by cmollis 2y ago
clearly talking his book. whatever.
12.
by cmollis 2y ago
true spark has existed for years and is a great toolset.. i use it ever day. it's also a huge hassle spinning clusters up and down and configuration is complex. I can execute some pretty hairy scans against a huge s3 parquet dataset in
13.
by cmollis 2y ago
exactly.. parquet is good for append only.. stream mods to parquet in new partitions.. compact, repeat.
14.
by cmollis 2y ago
Rust and scala
15.
by cmollis 2y ago
yes.. that is correct (also worked there 2000-01). Bertelsmann offered 1B to settle the suit with the Labels (including the ones Bertelsmann owned, somewhat ironically) so the subscription service that we were building could go live, but t
16.
by cmollis 2y ago
Yes. Duckdb works very well with parquet scans on s3 right now.
17.
by cmollis 2y ago
we've had tornadoes in NJ..
18.
by cmollis 3y ago
sounds a bit like what Iceberg does with writes on parquet.
19.
by cmollis 3y ago
I've been testing duckdb's ability to scan multi-tb parquet datasets in S3. I have to say that i've been pretty impressed with it. I've done some pretty hairy SQL (window functions, multi-table joins, etc).. stuff that
20.
by cmollis 3y ago
I always thought it was easier to read code than to write it.
21.
by cmollis 3y ago
Also, duckdb allows you convert scan results directly to both pandas and pl dataframes.. so you can mix and match based on need.
22.
by cmollis 3y ago
I've been testing polars and duckdb recently.. Polars is an excellent dataframe package.. extremely memory efficient and fast. I've experienced some issues with a hive-partitioning of a large S3 dataset which DuckDB doesn't
23.
by cmollis 3y ago
1. hacker news.. absolutely my favorite daily web experience. The nerdy eclecticism of the topics, coupled with the stripped-down experience are just unequaled on the Web, in my view. 2. writing software.. after almost 40 years (includi
24.
by cmollis 3y ago
+1
25.
by cmollis 3y ago
ok.. thanks.. I'll try it out. I can think of few use-case that we have where this might be a good alternative to athena.
26.
by cmollis 3y ago
this part is confusing to me in the doc.. I assume that you're using the httpfs (S3) extensions and perhaps doing scanning of the parquet files (which I think is actually streamed.. e.g. querying for a specific column values in a serie
27.
by cmollis 3y ago
continuing to write good unit and integration tests for code for software in maintenance
28.
by cmollis 3y ago
haha.. that's hysterical. Maybe NY Mag should actually read 'American Prometheus' and then create a headline. Oppenheimer got a degree in Chemistry first, then decided to go into Theoretical Physics.. (what??).. then he did
29.
by cmollis 3y ago
Breakfast club. Good flick
30.
by cmollis 3y ago
Unix Network Programming - Stevens. (this is kind of a classic book on the subject.. but at the time, I had never heard of it).

More ›