drej

5 ms·

1.
by drej 2mo ago
There's one for the Czech network (one of the densest in the world, if not the densest) https://grapp.spravazeleznic.cz
2.
by drej 1y ago
Please do run this on your own workloads! It's fairly easy to set up and run. I tried it a few weeks ago against a large test suite and saw huge perf benefits, but also found a memory allocation regression. In order for this v2 to be a
3.
by drej 1y ago
Read my posts again, I'm not complaining it's not for the masses, I know it isn't. I'm complaining that it's being forced upon people when there are simpler alternatives that help people focus on business problems r
4.
by drej 1y ago
I find it much more beneficial to lower the barrier for entry (oftentimes without any sacrifices) instead of spending time and money on upskilling everyone, just because I like engineering.
5.
by drej 1y ago
Fun aside - I actually used polars for a bit - first time I tried it, I actually thought it was broken, because it finished processing so quickly I thought it silently exited or something. So I'm definitely a fan, IF you need the DataF
6.
by drej 1y ago
I was talking about data engineering, because that was my job and all analysts were downstream of me. And I could see them struggle with handling infrastructure and way too many toggles that our platform provided them (Databricks at the tim
7.
by drej 1y ago
As a user? No, I don't have to choose. What I'm saying is that analysts (who this Polars Cloud targets, just like Coiled or Databricks) shouldn't worry about instance types, shuffling performance, join strategies, JVM version
8.
by drej 1y ago
Having done a bit of data engineering in my day, I'm growing more and more allergic to the DataFrame API (which I used 24/7 for years). From what I've seen over the past ~10 years, 90+% of use cases would be better served by
9.
by drej 1y ago
For those not familiar with this kind of computing challenges, I must link this wonderful video about TypeScript types running... DOOM. https://www.youtube.com/watch?v=0mCsluv5FXA
10.
by drej 1y ago
Whoa, I've been battling with an issue where my new M4 Mac Mini, disconnected from all peripherals, just sips power and gets rather warm overnight. Cools itself when I wake it up. I wonder if the changes suggested in the post and the c
11.
by drej 4y ago
I remember just adding one letter to the instance type in EMR to switch from Intel to ARM... and saw a 20% speedup as well as additional 20% hourly cost saving, all in all 1/3 cost decrease from a single character. Some migrations are
12.
by drej 4y ago
Note that this already exists on top of SQLite proper - authored by Ben Johnson (Litestream, Fly.io etc.) - https://github.com/benbjohnson/postlite
13.
by drej 4y ago
I encourage anyone to study these protocols, they are sometimes a lot more prevalent than one might think. Take the Postgres wire protocol, it's supported by a number of databases out there. Some years I built a data grepping tool, but
14.
by drej 4y ago
For me the main deterrent from Gitea has been their approach to UI design. The shameless inspiration (if you can call it that) they took from Github is pretty startling, the two interfaces look pretty much identical (well, Github has recent
15.
by drej 4y ago
Anyone can share their experience with the somewhat new STRICT mode? Does it help? I tend to use Postgres when available, primarily for the added strictness, but I'd surely prefer SQLite in more scenarios as it's easier to operate
16.
by drej 4y ago
It's wonderful tool and has simplified workflows for many, just be mindful of its one giant security implication. Should your database credentials ever leak in any way (lost/stolen property, incorrect git commit, screencasting mis
17.
by drej 4y ago
We used to run it self hosted, but the architecture is rather complex, so we ended up switching to their SaaS offering. I tried advocating [0] for a leaner architecture for simpler setups + to run integration tests against... but it wasn&#x
18.
by drej 4y ago
There are several principles that have helped me: - Do NOT migrate to new tools, even if they are really shiny and popular - this may end up being a big hurdle you'll regret down the line (looking at you, Notion, Todoist, Google Ke
19.
by drej 4y ago
Clicking on the link I though "I wonder it it starts with time.sleep" It was a pretty safe guess, though, the number of bugs related to this is pretty epic.
20.
by drej 5y ago
Perhaps I'm mistaken, but from an interview with the game author, I gathered that you can use 10k+ words, only ~2300 of those being candidates for the winning word. But the analysis only uses the latter subset. So in theory there could
21.
by drej 5y ago
What I find hilarious is that companies argue who can query 100 TB faster and try to sell this to people. I've been on the receiving end of offers by both of the companies in question and used both platforms (and sadly migrated some da
22.
by drej 5y ago
I remember benchmarking fast compression algorithms a while back and had lz4 as one of the top contenders, but I remember going with Snappy over lz4, because I ran into some compatibility issues in lz4 land... I can't recall any specif
23.
by drej 5y ago
That being said, I now remember I stopped contributing for a slightly different reason. While I tried to fill WD with complete information about a given subject, this was never leverage by a Wikimedia project - there is certain resistance t
24.
by drej 5y ago
It’s fairly difficult from the other side as well - contributing. I’ve been trying to complete wikidata from a few open source datasets I am intensly familiar with… and it’s been rather painful. WD is the sole place I have ever interacted w
25.
by drej 5y ago
Nice. Reminds me of an optimisation trick from a while ago: I remember being bottlenecked by one of these trigonometric functions years ago when working with a probabilistic data structure... then I figured the input domain was pretty small
26.
by drej 5y ago
Hey Mike, thanks for all the work you've been doing - I first used D3 back in 2013/2014 and been using them for side projects since. I haven't dug into the whole v3/v4 modularisation, so that might answer it, but is ther
27.
by drej 5y ago
I remember using this editor in the very early 2000s, it was quite something back then. You could easily live edit files off of FTP. With PHP being all the rage, we were changing things pretty live :-) Good times.
28.
by drej 6y ago
I have seen several deployments of Databricks (including first hand experience) and... most use cases could be better served by Postgres (or Redshift, Athena, Snowflake for larger scale). It has honestly been such an overkill for so many wo
29.
by drej 6y ago
> Note: We cannot accept non-trivial PRs for legal reasons. We need to retain copyright over the entire codebase. Does a CLA solve this? (Genuine question, I don't know.)
30.
by drej 6y ago
I used to have a boss who took this logic to an extreme and basically preached “always buy, never build” Problems mounted - cost, security, integration issues, performance, ... - we couldn’t do anything about any of that, because we just wr

More ›