mharrison

7 ms·

1.
by __mharrison__ 4d ago
I misspoke, you need to use .groupby/.transform to add a new filtering column: (sales .assign(country_median=lambda df_: ( df_.groupby("country")["amount"].transform("median") )
2.
by __mharrison__ 4d ago
Would love to see examples.
3.
by __mharrison__ 5d ago
I'm confused, you can use filter after a groupby in pandas... It's late here, I'm going to bed, perhaps I'll write the code tomorrow when I'm at my laptop and not on my phone.
4.
by __mharrison__ 5d ago
Those are generally rules of thumbs for data pipelines. (Plus duckdb can read Excel these days I think).
5.
by __mharrison__ 5d ago
This is a common complaint I get all the time (heard it this week while teaching pandas). I compare this to whitespace indentation in Python. Lots of folks complain about it before using it. After they use it it is a non issue. If it really
6.
by __mharrison__ 5d ago
I looked at your code very quickly, but it looks like you need to use .filter after a .groupby...
7.
by __mharrison__ 5d ago
Did you ever report these issues to polars developers? I reported many bugs to both pandas and polars over the years and both teams tend to address relatively big ones. (Still have some outstanding pandas bugs that I think are a big deal bu
8.
by __mharrison__ 5d ago
Most of the time it works, but there are still corner cases throughout the python ML ecosystem where polars fails. This and the decision not to natively plot with matplotlib keep me in pandas for most tasks. (Plus there's is still a re
9.
by __mharrison__ 5d ago
Rewriting pandas to polars is relatively trivial for most tasks these days. Especially if you wrote your pandas code correctly. I still prefer (and use) Pandas for EDA. I think matplotlib integration is a better choice for most viz. Also, I
10.
by __mharrison__ 5d ago
Use pandas if you want advanced analytics, visualization, or ml. Use SQL if you need to move data around.
11.
by __mharrison__ 5d ago
If you learn to write pandas correctly you end up writing it very similar to polars (or tidyverse). I agree that the API has warts, though typically it is more concise than polars.
12.
by __mharrison__ 5d ago
Most folks just need to learn how to use pandas well and that will open enough doors. Then they can move to polars or duck if needed.
13.
by __mharrison__ 5d ago
I'm in the middle of wrapping up the edits for Effective Pandas 3rd Edition. (I also wrote a Polars book and just wrapped up a weeklong training session on pandas this week.) Pandas is not perfect, it has a bunch of warts. But it is go
14.
by __mharrison__ 8d ago
I spent a few tokens last year trying to create a Python lib for native (undocumented) Resolve files. I was making progress, but it was slow (I ended up scripting Resolve in different ways). I imagine that current models could reverse-engin
15.
by __mharrison__ 8d ago
Highly recommend the studio version. The ability to edit by transcript is worth the price alone.
16.
by __mharrison__ 8d ago
I thought DaVinci Resolve could automatically sync camera footage for a few years now. I did it about 4 years ago.
17.
by __mharrison__ 8d ago
I had AI write a program to edit with resolve. It does transcription, looks at the transcript and decides where to make cuts. If does a decent job and saves me a bunch of time.
18.
by __mharrison__ 11d ago
Build a keyboard. By the end you should be well aware with soldering (and how to remove parts that you put on the wrong side of the PCB).
19.
by __mharrison__ 12d ago
Very cool. I was messing around vibe-coding an HR monitor on a LilyGo T5. My thought was I'd love to set an HR zone and then connect it to my e-MTB and have it change power to keep me in a zone. The refresh rate on my device was horrib
20.
by __mharrison__ 13d ago
This is the way. Favor keyword arguments to alias.
21.
by __mharrison__ 15d ago
The top of the readme says it's written by AI
22.
by __mharrison__ 19d ago
This is a problem that Hugging Face could easily help solve. Crawling through Reddit or forums to find the right incantation to run a model is frustrating.
23.
by __mharrison__ 20d ago
Yes, I was wondering if this was the Gameboy (capable) hardware.
24.
by __mharrison__ 21d ago
The lowest hanging fruit that hf could offer is community monitored commands for running local models. Right now it is a pain to find the correct incantation.
25.
by __mharrison__ 25d ago
Why? They brought columnar lately to the mass(es).
26.
by __mharrison__ 25d ago
Not sure why framework doesn't do this...
27.
by __mharrison__ 26d ago
Thanks for sharing. Parenting is hard. It sounds like you have found useful tools in adulthood.
28.
by __mharrison__ 26d ago
Yep, learning is hard work.
29.
by __mharrison__ 27d ago
Would you have preferred another label? If so, which one? Asking because...
30.
by __mharrison__ 1mo ago
What size is the ball?

More ›

__mharrison__

mharrison