phunge

13 ms·

1.
by phunge 6y ago
Altair is amazing. I've been using matplotlib going on 12 years now -- Altair didn't feel more productive at first (more typing), but the longer you work with it, the more you realize how the API is a cohesive system. This leads t
2.
by phunge 6y ago
A hazard rate can be thought of as a patient's one day probability of mortality. A hazard ratio is a ratio of two hazard rates, so 1.25 would mean that people in one group were dying at a 1.25x rate relative to a comparison group.
3.
by phunge 6y ago
For Bayesian stats, "Statistical Rethinking" by McElreath is a masterpiece.
4.
by phunge 7y ago
Neat! See also: https://fklearn.readthedocs.io/en/latest/ , which wraps sklearn in a much-improved functional API.
5.
by phunge 7y ago
Have a look at duckdb, it's is another interesting tool that's columnar and embedded. It would be amazing if the world of open-source column stores matured a little bit relative to where we are today...
6.
by phunge 8y ago
+1 to this, I've had multiple teams that have shied away from airflow because of its operability & deployment story, despite needing something that has all its features. In terms of radically different takes on workflow engines, I&
7.
by phunge 9y ago
They're also used in spectral clustering, which is a powerful method for clustering data (see Ng 2001 for some pictures)
8.
by phunge 9y ago
I think it's pretty easy for this discussion to become about personalities and not methodologies. Gelman is pretty brash and speaks his mind, so he could be correct on methodology and have that get lost in the noise. So I'll give
9.
by phunge 9y ago
In cases where you need to interpret the resulting model, I've been advised not to bin (for example: http://biostat.mc.vanderbilt.edu/wiki/Main/CatContinuous ). Other alternatives are splines or generalized ad
10.
by phunge 9y ago
Classic post! This post is like a gentle gateway to the world of Bayesian statistics -- check out Cameron Davidson Pilon's free book if you want to go deeper.
11.
by phunge 9y ago
Highly recommended! The first course was the first thing I came across that helped me contextualize the DL field into something that might be relevant for my work. It's a great way to get your hands dirty. One point of comparison is Ca
12.
by phunge 9y ago
Logistic regression can easily be made online too, keep in mind! sklearn has an implementation of online gradient descent, and vowpal wabbit is also excellent at those problems. Naive bayes can be parallelized in ways that SGD can't, t
13.
by phunge 9y ago
If you're interested in getting parse trees from regexes (ie all the submatch locations), check out Kleenex, it looks really interesting and is based on some new research. Full parse trees are a harder problem than matching, and one th
14.
by phunge 9y ago
I'm super excited for this! Good dashboarding for python has been a huge gap in the ecosystem, and none of the existing options (bowtie/pyxley/spyre) really came close to the functionality of shiny. The closest IME has been i
15.
by phunge 10y ago
Agreed, this is a great way to think about it. I think Ansible is at its best when the modules handle the imperative stuff behind the scenes, and the playbook just declares. That's not always possible, but the modules are getting bette
16.
by phunge 10y ago
I actually like Travis quite a lot except for one issue! At work we use docker for builds, and neither tool can build docker images in such a way that the docker layer cache is utilized. For more details: https://github.com/
17.
by phunge 10y ago
Which are the best of the SaaS options? Just curious -- I'm not happy with CircleCI or Travis right now.
18.
by phunge 10y ago
Ooh Python! Check out https://github.com/mrocklin/multipledispatch which is a little more fleshed out than Guido's implementation. From the author of toolz and dask so you know it's good ;) I also find that m
19.
by phunge 10y ago
They mention that it was originally paired with Druid. The data volume that Druid excels at (and that AirBnB must have) is orders of magnitude larger than what Tableau&Looker do well with. It's probably just built for bigger-than-S
20.
by phunge 11y ago
Yeah this is a common complaint. I don't have direct experience with NaCL/libsodium or Keyczar but check them out. Do you mean a bitstream-compatible thing, or a GPG/PGP alternative?
21.
by phunge 11y ago
I found that learning ansible and storing my machine customization as a deployable playbook was totally worth the effort involved.
22.
by phunge 11y ago
To put up something concrete, my last large employer had a 401k plan where the cheapest fund we had access to (PLFMX) had an expense ratio of 0.72%. That's in addition to account-level management fees, which I think were ~0.8%.
23.
by phunge 11y ago
This is 100% true. Mainstream 401k fees are out of control. I don't know how much is opportunism and how much is regulatory burden, but parity to wealthfront or anything else retail would be fucking miraculous.
24.
by phunge 11y ago
This is an incredible resource, +1. I started using ledger heavily about a year ago and it's been a game changer. Personal accounting is about data capture; if you don't gather good data, you end up with garbage in garbage out ana
25.
by phunge 11y ago
We had a similar desire: secure, performant egress from S3. We ended up using CloudFront. You can configure cloudfront with signed URLs, that will access private buckets with a special S3 user ( http://docs.aws.amazon.com/Ama
26.
by phunge 11y ago
You're probably thinking of https://en.m.wikipedia.org/wiki/Selective_laser_sintering which is pretty widespread -- for example you can order metal parts straight off ShapeWays that are SLS!
27.
by phunge 11y ago
Can someone explain why the random_split (i.e. first) rule tends towards inequality? It seems that any time a rich&poor person meet, the expected outcome is that the poor person receives money -- E(Uniform(0, X+Y)) = (X+Y)/2 > m
28.
by phunge 11y ago
The author wrote Luigi at Spotify, which is a pretty good example of a small amount of code with immense leverage on other people's productivity.
29.
by phunge 11y ago
Preach! :) That's my preferred design too. The first job of any external data capture process is to capture the full fidelity source data. Everything else belongs in a followon job.
30.
by phunge 11y ago
Man, if I had a dollar for every time data roundtripping to files has corrupted things I'd have many dollars. The schema-based serialization libraries (Thrift, Protobufs) or MsgPack are a good way to avoid that too. They come with a lo

More ›