mkmccjr

5 ms·

1.
by mkmccjr 7mo ago
These are both great points. When I wrote the post, it didn't occur to me that I could inspect the emitted bytecode. In hindsight, including that would have made the explanation much stronger. To be honest, this is my first time real
2.
by mkmccjr 7mo ago
Aha, I think I better understand your point: since the generated bytecode includes a cast, my explanation about the optimization is too simplistic. I haven't actually inspected the emitted bytecode, so I was only reasoning from the obs
3.
by mkmccjr 7mo ago
Thank you for this! On the second point, you are absolutely correct; that was sloppy writing on my part. I will correct that in the post. I'm not certain I understand your first point. When I add the type hint, it's me assertin
4.
by mkmccjr 7mo ago
Author of the blog post here. That explanation sounds very plausible to me! If the whole enclosing function became inlinable after the reflective call path disappeared, that could explain why the end-to-end speedup under load was even larg
5.
by mkmccjr 7mo ago
I appreciate the optimism! This specific example is just a pedagogical toy designed to be simple enough to analyze fully. That said, I do agree with the intuition that static networks have a ceiling. If we want systems that can truly adap
6.
by mkmccjr 7mo ago
You are absolutely right about the code: I haven't worked with neural networks in a while and I guess my post outs me! That said, I do like Keras's functional API, and in this case I think it maps nicely to the "math" of
7.
by mkmccjr 7mo ago
Thank you for your comment, and I sincerely apologize for my slow response! "Rediscovering structure" is exactly the inefficiency I was trying to highlight. In the physics/science cases I work with, the factorization is usua
8.
by mkmccjr 7mo ago
Thank you for reading my post, and for your thoughtful critique. And I sincerely apologize for my slow response! You are right that there are other ways to inject latent structure, and FiLM is a great example. I admit the "static emb
9.
by mkmccjr 7mo ago
Hello. I am the author of the post. The goal of this was to provide a pedagogical example of applying Bayesian hierarchical modeling principles to real world datasets. These datasets often contain inherent structure that is important to exp
10.
Hypernetworks: Neural Networks for Hierarchical Data(blog.sturdystatistics.com)
97 points by mkmccjr 7mo ago|10 comments
11.
by mkmccjr 10mo ago
Original author here -- thank you for your thoughtful comment. You're absolutely right that saying "SQL is useful" isn't exactly novel. My goal with the blog post was to describe the practical impact of leaning into SQL
12.
by mkmccjr 11mo ago
Just tried this out, and my mind is blown: https://platform.sturdystatistics.com/deepdive?fast=0&q=camp... I did a google search for "camping with dogs" and it organized the results into a set of about ~30 res