onalark

7 ms·

1.
by onalark 7y ago
It's complicated. The Army Corps of Engineers has had a civilian mandate to support flood control prevention since 1917 [1]. Beyond that, they are also involved in large public works projects such as the building of roads and bridges,
2.
by onalark 8y ago
Ilan Schnell is not "some guy". He's the original primary author of the Anaconda distribution. One of the main reasons that so many data scientists use Python.
3.
by onalark 10y ago
NumPy is a library that provides typed multidimensional arrays and functions that run atop them. It does provide a built-in LAPACK/BLAS or can link externally to LAPACK/BLAS, but that's a side effect of providing typed arrays
4.
by onalark 10y ago
Except that Docker containers play terribly with virtualization solutions. Still, some sort of configuration/infrastructure-as-code would go a long way.
5.
by onalark 10y ago
This is a really interesting article and I'm glad this is getting attention. It's especially refreshing to see a theoretical treatment bridging algorithms with more "modern" hardware implementations. One opportunity I do
6.
by onalark 11y ago
I don't think this would work for a number of reasons. If it's a database that you're modifying, you can see that a lot of operations (increment, delete, etc...) will do the wrong thing if they're called twice. If the
7.
by onalark 11y ago
Awesome, I'm a huge fan of new and innovative tools that help improve the process of refactoring and improving existing code. This looks like a really promising tool for Ruby developers, and I'm always grateful when companies and
8.
by onalark 11y ago
Shiny, and I love the interface/layout! This looks a lot like the Jupyter/IPython Notebook, which is a free and open source "scientist's notebook". If you're interested in mixing LaTeX, Markdown, and code from
9.
by onalark 11y ago
Have you looked at conda and http://anaconda.org ? We spent a lot of time curating the most important Python packages for data science into the Anaconda distribution, and conda packages are a great format for distributing compli
10.
by onalark 11y ago
Thanks, I clearly wasn't being careful. I'll update my Gist... edit: On reviewing, I think the intent of the original blog post was to modify images in place (or at least to do it as quickly as possible with in-place filtering o
11.
by onalark 11y ago
Agreed, for some reason when I was looking at this last night I thought I couldn't use broadcasting, I've added the example to the gist: https://gist.github.com/ahmadia/c1f8be119f3cb2d2b8e5 Would you believe
12.
by onalark 11y ago
Great post, William. I really appreciated your exposition on both the challenges you folks were facing and your solution to the problem. As a few others have pointed out, sending a lambda function through NumPy is almost always the last th
13.
by onalark 11y ago
Yes, I'm thinking of discretizations of elliptic 2D/3D PDEs. They don't scale in the weak or strong sense, and they can't hold O(n log n) asymptotic complexity due to fill-in from Cholesky/LU-style factorizations.
14.
by onalark 11y ago
That's because direct solvers can't scale. If you want to solve a large (distributed over hundreds of nodes) sparse linear algebra problem as fast as possible, decades of research have been poured into efficient techniques (Krylo
15.
by onalark 11y ago
Hi Niels. I have contacts within the DoD HPCMP and have run Python 2.7 on several of the heavy machines available on the Army side of the fence. I work for Continuum, which provides both a free and a commercial Python solution that are ba
16.
by onalark 11y ago
Let's hope this is not just bluster :(
17.
by onalark 11y ago
I believe "conda install seaborn" will do what you need :)
18.
by onalark 12y ago
Yes, but it's not ideal. Since everything is done through Javascript, we have to first identify all the math, then hide it from the Markdown parser, then parse the Markdown, then restore the math, then call MathJax on the now-HTML. E
19.
by onalark 12y ago
I agree, this is the first thing that jumped out at me when I was looking at the landing page. I don't know of quantitative evidence that this sort of thing causes harm, but I don't see any harm in mixing it a bit.
20.
by onalark 12y ago
Yeah, Kyle is a rock star!
21.
by onalark 12y ago
Yup, thanks for the comment. I think FPGA has interesting potential for sequencing (and we need more sequencing compute), I'm not sure what's ahead for the simulation machines.
22.
by onalark 12y ago
It's worth pointing out that this is what most people think of as the traditional "Linux Operating System" but sans the Linux kernel. Also, there are a few components on these supercomputers that you won't find on a typi
23.
by onalark 12y ago
Unfortunately, NumPy uses deep knowledge of the CPython API in quite a few places, which is one of the reasons implementing NumPyPy has been so challenging.
24.
by onalark 12y ago
edit: Jack Poulson's Elemental, and Andreas Waechter's IPOPT are also written in C++, and are both very important libraries within scientific computing and optimization, to add a few more examples of the usefulness of C++. I
25.
by onalark 12y ago
If you want/need maximum performance, why are you programming in a "high-level language"? Many of the highest-performance scientific computing libraries are written in assembly or use inline assembly instructions. The vast m
26.
by onalark 12y ago
An iPad does resemble the supercomputers of yore, between its superscalar, vector processing (GPU), and multicore architecture. The Parallella brings distributed-memory programming in, which is a very important development. You and I stro
27.
by onalark 12y ago
This is a little bit of a straw man. As Jack Dongarra will happily tell you, an iPad can outperform some of the supercomputers from the beginning of the Top500 benchmark. You don't get to be a supercomputer today by beating supercomp
28.
by onalark 12y ago
Agreed. It's a really cool project, and maybe you should build one for your next parallel computing class :)
29.
by onalark 12y ago
This is a misleading title. Brian builds Supercomputer Models, not Supercomputers. It would be like if I had a model of a Ferrari I put together at home and wrote an article about how I built sports cars in my spare time. Yes, these are a
30.
by onalark 12y ago
I agree that University archives present another opportunity, particularly among the "first-tier" research institutions in the US. One problem is that many University archives are paywalled or require restrictive licenses. Anoth

More ›