darsnack

7 ms·

1.
by darsnack 3y ago
> Can I use PyTorch or JAX comfortably in Julia? There is https://github.com/rejuvyesh/PyCallChainRules.jl which makes this possible. But using some of the native Julia ML libraries that others have mentioned is pre
2.
by darsnack 3y ago
How you interact with parameters. Lux is similar to Flax (Jax) where the parameters are kept in a separate variable from the model definition, and they are passed in on the forward pass. Notably, this design choice allows Lux to accept para
3.
by darsnack 3y ago
You are also allowed to have bike share, buses, subway/light rail, and taxis. No one is saying trains are the only mode of transportation. I’ve lived in midwestern states with miles of farmland. In the town center, a bus network and bi
4.
by darsnack 5y ago
You would have to add a learning method to tell it how to encode/decode graph data, but the framework is agnostic to the model choice. So any Flux model is supported.
5.
by darsnack 5y ago
I’m not the main dev on FastAI.jl, but I work on the Julia ML community team that supported this project. > Since FastAI.jl uses Flux, and not PyTorch, functionality has to be reimplemented. We are looking to offer a high level API for M
6.
by darsnack 6y ago
You should check out Makie. Getting it set up can be a bit frustrating if things don’t go right, and there is a small learning curve for using `@lift`, but it is an absolute joy to use once you ramp up. I use it for my research by default.
7.
by darsnack 6y ago
On the NVidia A100, the standard FP32 performance is 20 TFLOPs, but if you use the tensor cores and all the ML features available then it peaks out at 300+ TFLOPs. Not exactly your question, but a simple reference point. Now the accelerato
8.
by darsnack 6y ago
In a more complex example where you actually take a variable, do some operations to it, then reassign it, Pluto.jl encourages you to separate that into multiple cells. The reason is each cell marks a distinct node in the dependency graph. I
9.
Interactive Notebooks – Pluto.jl(youtu.be)
2 points by darsnack 6y ago|0 comments
10.
by darsnack 6y ago
Most of that is not fundamental to Julia or Flux itself. It’s the difference between a monolithic package like TF and source-to-source AD in Julia. The former allows the designers to use their own data structures and external libraries to d
11.
by darsnack 6y ago
I have been using Flux for a year (or more?) and I have never found it to be slower than PyTorch or TF. Granted I am training at most ResNet-20 and mostly smaller models, so maybe there is larger training routines where people have issues.
12.
by darsnack 7y ago
Great summary! At the end you mention the difficulty extrapolating beyond an HH neuron model. I think curious readers will find the work of Jim Smith ( https://fcrc.acm.org/plenary-speakers/james-e-smith-plenary ) intere
13.
by darsnack 7y ago
They even address what you are saying in the article. They mention the looming danger of weaponized AI which is exactly when someone has altered the program to do harm.
14.
by darsnack 7y ago
That’s the entire point of the article. The AI itself will not develop a need to harm. Users/creators of the AI will program that into it. But AI by itself even with creators of the best intentions has real problems that affect society
15.
by darsnack 7y ago
Just to be clear, I’m not trying to put down Clash. I disagree with your statement about it being an alternative to Verilog or VHDL. It’s like saying Java is dead because Scala exists.
16.
by darsnack 7y ago
I guess my point is that Clash is just a high level language that transpiles to Verilog. There a plenty of languages that already do this. So your original claim that it is a Verilog or VHDL replacement isn’t accurate. We still use Verilog.
17.
by darsnack 7y ago
I just took a look at clash. HDL describes state in a very real way. Trying to represent stateful hardware using a functional language is just too complicated. I hate these toy examples of “look how easy an FIR filter is.” An FIR filter isn
18.
by darsnack 7y ago
I’ll leave this here: https://t.co/jA1kz8QMvt
19.
by darsnack 7y ago
You are right about qutrits. Essentially, anything that exhibits quantum behavior is in infinitely many levels at once. It is our ability to measure discrete levels that leads to qubits, qutrits, etc. Generally speaking, the more levels the
20.
by darsnack 7y ago
Tried setting up an IPFS website using Hearth, and I ran into the links issue. Gave up pretty soon after in favor of GitHub Pages.
21.
by darsnack 7y ago
If a distro is committed to modifying the style sheets to look like macOS, then it should be the distro’s responsibility to maintain the applications. Precisely because the distro market for Linux is so varied, it is hard for Gnome app deve
22.
by darsnack 7y ago
You’re right, but that is the motivation for the blog post. Learning is a form of fitting that performs better in practice than the curve fitting mentioned in the blog post when the required fit is nonlinear and/or high dimensional. Th
23.
by darsnack 7y ago
I don’t think if you see someone with an iPhone, you assume they have the money to buy nice things. I think the image Apple has built up works in the opposite way. If you see someone without an iPhone, you assume they only bought that produ
24.
by darsnack 7y ago
Most neuromorphic chips are general purpose in that you can tune the parameters of the neuron model. You can run a variety of learning algorithms by tuning these parameters. The only thing that is fixed is the model of a neuron itself. To h
25.
by darsnack 7y ago
Great news! Question for the fellow Jupyter Hub users: how do I expose users’ Conda environments to them?
26.
by darsnack 7y ago
I don’t. I have the 2016 15” model, and I’ve never had an issue. Most of the people in my graduate program don’t seem to have issues either. It surprises me how much i hear about this issue, because it directly contradicts my anecdotal evid
27.
by darsnack 8y ago
Could you comment on these “aha” moments?
28.
by darsnack 8y ago
I agree. Technology always makes progress, so it is inevitable that clean energy will be dominant in the future. The question is whether that will be too little too late. > gasoline cars will be worthless scrap heaps over night This is t