fpgamlirfanboy

6 ms·

1.
by fpgamlirfanboy 2y ago
You skipped over the second sentence of what you're responding to: > Say you’re reading a paper or trying to implement some technology that uses a mathematical concept you aren’t familiar with In such a case you're not interest
2.
by fpgamlirfanboy 2y ago
i don't have an outrageous amount of experience here but i work at a place that designs and sells x86 chips (and i work on arch adjacent things). i'll just say this: do not underestimate the effect of institutional friction/m
3.
by fpgamlirfanboy 2y ago
this is very common. lots of companies around (e.g. cadence) that sell SIPs as synthesizable RTL for easy integration into chip designs (and lots of hardware companies buy these SIPs).
4.
by fpgamlirfanboy 2y ago
1024 fp16 macs is pretty good but the 128b vector datapath is weak sauce. on the other hand 2MB SRAM is legit. i wonder how many tiles (i don't think it's in the post).
5.
by fpgamlirfanboy 2y ago
> does PyTorch have a similar concept of course https://github.com/pytorch/pytorch/blob/main/torch/utils/_py...
6.
by fpgamlirfanboy 2y ago
https://en.wikipedia.org/wiki/Brown_%26_Williamson#Controver... > Wigand turned his attention to improving tobacco additives, some of which were designed for "impact boosting", using chemicals like ammonia
7.
by fpgamlirfanboy 2y ago
> It's easy to assume you're great especially working under "passion coders" who keep stuff afloat. i work on compilers+hardware so that's the backdrop here. here's a real hypothetical for you (ie it happene
8.
by fpgamlirfanboy 2y ago
> well because they have other priorities and responsibilities in life that make it necessary to maintain a strong work ethic. It's amazing how many people in tech can't imagine that the same people that can grind med school or
9.
by fpgamlirfanboy 2y ago
> Side-note: Mojo has been designed by the creator of LLVM and MLIR to prioritize and optimize vector hardware use, as a language that is similar to Python (and somewhat syntax compatible). Are people getting paid to repeat this ad nause
10.
by fpgamlirfanboy 2y ago
> the same AIE-ML coprocessors they're not the same - versal acaps (whatever you want to call them) have AIE1 arch while phoenix has AIE2 arch. there are significant differences between the two arches (local memory, bfloat16, etc.)
11.
by fpgamlirfanboy 2y ago
Tell that to PhD advisor that took credit for all my work because they were his ideas (at least so he claimed).
12.
by fpgamlirfanboy 2y ago
you see this kind of wishful (delusional?) thinking very frequently on hn: > Microsoft won't ever be able ... their business model is ... have had enough. statements made with complete certitude, as if these things aren't
13.
by fpgamlirfanboy 2y ago
It's funny - former Google devs (whom I just maintain a good relationship with their former employer) are ideally positioned to profitably take advantage of the arb of TPU over GPU.
14.
by fpgamlirfanboy 2y ago
With all do respect, I think you're telling a half-truth here. Your LinkedIn profile shows you had two MS degrees before starting your PhD. Undoubtedly you got some of the requirements waived for the PhD course requirements. That means
15.
by fpgamlirfanboy 2y ago
> Vivado is intimidating (as opposed to Yosys/nextpnr which you seem to hate) i never said i hated yosys/nextpnr? i said somewhere that yosys makes the uber strange decision to use C++ as effectively a scripting language ie glu
16.
by fpgamlirfanboy 2y ago
it's so true it hurts
17.
by fpgamlirfanboy 2y ago
hey look someone that actually knows what they're talking about!
18.
by fpgamlirfanboy 2y ago
i haven't a clue what that means but when julia's autodiff is the only one that is implemented using dual numbers i think the claim is pretty obviously false and seemingly everyone has an issue admitting that. without a doubt yo
19.
by fpgamlirfanboy 2y ago
is this like some kind of version of truman show? the full sentence is >please show me the source line number in pytorch or tensorflow that defines this number why? because the original comment makes a claim about pytorch . it's al
20.
by fpgamlirfanboy 2y ago
it's amazing to me that pointing out a straight up mathematically factual inaccuracy is considered "angry" and "acting a fool".
21.
by fpgamlirfanboy 2y ago
> I don't know why you keep calling it "magic". because they have all of the gee-whiz factor of a freshman calc proof of the chain rule that divides and multiplies infinitesmals and absolutely not enough of the substance n
22.
by fpgamlirfanboy 2y ago
i didn't say it cannot be, i said there's a natural reason it's not: the same reason the rest of analysis isn't. > You're right on one count: no library implements forward mode there are plenty of CFD type libr
23.
by fpgamlirfanboy 2y ago
> It seems like you haven't really worked through this stuff too much yup not at all - i just wandered in off the street and knew accidentally that you were talking about non-standard analysis. > The rest of your points I think I
24.
by fpgamlirfanboy 2y ago
> and if addition and multiplication work the way you expect and propagate derivatives correctly - then you are using dual numbers you literally started out your miraculous comment with > This new algebra is called the ring of "d
25.
by fpgamlirfanboy 2y ago
you guys are wrong and spreading blatant misinformation - there is no magic number whose square is 0 but which is itself not zero anywhere in pytorch or tensorflow or any other real DNN framework that i'm familiar with. it's all f
26.
by fpgamlirfanboy 2y ago
> Most autodiff packages (such as Pytorch) use something not much more advanced than this pytorch absolutely does not use the dual number formulation - there are absolutely no magic epsilons anywhere in pytorch's (or tensorflow&#x27
27.
by fpgamlirfanboy 2y ago
> I mean, yes…? Maybe I’m a terrible programmer but I’ve never applied calculus to my work in any real way. A book that’s just “calculus applications for software design” seems quite useful, and quite unrelated to teaching “math” in a di
28.
by fpgamlirfanboy 2y ago
> graduate-level introduction to differentiable programming. go check out any real graduate textbook. what you will find is they all have exercises. > It's a book for ML researchers. I'm excited to read it. Calm down. just
29.
by fpgamlirfanboy 2y ago
i don't know why people write these things. it's an absolute hodge-podge of theorem/proofs/results/techniques with no unifying theme other than "CALCULUS". so it's a pretty bad math book to actually l
30.
by fpgamlirfanboy 2y ago
> This is a personal project aiming to replicate analog coupling dynamics with asynchronous digital circuits FPGAs, not a claim that we can solve NP complete problems with a fundamental speedup. Then you shouldn't have led with that

More ›