jroesch

6 ms·

1.
by jroesch 11mo ago
We also have a formal memory model and the program semantics are simpler so if anything reasoning about it should be easier.
2.
by jroesch 2y ago
There was some solid commentary on the Ps5Pro tech talk stating core rendering is so well optimized much of the gains in the future will come from hardware process technology improvements not from radical architecture changes. It seems clea
3.
by jroesch 2y ago
Note: this is old work, and much of the team working on TVM, and MLC were from OctoAI and we have all recently joined NVIDIA.
4.
by jroesch 2y ago
Having been working in DL inference for now 7+ years (5 of which at startup) which makes me comparably ancient in the AI world at this point. The performance rat race/treadmill is never ending, and to your point a large (i.e 2x+) perfo
5.
by jroesch 2y ago
I think this is roughly correct. My 2c is that folks used the initial web data to cold start and bootstrap the first few models, but so much of the performance increase we have seen at smaller sizes is a shift towards more conscientious dat
6.
by jroesch 3y ago
I agree with this after a short while I turned off the romanization in many learning apps as it just messes with/undermines your actual learning.
7.
by jroesch 3y ago
To chime in Apple already has a lot of great ML talent they are just far more deliberate and slow to change their products. People forget that FaceID was/is one of the most cutting edge ML features ever developed/deployed when it
8.
by jroesch 3y ago
Things are already possible on today's hardware, see https://github.com/mlc-ai/mlc-llm which allows many models to be run on M1/M2 Macs, WASM, iOS and more. The main limiting factor will be small enough, high
9.
by jroesch 3y ago
This is also just straight up FUD. ADHD is one of the few psychiatric conditions that has numerous effective medications which work reliably for a large part of the effected population. Stimulants work for a large number of people diagnosed
10.
by jroesch 3y ago
It has nothing to do with the blog post quality or being different the guy has multiple key sentences which map to key ADHD experiences/symptoms. For those of us living with ADHD its just an empathy response as many of us have suffered
11.
by jroesch 3y ago
You just go see a psychiatrist or a psychiatric nurse practitioner and ask them to perform an evaluation. Many GPs can also perform/refer you as well. ADHD understanding and awareness was very low before the 2000s/2010s many peopl
12.
by jroesch 3y ago
As the parent comment said, and I mentioned in my reply. JavaScript was just incredibly poorly optimized/not compiled and they applied 20-30 years worth of compiler research to make it significantly faster. You also had an alliance of
13.
by jroesch 3y ago
Long time compiler hacker/engineer and compiler/programming language PhD here all great points. Worth saying out loud that many reasons why this stuff is slow is not due to bad code, its due to the fact that many of the best algor
14.
by jroesch 4y ago
This is much broader than ONNX its closer to ONNX Runtime + ONNX but it has some important advantages. StableHLO is the IR already supported by most HW accelerators including Inferentia/Trainium and TPU. Much of this code is not "
15.
by jroesch 4y ago
Microsoft and OpenAI have different technologies they have worked on including ONNX + ONNX-RT and OpenAI is focused on Triton which is a kernel compiler being used to speed up models. Given my understanding of heavy PyTorch use it seems mor
16.
by jroesch 4y ago
Did a PhD half focused on verification and also very biased being an early Lean developer. imo the Lean tooling and everything is much better I personally would never use Coq again especially after writing 200kloc+ of it over a few years. I
17.
by jroesch 5y ago
There is a lot more happening around https://www.tvmcon.org this week. For example a few other cool blogs: * https://octoml.ai/blog/write-python-with-blazing-fast-cuda-l... * https://octoml.ai&#x
18.
by jroesch 6y ago
TLDR Yes. I having been writing C++ extensively for research/work/etc the past 5 years. Compared with modern languages it completely deserves the bad rap. C++ has come a long way, can you write cleaner code than you could 10 years
19.
by jroesch 7y ago
Many universities just toss you an MS degree along the way for free in your PhD, but coming in with one has no real effect on your PhD length besides waving some clad requirements. At the end of the day US PhD programs just assume you will
20.
by jroesch 7y ago
It is still pretty much the same, the UW stipend in Seattle is enough to rent an apartment in a nice neighborhood and eat well. Not an extravagant life but no one is going even 20k into debt, let alone 50,100,200k that people do for other p
21.
by jroesch 7y ago
I almost have a PhD from UW and concur. One failure mode I’ve observed in people getting a PhD is not fully understanding what it entails before starting. Later they undergo a painful period of rectifying reality and their idealized version
22.
TVM deep-learning compiler framework transitions to Apache(news.cs.washington.edu)
34 points by jroesch 8y ago|3 comments
23.
Talks from the first TVM and deep learning compilers conference(youtube.com)
5 points by jroesch 8y ago|1 comments
24.
by jroesch 9y ago
If you have a system that allows you to write down the semantics of these expressions you can easily prove equivalence. You can use many of the techniques posted by others to construct such a proof for example functional extensionality is o
25.
by jroesch 9y ago
They are fundamentally not equivalent, you can not guarantee that a system respects a safety property with testing. You can prove that certain concrete instances, i.e your test cases inputs are safe, but you don't know where there exis
26.
by jroesch 9y ago
In your second point you are referring to fact that is needed in a calling context when proving a large spec, that means it is a top level specification, and therefor trusted. You don't need to prove an implementation only touches the
27.
by jroesch 9y ago
There are older papers that describes Lean's meta theory, https://leanprover.github.io/publications/ , the first paper, and the one on elaboration. Unfortunately they both describe the version present in Lean 2, wh
28.
by jroesch 9y ago
Daniel's point is that the specification itself is simple, he is saying nothing about the complexity of proving that your program matches the specification. The decidability of the specification isn't important in this context. It
29.
by jroesch 9y ago
This article is from 1998, the landscape was much different. Haskell had a handful of the language features it has today, and was lacking many of the innovations in its runtime and libraries.
30.
by jroesch 10y ago
Yeah I have been working nearly exclusively on a Retina Macbook since they were released last year. I really love the keyboard on this computer, and I think that the newest iteration of the keyboard is a significant improvement on the Macbo

More ›