7 ms·
hey, how does someone get started with doing things like these (writing inference code/ cuda etc..). any guidance is appreciated. i understand one doesn't just
by kingreflex 7mo ago
hey,
how does someone get started with doing things like these (writing inference code/ cuda etc..). any guidance is appreciated. i understand one doesn't just directly write these things and this would require some kind of reading. would be great to receive some pointers.
- Kilenaitor 7mo agoSame! Would love any resources. I'm interested more in making models run vs making the models themselves :)
- briandw 7mo agoThese are good lectures and there is also a discord. https://github.com/gpu-mode/lectures https://github.com/gpu-mode/lectures
- HorizonXP 7mo agoYou know, I love this comment because you are where I was 15 years ago when I naively decided that I wanted to do my master's in medical biophysics and try to use NVIDIA CUDA to help accelerate some of the work that we were doing. So I have a very... storied history with NVIDIA CUDA, but frankly, it's been years since I've actually written C code at all, let alone CUDA. I have to admit that I wrote none of the code in this repo. I asked Codex to go and do it for me. I did a lot of prompting and guidance through some of the benchmarking and tools that I expected it to use to get the result that I was looking for. Most of the plans that it generated were outside of my wheelhouse and not something I'm particularly familiar with, but I know it well enough to understand that its plan roughly made sense to me and I just let it go. So the fact that this worked at all is a miracle, but I cannot take credit for it other than telling the AI: what I wanted, how to do it, in loose terms, and helping it when it got stuck. BTW, everything above was dictated with the code we generated, except for this sentence. And I added breaklines for paragraphs. That's it.
- cgfjtynzdrfht 7mo ago[dead]