4 ms·
Oh, so an M2 will support GPU usage? Can you run CoreML and unsloth models in the same way you would use them on regular MacOS? Are there benefits to using Linu
by xrd 12d ago
Oh, so an M2 will support GPU usage? Can you run CoreML and unsloth models in the same way you would use them on regular MacOS? Are there benefits to using Linux/Asahi for running models on Apple hardware?
- brundolf 12d agoTo my understanding the M1 and M2 have very functional GPU drivers. I don't know about the other specifics you asked
- simcop2387 12d agoYou wouldnt be using coreml since thats apples software, but likely vulkan versions of llama.cpp or pytorch or what have you. How well that works at the moment i dont know