6 ms·

I also added a Mac version: https://selfhostllm.org/mac/ https://selfhostllm.org/mac/ so you can know which models you can run on your Mac and get an estimated

by erans 1y ago

I also added a Mac version: https://selfhostllm.org/mac/ https://selfhostllm.org/mac/ so you can know which models you can run on your Mac and get an estimated tokens/sec.