5 ms·
Aren't you kind of stuck with smaller models on the mini though? Even with the pro you'd be stuck with a max of four daisy chained over thunderbolt and with the
by AbsurdCensor 23d ago
Aren't you kind of stuck with smaller models on the mini though? Even with the pro you'd be stuck with a max of four daisy chained over thunderbolt and with the 160 gig memory bandwidth you'd probably be far better off with other configurations.
- j45 22d agoThey can be connected to share ram and processing. Depending on the use case for known processes the LLM requirements are much, much, simpler and lower to make and keep it more predictable.
- AbsurdCensor 22d agoI really haven't seen any 16gb Mac Mini cluster setups running large models at any appreciable speed for the reasons previously provided. Do you happen to have examples that folks are actually using?