7 ms·What kind of hardware do you run it on?by zirror 7mo agoWhat kind of hardware do you run it on?UncleOxidant 7mo agoFramework Desktop (AMD Strix Halo with 128GB). Runs it around 27 tok/sec which is quite acceptable.