I'm not the person you asked, but if they're running in their own local hardware, then it might just be a lot slower than what the big providers run their model

I'm not the person you asked, but if they're running in their own local hardware, then it might just be a lot slower than what the big providers run their models on. System RAM is a lot cheaper than VRAM, especially if you bought it last year.