8 ms·
Am i the only one that does not trust the ootb harnesses? My approach is a llama-server wrapped in a locked down systemd service and a goose client/harness wit
by throwawayqqq11 23d ago
Am i the only one that does not trust the ootb harnesses?
My approach is a llama-server wrapped in a locked down systemd service and a goose client/harness with a from-scratch apparmor profile behind a filtered network interface.
Getting this running was alot of work and is certainly not perfect but with qwen3.8 and expected price hikes, i think it might be worth it.