6 ms·
`model.safetensors` for Qwen3-0.6B is a single 1.5GB file. Qwen3-235B-A22B has 118 `.safetensors` files at 4GB each. There are a bunch of models and quants be
by smcnally 1y ago
`model.safetensors` for Qwen3-0.6B is a single 1.5GB file.
Qwen3-235B-A22B has 118 `.safetensors` files at 4GB each.
There are a bunch of models and quants between those.
- azinman2 1y agoDoes it run in 8x80G? Or does the KV cache and other buffers push it over the edge?