If you look in the `config.json`[1] it shows `Zamba2ForCausalLM`. You can use a version of the transformers library to do inference that supports that. The mod

If you look in the `config.json`[1] it shows `Zamba2ForCausalLM`. You can use a version of the transformers library to do inference that supports that. The model card states that you have to use their fork of transformers.[2] 1. https://huggingface.co/Zyphra/Zamba2-7B-Instruct/blob/main/config.json#L5 https://huggingface.co/Zyphra/Zamba2-7B-Instruct/blob/main/c... 2. https://huggingface.co/Zyphra/Zamba2-7B-Instruct#prerequisites https://huggingface.co/Zyphra/Zamba2-7B-Instruct#prerequisit...