6 ms·
It corresponds to the paper formulas as a courtesy. While descriptive comments or function signature might be nicer, it still is reasonably easy to follow along
by junipertea 3y ago
It corresponds to the paper formulas as a courtesy. While descriptive comments or function signature might be nicer, it still is reasonably easy to follow along from the paper description! (Although, most of the complexity is hidden away in selective_scan_cuda.fwd())
- telotortium 3y agoImplementation of selective_scan_cuda: https://github.com/state-spaces/mamba/blob/6dbfc4553a98c81e1e93b8fd2d5abf387f5c09ee/csrc/selective_scan/selective_scan_fwd_kernel.cuh https://github.com/state-spaces/mamba/blob/6dbfc4553a98c81e1...
- triyambakam 3y agoAha, thanks, that is helpful. Any chance you know of a guide that walks through a paper and code side by side?
- ttul 3y agoHailing Jeremy Howard and his team at Fast.ai to make it so!