Q-S5 - Towards Quantized State Space Models
Steven Abreu*, Jens E. Pedersen*, Kade M. Heckel*, Alessandro Pierro
This work was presented at the [NGSM] workshop at ICML 2024.
You can find our code on GitHub and our paper on ArXiv.
![Q-S5 @ ICML 2024 (NGSM workshop)](/assets/img/qs5.png)
We present a fully quantized implementation of the S5 state space model, and demonstrate that we can reach competitive performance on SMNIST, SCIFAR and most LRA tasks.