Q-S5 - Towards Quantized State Space Models
Steven Abreu*, Jens E. Pedersen*, Kade M. Heckel*, Alessandro Pierro
This work was presented at the [NGSM] workshop at ICML 2024.
You can find our code on GitHub and our paper on ArXiv.
We present a fully quantized implementation of the S5 state space model, and demonstrate that we can reach competitive performance on SMNIST, SCIFAR and most LRA tasks.