#ai # [[Epistemic status]] #shower-thought # Scalable attention #to-digest ![[Screenshot 2022-04-28 at 08.08.55.png]] https://www.gwern.net/notes/Attention ![[Screenshot 2022-04-28 at 08.09.24.png]] https://paperswithcode.com/methods/category/transformers https://paperswithcode.com/methods/category/attention-mechanisms-1 ### S4 https://arxiv.org/pdf/2111.00396.pdf https://github.com/HazyResearch/state-spaces # External links