Best Alternatives to x-transformers

Local attention, window with lookback, for language modeling

The convolutional module from the Conformer paper

Vector Quantization - Pytorch

Rotary Embedding - Pytorch

Resize Right

Conditionally Routed Attention

Easily turn a set of image urls to an image dataset

Image augmentation library for deep neural networks

Product Key Memory

Easy way to keep track of exponential moving average version of your pytorch module

Einops Extensions

BS-RoFormer - Band-Split Rotary Transformer for SOTA Music Source Separation