On the Integration of Self-Attention and Convolution

Published in Computer Vision And Pattern Recognition (CVPR) 2022, 2021

An efficient and elegant way of combining convolution and self-attention.