EL-attention proposes a way to reduce the memory requirements during inference. This post will try to provide a simple summary of the approach.