https://www.jonam.io/tags/attention/Recent content in Attention on jonam'LogHugo -- gohugo.ioen© 2026 Manoj. All Rights Reserved.Mon, 18 May 2026 00:00:00 +0000https://www.jonam.io/journal/inference-engineering/research-topics/attention-head-similarity-pruning/Mon, 18 May 2026 00:00:00 +0000https://www.jonam.io/journal/inference-engineering/research-topics/attention-head-similarity-pruning/Measure cross-head similarity on a prompt and skip heads that are redundant for that input.https://www.jonam.io/journal/inference-engineering/research-topics/unlearning-layer-in-attention/Mon, 18 May 2026 00:00:00 +0000https://www.jonam.io/journal/inference-engineering/research-topics/unlearning-layer-in-attention/Can we attenuate undesirable token associations inside attention without full retraining?