https://www.jonam.io/tags/inference/Recent content in Inference on jonam'LogHugo -- gohugo.ioen© 2026 Manoj. All Rights Reserved.Mon, 18 May 2026 00:00:00 +0000https://www.jonam.io/journal/inference-engineering/research-topics/attention-head-similarity-pruning/Mon, 18 May 2026 00:00:00 +0000https://www.jonam.io/journal/inference-engineering/research-topics/attention-head-similarity-pruning/Measure cross-head similarity on a prompt and skip heads that are redundant for that input.https://www.jonam.io/journal/inference-engineering/product-ideas/specdraft-cloud/Mon, 18 May 2026 00:00:00 +0000https://www.jonam.io/journal/inference-engineering/product-ideas/specdraft-cloud/A draft model service that learns from accepted and rejected tokens.https://www.jonam.io/journal/inference-engineering/research-topics/Mon, 18 May 2026 00:00:00 +0000https://www.jonam.io/journal/inference-engineering/research-topics/Novel and practical research directions around KV cache compression, scheduling, speculation, quantization, and hardware-aware serving.https://www.jonam.io/journal/inference-engineering/Mon, 18 May 2026 00:00:00 +0000https://www.jonam.io/journal/inference-engineering/A living notebook for inference engineering research topics and product ideas.https://www.jonam.io/journal/inference-engineering/product-ideas/Mon, 18 May 2026 00:00:00 +0000https://www.jonam.io/journal/inference-engineering/product-ideas/Ten product directions built from KV cache reuse, roofline scheduling, speculative decoding, and inference observability.https://www.jonam.io/files/inference-engineering-lecture-3/Thu, 30 Apr 2026 00:00:00 +0000https://www.jonam.io/files/inference-engineering-lecture-3/Practical applications and case studies in inference systemshttps://www.jonam.io/files/inference-engineering-lecture-2/Tue, 28 Apr 2026 00:00:00 +0000https://www.jonam.io/files/inference-engineering-lecture-2/Advanced concepts in inference engineering and optimization techniques