Inference on Local First AIhttps://localfirstai.eu/tags/inference/Recent content in Inference on Local First AIHugoen-usTue, 28 Apr 2026 00:00:00 +0000The Memory Bandwidth Cliff: Lessons from an AI Runawayhttps://localfirstai.eu/posts/2026-04-28-incident_003_alpha_post/Tue, 28 Apr 2026 00:00:00 +0000https://localfirstai.eu/posts/2026-04-28-incident_003_alpha_post/An investigation into the super-quadratic prefill latency and memory bandwidth bottleneck observed on the Gemma 4 26B stack.