We Ported Aleph Alpha's Kolibri to a MacBook. Our Own Gate Said No.
Update, 5 October (evening): after publishing, we narrowed the M5 result to one MLX operation, with an exact trigger, and reported it upstream. See the update at the end of section 3. Aleph Alpha released Kolibri-1 on Saturday, 3 October. It is a mixture-of-experts model: 78.1 billion parameters in total, 3.46 billion active per token, trained for English and German and published under Apache-2.0. That day it had no MLX build and no GGUF, and no local runtime supported it. We wanted to know three things: ...