Kolibri Scored Below Gemma 4 in Our Property Assistant
On Tuesday Andrei asked whether we should train Kolibri-1, Aleph Alpha’s English–German mixture-of-experts model, as his property agent. We advised against training. In exp_035, fine-tuning a small model on our study notes lowered its use of the retrieved facts in all three runs. The best build was an untrained model behind deterministic glue. So exp_038 asks a narrow question. Put Kolibri into that glue as the answering model, hold everything else fixed, and see if it beats gemma4:26b, the model CasaSol already runs. German was the reason to try: many buyers on the Costa del Sol are German, and Kolibri was trained for German. ...