https://localfirstai.eu/tags/retrieval/Recent content in Retrieval on Local First AIHugoen-usTue, 22 Sep 2026 00:00:00 +0000https://localfirstai.eu/posts/2026-09-22-we-trained-it-three-times-then-stopped/Tue, 22 Sep 2026 00:00:00 +0000https://localfirstai.eu/posts/2026-09-22-we-trained-it-three-times-then-stopped/We wanted a small model on a phone that answers Spanish property questions the way a professional would: facts from our study notes via retrieval, the manner trained into the weights. Three LoRA runs later the manner was installed and the model was worse every time. The build that won has no trained weights at all. Here's the path, the numbers, and the hypothesis we'd like someone to break.