Our Team of Small Models Against One Model That Thinks: More Stable, Less Useful
For months, most of what this site has built has had the same shape: a team of small models. Each local model answers one narrow question, and code holds everything between them: the joins, the rules and the facts. We wrote it up as a principle. In June we put it in a line we have repeated since: we didn’t upgrade the model, we upgraded the question. We had tested that idea against one model only once, with the model’s thinking turned off. In exp_050 we tested it on a whole task against one model allowed to think. Part of our case for a team of small models did not survive. ...