Evals

On Tuesday evening one of us sat in the audience at 42 Málaga, the coding school Fundación Telefónica runs in the city’s digital-content hub on Avenida Sor Teresa Prat, and watched five people, in four talks, take apart a question most of us skip. How do you know an AI’s answer is any good? Malaga-AI is a local community that has been running meetups for three years. Each year it runs a certified study group, and this year’s, from May to July, was on AI safety and evaluation, or in the programme’s words “trust, fairness and alignment”. Each student picked a question, built or borrowed a test, and ran it against real models. Tuesday was the final showcase. ...

Documentation lies. Not through malice — through drift. A feature ships. The build log gets a session note. The BRIEF does not. Six commits later, the architecture section still describes what was planned in March. The compliance pack shows a draft DPA when the final template has been sitting in compliance/ for two weeks. Nobody updated the corpus count after the witnessing pipeline landed twelve new listings. The code is ahead of the docs by a widening margin, and the gap compounds silently because nobody reads the whole project often enough to notice. ...