Docs Bueller's Rubrik FAQ

How Does the Evaluation Work?

June 16, 20261 min read

Each evaluation cycle administers 100 questions to multiple AI models. Models answer independently — they can't see each other's responses. Each response is scored on the rubric dimensions. Individual scores are aggregated into per-model totals, then cross-model consensus is computed. The process is fully automated and repeatable — same questions, same rubric, consistent methodology across cycles.

MG
Matthew J. Goss, Jr.
Retired COMEX/NYMEX floor trader, Goldman Sachs and FlexTrade Systems alumnus, multi-instrumentalist, published author, and independent mathematics researcher. Founder of Quantiterate.