Expand PolicyBench to your region, population, or program
Families already ask AI about the questions that decide their month: Do I qualify for SNAP? How much is my credit? Will this job cost me Medicaid? The public board tests 30 frontier models on 100 real households. The best model computes 88.7% of amounts within $1. On SNAP cases where the family is owed benefits, models answer exactly $0 in 42% of answers, and no model gets more than 1 case in 20 right. On Medicaid eligibility, the median model misclassifies 1 person in 15; the weakest, nearly 1 in 3. A family told “$0” does not apply. Those are national numbers — nobody measures this for your region.
A PolicyBench slice measures it. We draw households from survey microdata weighted to your population, cover your programs, benchmark the models behind the tools your people use, and compute every reference from the law with PolicyEngine. Every miss gets a diagnosed failure mode. You get a public slice leaderboard, a written analysis of where models fail your population, and a briefing. The answer key checks itself in public: references come from open-source code, cross-checked against other calculators where they exist, and challenged values get adjudicated against the statute — the methodology and adjudication record are published.
We size samples to the confidence width your question needs, from your population — not a fixed household count. Any slice can add standing coverage: quarterly refresh and re-analysis, new models as they ship, and technical assistance to grantees building AI tools — priced with the slice.
Funders buy coverage: households, programs, regions, refresh cadence. Funding never buys scores, rankings, or placement. No model vendor pays for evaluation — vendor funding for separate projects never touches the benchmark. Every slice stays public — prompts, references, predictions, and diagnoses.
PolicyBench is a project of PolicyEngine, a 501(c)(3) nonprofit — engagements work as grants or contracts. We also brief funder networks — one slice presented to a convened room goes further than a dozen pitches, and we are glad to present at yours.