PolicyBench
GLM-5.2
Z.ai · AI alone, no tools
United States rank
#16 of 23
US exact
73.1%
United States
United States benchmark
Exact match
73.1%
Bounded score
84.0%
Parse rate
93.0%
Eligibility flags
894/984
Score by programhardest first
| Program | Exact | Within 1% | n |
|---|---|---|---|
| Federal tax before refundable credits | 43.0% | 43.0% | 100 |
| State tax before refundable credits | 45.0% | 46.0% | 100 |
| State refundable credits | 72.0% | 72.0% | 100 |
| Payroll tax | 73.0% | 80.0% | 100 |
| SNAP | 76.0% | 78.0% | 100 |
| Federal refundable credits | 79.0% | 79.0% | 100 |
| Person-level Medicaid eligibility | 85.9% | 85.9% | 177 |
| Person-level Medicare eligibility | 89.3% | 89.3% | 177 |
| Person-level Early Head Start eligibility | 89.5% | 89.5% | 38 |
| Person-level Head Start eligibility | 89.5% | 89.5% | 38 |
| SSI | 90.0% | 90.0% | 100 |
| Self-employment tax | 91.0% | 91.0% | 100 |
| Person-level WIC eligibility | 92.7% | 92.7% | 177 |
| Free school meals eligibility | 93.0% | 93.0% | 100 |
| Person-level CHIP eligibility | 93.2% | 93.2% | 177 |
| Local income tax | 94.0% | 94.0% | 100 |
| Reduced-price school meals eligibility | 94.0% | 94.0% | 100 |
| TANF | 94.0% | 94.0% | 100 |
Hardest casesworst misses on positive references
- Federal refundable creditsno parseable answerReference $12,434Inspect household #008
- Payroll taxno parseable answerReference $2,163Inspect household #008
- Self-employment taxno parseable answerReference $565Inspect household #008
- State tax before refundable creditsno parseable answerReference $265Inspect household #008
- State refundable creditsno parseable answerReference $5,342Inspect household #008
- Federal tax before refundable creditsno parseable answerReference $0Inspect household #027
Scores are from the frozen manuscript snapshot under the AI-alone condition: one structured response per household, no tools, graded against PolicyEngine reference outputs. See the leaderboard and paper for methodology.