PolicyBench
Grok 4.3
xAI · AI alone, no tools
United States rank
#8 of 23
US exact
77.2%
United States
United States benchmark
Exact match
77.2%
Bounded score
87.1%
Parse rate
100.0%
Eligibility flags
946/984
Score by programhardest first
| Program | Exact | Within 1% | n |
|---|---|---|---|
| Federal tax before refundable credits | 49.0% | 52.0% | 100 |
| State tax before refundable credits | 57.0% | 60.0% | 100 |
| Payroll tax | 77.0% | 84.0% | 100 |
| SNAP | 78.0% | 78.0% | 100 |
| State refundable credits | 79.0% | 79.0% | 100 |
| Federal refundable credits | 84.0% | 84.0% | 100 |
| Person-level Medicaid eligibility | 88.7% | 88.7% | 177 |
| Self-employment tax | 96.0% | 99.0% | 100 |
| Person-level CHIP eligibility | 96.0% | 96.0% | 177 |
| SSI | 97.0% | 97.0% | 100 |
| Person-level Early Head Start eligibility | 97.4% | 97.4% | 38 |
| Person-level Head Start eligibility | 97.4% | 97.4% | 38 |
| Person-level WIC eligibility | 97.7% | 97.7% | 177 |
| Person-level Medicare eligibility | 98.3% | 98.3% | 177 |
| Free school meals eligibility | 99.0% | 99.0% | 100 |
| Reduced-price school meals eligibility | 99.0% | 99.0% | 100 |
| TANF | 99.0% | 99.0% | 100 |
| Local income tax | 100.0% | 100.0% | 100 |
Hardest casesworst misses on positive references
- Federal tax before refundable credits1601% offReference $500 · predicted $8,500Inspect household #046
- Federal tax before refundable credits495% offReference $1,346 · predicted $8,000Inspect household #039
- Federal tax before refundable credits204% offReference $4,439 · predicted $13,500Inspect household #064
- Federal tax before refundable credits169% offReference $5,200 · predicted $14,000Inspect household #123
- Federal tax before refundable credits113% offReference $24,392 · predicted $52,000Inspect household #117
- Federal tax before refundable credits100% offReference $2,883 · predicted $0Inspect household #000
Scores are from the frozen manuscript snapshot under the AI-alone condition: one structured response per household, no tools, graded against PolicyEngine reference outputs. See the leaderboard and paper for methodology.