PolicyBench
Claude Haiku 4.5
Anthropic · AI alone, no tools
United States rank
#19 of 23
US exact
71.7%
United States
United States benchmark
Exact match
71.7%
Bounded score
82.1%
Parse rate
100.0%
Eligibility flags
901/984
Score by programhardest first
| Program | Exact | Within 1% | n |
|---|---|---|---|
| Federal tax before refundable credits | 46.0% | 48.0% | 100 |
| State tax before refundable credits | 55.0% | 56.0% | 100 |
| Payroll tax | 65.0% | 71.0% | 100 |
| Federal refundable credits | 75.0% | 75.0% | 100 |
| State refundable credits | 79.0% | 79.0% | 100 |
| SNAP | 80.0% | 80.0% | 100 |
| Person-level Medicaid eligibility | 82.5% | 82.5% | 177 |
| Person-level Early Head Start eligibility | 86.8% | 86.8% | 38 |
| Person-level CHIP eligibility | 90.4% | 90.4% | 177 |
| Self-employment tax | 91.0% | 94.0% | 100 |
| Reduced-price school meals eligibility | 92.0% | 92.0% | 100 |
| Person-level WIC eligibility | 92.7% | 92.7% | 177 |
| Person-level Medicare eligibility | 96.6% | 96.6% | 177 |
| SSI | 97.0% | 97.0% | 100 |
| Person-level Head Start eligibility | 97.4% | 97.4% | 38 |
| Free school meals eligibility | 98.0% | 98.0% | 100 |
| Local income tax | 99.0% | 99.0% | 100 |
| TANF | 99.0% | 99.0% | 100 |
Hardest casesworst misses on positive references
- SNAP978% offReference $288 · predicted $3,100Inspect household #045
- Federal tax before refundable credits587% offReference $500 · predicted $3,433Inspect household #046
- State tax before refundable credits151% offReference $2,087 · predicted $5,238Inspect household #026
- Federal tax before refundable credits145% offReference $9,563 · predicted $23,437Inspect household #082
- Payroll tax136% offReference $5,040 · predicted $11,894Inspect household #089
- State tax before refundable credits136% offReference $1,922 · predicted $4,533Inspect household #025
Scores are from the frozen manuscript snapshot under the AI-alone condition: one structured response per household, no tools, graded against PolicyEngine reference outputs. See the leaderboard and paper for methodology.