PolicyBench
Ox Alpha (preview)
United States rank
#4 of 32
US exact
84.2%
United States
United States benchmark
Exact match
84.2%
Bounded score
93.3%
Parse rate
100.0%
Eligibility flags
956/984
Score by programhardest first
| Program | Exact | Within 1% | n |
|---|---|---|---|
| State tax before refundable credits | 55.0% | 59.0% | 100 |
| Federal tax before refundable credits | 63.0% | 70.0% | 100 |
| SNAP | 79.0% | 83.0% | 100 |
| State refundable credits | 79.0% | 79.0% | 100 |
| Federal refundable credits | 84.0% | 88.0% | 100 |
| Payroll tax | 87.0% | 89.0% | 100 |
| Person-level CHIP eligibility | 92.7% | 92.7% | 177 |
| Person-level Medicaid eligibility | 93.8% | 93.8% | 177 |
| Free school meals eligibility | 98.0% | 98.0% | 100 |
| SSI | 98.0% | 98.0% | 100 |
| Reduced-price school meals eligibility | 99.0% | 99.0% | 100 |
| Self-employment tax | 99.0% | 99.0% | 100 |
| TANF | 99.0% | 99.0% | 100 |
| Person-level Medicare eligibility | 99.4% | 99.4% | 177 |
| Local income tax | 100.0% | 100.0% | 100 |
| Person-level Early Head Start eligibility | 100.0% | 100.0% | 38 |
| Person-level Head Start eligibility | 100.0% | 100.0% | 38 |
| Person-level WIC eligibility | 100.0% | 100.0% | 177 |
Hardest casesworst misses on positive references
- State tax before refundable credits630% offReference $514 · predicted $3,755Inspect household #039
- Federal tax before refundable credits539% offReference $1,346 · predicted $8,596Inspect household #039
- State tax before refundable credits194% offReference $7 · predicted $20Inspect household #023
- SNAP110% offReference $2,428 · predicted $5,100Inspect household #079
- Federal tax before refundable credits102% offReference $3,256 · predicted $6,573Inspect household #086
- State refundable credits100% offReference $25 · predicted $0Inspect household #013
Scores are from the frozen manuscript snapshot under the AI-alone condition: one structured response per household, no tools, graded against PolicyEngine reference outputs. See the leaderboard and paper for methodology.