PolicyBench
Kimi K3
Moonshot AI · AI alone, no tools
United States rank
#2 of 25
US exact
86.2%
United States
United States benchmark
Exact match
86.2%
Bounded score
93.4%
Parse rate
96.8%
Eligibility flags
928/984
Score by programhardest first
| Program | Exact | Within 1% | n |
|---|---|---|---|
| State tax before refundable credits | 61.0% | 64.0% | 100 |
| Federal tax before refundable credits | 71.0% | 79.0% | 100 |
| SNAP | 77.0% | 81.0% | 100 |
| State refundable credits | 78.0% | 79.0% | 100 |
| Federal refundable credits | 90.0% | 92.0% | 100 |
| Person-level Medicare eligibility | 91.0% | 91.0% | 177 |
| Payroll tax | 92.0% | 93.0% | 100 |
| SSI | 93.0% | 93.0% | 100 |
| Person-level CHIP eligibility | 93.8% | 93.8% | 177 |
| Person-level Medicaid eligibility | 94.4% | 94.4% | 177 |
| Person-level Early Head Start eligibility | 94.7% | 94.7% | 38 |
| Person-level Head Start eligibility | 94.7% | 94.7% | 38 |
| Reduced-price school meals eligibility | 95.0% | 95.0% | 100 |
| Free school meals eligibility | 96.0% | 96.0% | 100 |
| TANF | 96.0% | 96.0% | 100 |
| Person-level WIC eligibility | 96.6% | 96.6% | 177 |
| Local income tax | 97.0% | 97.0% | 100 |
| Self-employment tax | 97.0% | 97.0% | 100 |
Hardest casesworst misses on positive references
- Federal tax before refundable creditsno parseable answerReference $643Inspect household #023
- Federal refundable creditsno parseable answerReference $0Inspect household #023
- Local income taxno parseable answerReference $0Inspect household #023
- Payroll taxno parseable answerReference $1,561Inspect household #023
- Self-employment taxno parseable answerReference $0Inspect household #023
- SNAPno parseable answerReference $461Inspect household #023
Scores are from the frozen manuscript snapshot under the AI-alone condition: one structured response per household, no tools, graded against PolicyEngine reference outputs. See the leaderboard and paper for methodology.