PolicyBench

Inkling

Thinking Machines · AI alone, no tools

United States rank

#4 of 29

US exact

83.8%

United States

United States benchmark

Exact match

83.8%

Bounded score

94.9%

Parse rate

100.0%

Eligibility flags

973/984

Score by programhardest first

Program	Exact	Within 1%	n
State tax before refundable credits	53.0%	56.0%	100
Federal tax before refundable credits	60.0%	68.0%	100
SNAP	79.0%	84.0%	100
State refundable credits	80.0%	80.0%	100
Payroll tax	81.0%	86.0%	100
Federal refundable credits	87.0%	92.0%	100
SSI	96.0%	96.0%	100
Person-level Medicaid eligibility	97.7%	97.7%	177
Reduced-price school meals eligibility	98.0%	98.0%	100
Person-level Medicare eligibility	98.9%	98.9%	177
Person-level WIC eligibility	98.9%	98.9%	177
Free school meals eligibility	99.0%	99.0%	100
Local income tax	99.0%	99.0%	100
Self-employment tax	99.0%	99.0%	100
TANF	99.0%	99.0%	100
Person-level CHIP eligibility	100.0%	100.0%	177
Person-level Early Head Start eligibility	100.0%	100.0%	38
Person-level Head Start eligibility	100.0%	100.0%	38

Hardest casesworst misses on positive references

Federal tax before refundable credits543% off
Reference $1,346 · predicted $8,656
Inspect household #039
SNAP446% off
Reference $461 · predicted $2,520
Inspect household #023
State tax before refundable credits292% off
Reference $514 · predicted $2,019
Inspect household #039
State tax before refundable credits186% off
Reference $1,028 · predicted $2,936
Inspect household #122
State refundable credits169% off
Reference $473 · predicted $1,275
Inspect household #100
State tax before refundable credits131% off
Reference $756 · predicted $1,747
Inspect household #007

Scores are from the frozen manuscript snapshot under the AI-alone condition: one structured response per household, no tools, graded against PolicyEngine reference outputs. See the leaderboard and paper for methodology.