7 blank unknown annotations were caused by the benchmark CSV writer after explicit model-supplied JSON nulls; these are harness delivery failures, not model factual errors.
R6774 / outstanding_balance_usd: artifact differs from answer or lacks explicit unknown
R4598 / outstanding_balance_usd: artifact differs from answer or lacks explicit unknown
R7567 / outstanding_balance_usd: artifact differs from answer or lacks explicit unknown
R8446 / outstanding_balance_usd: artifact differs from answer or lacks explicit unknown
R8446 / contact_email: artifact differs from answer or lacks explicit unknown
R2663 / outstanding_balance_usd: artifact differs from answer or lacks explicit unknown
R3927 / outstanding_balance_usd: artifact differs from answer or lacks explicit unknown
7 blank unknown annotations were caused by the benchmark CSV writer after explicit model-supplied JSON nulls; these are harness delivery failures, not model factual errors.
R1514 / outstanding_balance_usd: artifact differs from answer or lacks explicit unknown
R4598 / outstanding_balance_usd: artifact differs from answer or lacks explicit unknown
R7567 / outstanding_balance_usd: artifact differs from answer or lacks explicit unknown
R8446 / outstanding_balance_usd: artifact differs from answer or lacks explicit unknown
R8446 / contact_email: artifact differs from answer or lacks explicit unknown
R2663 / outstanding_balance_usd: artifact differs from answer or lacks explicit unknown
R3927 / outstanding_balance_usd: artifact differs from answer or lacks explicit unknown
7 blank unknown annotations were caused by the benchmark CSV writer after explicit model-supplied JSON nulls; these are harness delivery failures, not model factual errors.
R8920 / outstanding_balance_usd: artifact differs from answer or lacks explicit unknown
R2258 / outstanding_balance_usd: artifact differs from answer or lacks explicit unknown
R8680 / outstanding_balance_usd: artifact differs from answer or lacks explicit unknown
R9318 / outstanding_balance_usd: artifact differs from answer or lacks explicit unknown
R9318 / contact_email: artifact differs from answer or lacks explicit unknown
R7666 / outstanding_balance_usd: artifact differs from answer or lacks explicit unknown
R8605 / outstanding_balance_usd: artifact differs from answer or lacks explicit unknown
7 blank unknown annotations were caused by the benchmark CSV writer after explicit model-supplied JSON nulls; these are harness delivery failures, not model factual errors.
R8920 / outstanding_balance_usd: artifact differs from answer or lacks explicit unknown
R2258 / outstanding_balance_usd: artifact differs from answer or lacks explicit unknown
R8680 / outstanding_balance_usd: artifact differs from answer or lacks explicit unknown
R9318 / outstanding_balance_usd: artifact differs from answer or lacks explicit unknown
R9318 / contact_email: artifact differs from answer or lacks explicit unknown
R7666 / outstanding_balance_usd: artifact differs from answer or lacks explicit unknown
R8605 / outstanding_balance_usd: artifact differs from answer or lacks explicit unknown
7 blank unknown annotations were caused by the benchmark CSV writer after explicit model-supplied JSON nulls; these are harness delivery failures, not model factual errors.
R7391 / outstanding_balance_usd: artifact differs from answer or lacks explicit unknown
R4643 / outstanding_balance_usd: artifact differs from answer or lacks explicit unknown
R3353 / outstanding_balance_usd: artifact differs from answer or lacks explicit unknown
R2253 / outstanding_balance_usd: artifact differs from answer or lacks explicit unknown
R2253 / contact_email: artifact differs from answer or lacks explicit unknown
R5546 / outstanding_balance_usd: artifact differs from answer or lacks explicit unknown
R7918 / outstanding_balance_usd: artifact differs from answer or lacks explicit unknown
7 blank unknown annotations were caused by the benchmark CSV writer after explicit model-supplied JSON nulls; these are harness delivery failures, not model factual errors.
R2362 / outstanding_balance_usd: artifact differs from answer or lacks explicit unknown
R4643 / outstanding_balance_usd: artifact differs from answer or lacks explicit unknown
R3353 / outstanding_balance_usd: artifact differs from answer or lacks explicit unknown
R2253 / outstanding_balance_usd: artifact differs from answer or lacks explicit unknown
R2253 / contact_email: artifact differs from answer or lacks explicit unknown
R5546 / outstanding_balance_usd: artifact differs from answer or lacks explicit unknown
R7918 / outstanding_balance_usd: artifact differs from answer or lacks explicit unknown
7 blank unknown annotations were caused by the benchmark CSV writer after explicit model-supplied JSON nulls; these are harness delivery failures, not model factual errors.
R3529 / outstanding_balance_usd: artifact differs from answer or lacks explicit unknown
R9410 / outstanding_balance_usd: artifact differs from answer or lacks explicit unknown
R8389 / outstanding_balance_usd: artifact differs from answer or lacks explicit unknown
R2818 / outstanding_balance_usd: artifact differs from answer or lacks explicit unknown
R2818 / contact_email: artifact differs from answer or lacks explicit unknown
R1318 / outstanding_balance_usd: artifact differs from answer or lacks explicit unknown
R5792 / outstanding_balance_usd: artifact differs from answer or lacks explicit unknown
7 blank unknown annotations were caused by the benchmark CSV writer after explicit model-supplied JSON nulls; these are harness delivery failures, not model factual errors.
R3529 / outstanding_balance_usd: artifact differs from answer or lacks explicit unknown
R9410 / outstanding_balance_usd: artifact differs from answer or lacks explicit unknown
R8389 / outstanding_balance_usd: artifact differs from answer or lacks explicit unknown
R2818 / outstanding_balance_usd: artifact differs from answer or lacks explicit unknown
R2818 / contact_email: artifact differs from answer or lacks explicit unknown
R1318 / outstanding_balance_usd: artifact differs from answer or lacks explicit unknown
R5792 / outstanding_balance_usd: artifact differs from answer or lacks explicit unknown
3 blank unknown annotations were caused by the benchmark CSV writer after explicit model-supplied JSON nulls; these are harness delivery failures, not model factual errors.
R6968 / outstanding_balance_usd: artifact differs from answer or lacks explicit unknown
R7631 / outstanding_balance_usd: artifact differs from answer or lacks explicit unknown
R7798 / outstanding_balance_usd: artifact differs from answer or lacks explicit unknown
2 blank unknown annotations were caused by the benchmark CSV writer after explicit model-supplied JSON nulls; these are harness delivery failures, not model factual errors.
R6968 / outstanding_balance_usd: artifact differs from answer or lacks explicit unknown
R7631 / outstanding_balance_usd: artifact differs from answer or lacks explicit unknown
Infrastructure failure: both 300-second requests timed out. No answer or known charge was returned. The 3 requested shortlist slots and 20 candidate decisions remain unanswered in aggregate success denominators. This is not counted as a model factual error.
1 blank unknown annotations were caused by the benchmark CSV writer after explicit model-supplied JSON nulls; these are harness delivery failures, not model factual errors.
R4787 / contact_email: artifact differs from answer or lacks explicit unknown
1 blank unknown annotations were caused by the benchmark CSV writer after explicit model-supplied JSON nulls; these are harness delivery failures, not model factual errors.
R4787 / contact_email: artifact differs from answer or lacks explicit unknown
1 blank unknown annotations were caused by the benchmark CSV writer after explicit model-supplied JSON nulls; these are harness delivery failures, not model factual errors.
R6968 / contact_email: artifact differs from answer or lacks explicit unknown
1 blank unknown annotations were caused by the benchmark CSV writer after explicit model-supplied JSON nulls; these are harness delivery failures, not model factual errors.
R6968 / contact_email: artifact differs from answer or lacks explicit unknown
1 blank unknown annotations were caused by the benchmark CSV writer after explicit model-supplied JSON nulls; these are harness delivery failures, not model factual errors.
R3919 / contact_email: artifact differs from answer or lacks explicit unknown
1 blank unknown annotations were caused by the benchmark CSV writer after explicit model-supplied JSON nulls; these are harness delivery failures, not model factual errors.
R9831 / contact_email: artifact differs from answer or lacks explicit unknown
1 blank unknown annotations were caused by the benchmark CSV writer after explicit model-supplied JSON nulls; these are harness delivery failures, not model factual errors.
R9831 / contact_email: artifact differs from answer or lacks explicit unknown
