Evaluation Benchmark & Counterfactual Analysis

Head-to-head empirical evaluation of AI Recovery Strategist vs Static Calendar Baseline Policy across 70 invoices & 20 debtors.

RNG Seed: 42 As-Of: 2026-08-26 Deterministic Evaluator (Mock)
Reset (Seed 42)

Portfolio Overview & Headline Benchmark Metrics

Empirically Grounded
Total Book Value Exposure
Rs 62,937,200
70 invoices across 20 commercial debtors
True Collectible Balance Net of Deductions
Rs 51,243,531
vs Rs 51,390,321 Naive Outstanding (Prevents โ‚น1.46L wrongful TDS dunning)
WAIT Restraint Share Noise Reduction
10.0% vs 0.0% Base
2/20 accounts held back under reliable payer & opt-out policy
Reconciliation Routing Tax & Bank UTR
40.0%
8/20 accounts routed to Form 26AS TDS & UTR verification
Prevented Escalations Relationship Protection
20/20
100% of indiscriminate Day 30+ legal threat notices intercepted & blocked
Touch Efficiency Outreach ROI
0.03 touches/Lakh
Agent 16 touches vs Baseline 20 touches (0.04/Lakh)

Visual Strategy Distribution: AI Agent vs Calendar Baseline

Action breakdown demonstrating dynamic multi-door routing vs single-track calendar escalation

AI Agent
Calendar Baseline
WAIT
Agent
2 (10.0%)
Baseline
0 (0.0%)
RECONCILE
Agent
8 (40.0%)
Baseline
0 (0.0%)
REQUEST_PAYMENT
Agent
5 (25.0%)
Baseline
0 (0.0%)
OBTAIN_PROMISE
Agent
0 (0.0%)
Baseline
0 (0.0%)
RESOLVE_DISPUTE
Agent
3 (15.0%)
Baseline
0 (0.0%)
ESCALATE
Agent
0 (0.0%)
Baseline
20 (100.0%)
HUMAN_HANDOFF
Agent
2 (10.0%)
Baseline
0 (0.0%)

Hard-Case Adjudication Matrix (8 Curated Archetypes)

Head-to-head decision audits across commercial edge cases. Click any debtor row or press Enter to expand deep causal reasoning & drafted copy previews.

Debtor & Hard-Case Archetype Baseline Policy Action AI Agent Decision Adjudication Verdict Drill-down
Kaveri Textiles Pvt Ltd
DEB-004 • TDS Deducted (Form 26AS Reconciliation)
ESCALATE (email, Rs 6,052,664)
Single-track calendar dunning
RECONCILE (email, Rs 0)
Policy Envelope calibrated
Agent Win (Prevents false underpayment accusation)

Debtor Context & Profile

Deducted 10% TDS under Section 194C/J and remitted net balance. Regular commercial account.

Why Baseline Erred

Blindly treated the statutory TDS withholding shortfall as a delinquent default and issued an aggressive escalation notice demanding unowed money.

Why Agent Won

Recognized legitimate tax withholding, suppressed debt collection dunning, and requested Form 26AS certificate for seamless accounting reconciliation without friction.

Drafted Outreach Copy EMAIL • EN
Subject: TDS Reconciliation Request: Invoices INV-4020, INV-4028, INV-4043, INV-4212, INV-4318 - Nandi Precision Components
Meridian Logistics
DEB-005 • Off-Rail NEFT Payment (UTR Verification)
ESCALATE (email, Rs 744,400)
Single-track calendar dunning
RECONCILE (email, Rs 0)
Policy Envelope calibrated
Agent Win (Prevents double-billing good payer)

Debtor Context & Profile

Paid full invoice balance via offline direct NEFT/RTGS bank transfer with UTR submitted.

Why Baseline Erred

Missed direct bank credit because funds bypassed payment link; escalated and threatened legal action against an already settled customer.

Why Agent Won

Flagged UTR reference on record, initiated banking ledger reconciliation, and avoided humiliating double-billing of a good payer.

Drafted Outreach Copy EMAIL • EN
Subject: Payment Verification (UTR Confirmation) - Nandi Precision Components
Pushpa Foods Pvt Ltd
DEB-020 • Active Dispute (Dispute Triage & MSMED Clock Reset)
ESCALATE (email, Rs 718,300)
Single-track calendar dunning
RESOLVE_DISPUTE (email, Rs 0)
Policy Envelope calibrated
Agent Win (Complies with MSMED s.15 objection rules)

Debtor Context & Profile

Raised formal goods/service quality objection within 15-day statutory objection window under MSMED Section 15.

Why Baseline Erred

Escalated demand notice with statutory compound penal interest despite open dispute, violating MSMED Section 15 deemed acceptance rules.

Why Agent Won

Suspended statutory interest clock, paused collection chasing, and routed objection to human dispute triage with structured evidence checklist.

Drafted Outreach Copy EMAIL • EN
Subject: Dispute Triage & Clarification: Invoices INV-4230 - Sagar Trading Company
Mahalaxmi Hardware
DEB-018 • Trader Merchant Refusal (MSMED Exclusion)
ESCALATE (email, Rs 10,361,700)
Single-track calendar dunning
REQUEST_PAYMENT (email, Rs 10,361,700)
Policy Envelope calibrated
Agent Win (Avoids unlawful statutory threats)

Debtor Context & Profile

Supplier is a registered retail/wholesale trader (NIC 45-47), strictly ineligible for MSMED Section 15/16 benefits.

Why Baseline Erred

Unlawfully threatened MSMED Section 15/16 3x RBI compound penal interest and Section 43B(h) tax disallowance on behalf of a non-manufacturing trader.

Why Agent Won

Strictly enforced statutory eligibility bounds, refused unlawful legal threats, and calibrated communication to a firm commercial collection notice.

Drafted Outreach Copy EMAIL • HINGLISH
Subject: Payment Reminder - Sagar Trading Company (INV-4007, INV-4008, INV-4111, INV-4119, INV-4258, INV-4344)
Everest Cold Chain
DEB-012 • VIP Relationship Protection (<5% Exposure)
ESCALATE (email, Rs 266,760)
Single-track calendar dunning
RECONCILE (email, Rs 0)
Policy Envelope calibrated
Agent Win (Protects a high-value account the baseline would escalate)

Debtor Context & Profile

Strategic enterprise buyer with โ‚น8.4 Cr annual turnover and <5% portfolio exposure. Minor invoice timing friction.

Why Baseline Erred

Applied rigid calendar dunning ladder and sent abrasive escalation notice, jeopardizing multi-crore enterprise contract over minor timing friction.

Why Agent Won

Policy envelope enforced VIP relationship protection, barring abrasive dunning and routing to polite collaborative reconciliation.

Drafted Outreach Copy EMAIL • HINGLISH
Subject: TDS Certificate Request - Nandi Precision Components (INV-4058, INV-4353)
Girija Chemicals Pvt Ltd
DEB-008 • Opt-Out Debtor (Zero-Harassment Compliance)
ESCALATE (email, Rs 2,372,600)
Single-track calendar dunning
WAIT (none, Rs 0)
Policy Envelope calibrated
Agent Win (Zero harassment compliance)

Debtor Context & Profile

Registered explicit opt-out request under DPDP / TRAI commercial communication regulations.

Why Baseline Erred

Repeatedly spammed debtor with automated WhatsApp and email demands, committing direct regulatory compliance violations.

Why Agent Won

Enforced immediate, permanent contact suppression (WAIT with 0 touches), maintaining complete regulatory compliance.

Outbound communication suppressed by policy envelope (Zero-Touch WAIT Restraint).
Silverline Interiors
DEB-017 • Reliable Late Payer (Restraint over Noise)
ESCALATE (email, Rs 1,533,300)
Single-track calendar dunning
WAIT (none, Rs 0)
Policy Envelope calibrated
Agent Win (Avoids spamming reliable customers)

Debtor Context & Profile

Habitual late payer (avg ~5 days late) with 7 of 7 promises kept; 100% historical settlement record.

Why Baseline Erred

Sent premature intrusive dunning reminders on Day 30, generating unnecessary noise and annoying a loyal paying client.

Why Agent Won

Exercised intelligent WAIT restraint, trusting debtor's verified payment cycle and achieving zero-touch recovery without friction.

Outbound communication suppressed by policy envelope (Zero-Touch WAIT Restraint).
Nova Retail Systems
DEB-007 • Complex Mixed-State Account (Human Handoff)
ESCALATE (email, Rs 1,254,986)
Single-track calendar dunning
HUMAN_HANDOFF (none, Rs 0)
Policy Envelope calibrated
Agent defers to human review (baseline escalates regardless)

Debtor Context & Profile

3+ open invoices across conflicting states (dispute + partial payment + overdue) with low promise reliability.

Why Baseline Erred

Applied generic single-invoice escalation rule blind to composite account complexity, risking litigation.

Why Agent Won

Recognized aggregate ambiguity exceeded autonomous confidence threshold and safely routed to human credit specialist (HUMAN_HANDOFF).

Outbound communication suppressed by policy envelope (Defers to Human Credit Specialist).