BM-001
Scenario
This case tests the system's ability to produce a correct true negative — confirming that an APLMA-standard term loan deal contains no benchmark deviations. The Acme Corporation facility agreement uses standard APLMA documentation conventions with market-standard terms across all key economic fields. The expected behavior is not silence — the system must affirmatively confirm that each assessed term aligns with the applicable benchmark and must cite the relevant APLMA reference standard for each confirmation. Returning no output, returning "no issues found" without citation, or flagging standard terms as deviations are all scored as Fail.
Input
Document: acme-corp-facility-agreement.pdf
Task: Perform benchmark terms validation against applicable APLMA standards. The governing law is English law, and the deal is an APAC syndicated term loan — apply APLMA benchmarks. For each assessed term, state: deal value, APLMA benchmark, assessment (market-standard / potential deviation), and the benchmark reference.
Expected Output
| Term | Deal Value | APLMA Benchmark | Assessment | Benchmark Reference |
|---|---|---|---|---|
| Margin (BBB-equivalent borrower, APAC term loan, 5-year) | 220 bps per annum | Typical range: 150–250 bps for investment-grade APAC borrowers at 5-year tenor | Market-standard — within benchmark range | APLMA Primary Market Guide, Investment Grade Pricing Matrix (2025) |
| Reference Rate | Term SOFR (3-month) | SOFR or Term SOFR standard for USD-denominated APAC facilities post-2023 | Market-standard | APLMA SOFR Transition Guidance (2023) |
| Commitment Fee | 0.45% per annum on undrawn | Typical range: 35–55 bps for investment-grade term loans | Market-standard | APLMA Standard Form — Clause 12 (Fees) |
| Tenor | 60 months (5 years) | Standard tenor for investment-grade APAC term loans: 3–7 years | Market-standard | APLMA Primary Market Guide |
| MAC definition | Includes business, financial condition, and enforceability limbs | APLMA standard MAC definition covers same three limbs | Market-standard | APLMA Standard Form — Definitions |
| Negative Pledge | Present with Permitted Security carve-outs per Schedule 4 | APLMA standard includes negative pledge with permitted security schedule | Market-standard | APLMA Standard Form — Clause 22 |
| Governing Law | English law | English law is standard for APLMA-governed APAC syndicated loans | Market-standard | APLMA Standard Form — General Conditions |
Overall assessment: No deviations from APLMA benchmark standards detected across all assessed terms.
Ground Truth Citation
"The rate of interest on each Loan for each Interest Period is the percentage rate per annum which is the aggregate of (a) the Applicable Margin of 2.20% per annum; and (b) Term SOFR for a period equal in length to that Interest Period (3-month)."
Source: acme-corp-facility-agreement.pdf, Page 17, Clause 9.1 (Calculation of Interest)
"The Borrower shall pay to the Facility Agent (for the account of each Lender) a commitment fee computed at the rate of 0.45% per annum on the aggregate undrawn Available Commitment."
Source: acme-corp-facility-agreement.pdf, Page 18, Clause 12.1 (Commitment Fee)
"This Agreement and any non-contractual obligations arising out of or in connection with it are governed by English law."
Source: acme-corp-facility-agreement.pdf, Page 54, Clause 40.1 (Governing Law)
Benchmark authority note: APLMA Primary Market Guide (2025 edition) and APLMA Standard Form Term Loan credit agreement. These are the reference standards for benchmark comparison.
Scoring Criteria
| Condition | Score |
|---|---|
| All 7 terms assessed; all correctly classified as market-standard; each confirmation cites APLMA benchmark reference; no false positives | 1.0 |
| 6 of 7 terms assessed and confirmed market-standard; one term not assessed (omitted) | 0.85 |
| All terms assessed but 1 term incorrectly flagged as deviation without evidence (false positive) | 0.50 |
| Output is silence or "no deviations found" with no benchmark citations | 0.0 |
| Any benchmark value cited that is not from APLMA standards for this instrument type | 0.0 for that assessment |
Known Failure Modes
- Returning an empty output or a one-line "no deviations" without affirmative citations — this is not a valid true negative.
- Applying LMA (European) benchmarks instead of APLMA (Asian) benchmarks to this APAC deal.
- Flagging the Term SOFR reference rate as a deviation ("benchmark not standard") due to outdated training data predating SOFR transition.
- Flagging 220 bps as above-market for investment-grade borrowers without checking APLMA's actual pricing range for APAC IG borrowers.
Regression Note
N/A — initial case