ContractRadar test set

CR-004 · contract change notice · 1 page · sha256 87ba5f0513421a76…

Contract change notice relying on the wrong ground

The notice cites section 74(1)(c) (below-threshold) for a +14.4% value change and a +33% term extension. The percentage is not printed. A rule engine should raise PA23-s74-exceeds-below-threshold and PA23-s74-substantial-term.

document.pdf gold.json expected.csv notes.md

Hazards

Pages

CR-004 page 1
Page 1

Gold labels and extractor output

✓ correct · ✗ wrong · – missing. Blank means the field is null in the gold and the extractor returned nothing (not counted).

FieldGoldllm:nim/z-ai/glm-5.3-flash:textllm:nvidia/nemotron-3-ultra-550b-a55b:free:textnaive_text
notice_typecontract_change_notice✓ contract_change_notice✓ contract_change_notice✓ contract_change_notice
notice_reference006540-2026✓ 006540-2026✓ 006540-2026✓ 006540-2026
contracting_authority criticalStonebridge Metropolitan Borough Council✓ Stonebridge Metropolitan Borough Council✓ Stonebridge Metropolitan Borough Council✓ Stonebridge Metropolitan Borough Council
contracting_authority_typesub_central✓ sub_central✓ sub_central✓ sub_central
supplier_name criticalAlderman Facilities Group Ltd✓ Alderman Facilities Group Ltd✓ Alderman Facilities Group Ltd✓ Alderman Facilities Group Ltd
supplier_registration_number09418832✓ 09418832✓ 09418832✓ 09418832
contract_title criticalFacilities Management for Corporate Buildings✓ Facilities Management for Corporate Buildings✓ Facilities Management for Corporate Buildings✓ Facilities Management for Corporate Buildings
contract_referenceSMBC/FM/2025/003✓ SMBC/FM/2025/003✓ SMBC/FM/2025/003✓ SMBC/FM/2025/003
procurement_typeservices✓ services✓ services✓ services
light_touchfalse✓ false✓ false✓ false
procedurecompetitive_flexible✓ competitive_flexible✓ competitive_flexible✓ competitive_flexible
cpv_codes["79993100", "50700000", "90911200"]✓ ["79993100", "50700000", "90911200"]✓ ["79993100", "50700000", "90911200"]✓ ["79993100", "50700000", "90911200"]
notice_published_date2026-05-04✓ 2026-05-04✓ 2026-05-04✓ 2026-05-04
award_date2025-11-14✓ 2025-11-14✓ 2025-11-14✓ 2025-11-14
contract_signed_date2026-03-20✓ 2026-03-20✓ 2026-03-20✓ 2026-03-20
contract_start_date critical2026-04-01✓ 2026-04-01✓ 2026-04-01✓ 2026-04-01
contract_end_date criticalnull✗ 2029-03-31✗ 2029-03-31·
extension_options_months0✓ 0✓ 0✓ 0
maximum_term_months36✓ 36✓ 36– null
contract_value_gbp criticalnull✗ 1,800,000✗ 1,800,000·
value_includes_vatfalse✓ false✓ false– null
number_of_tenders_receivednull· · ·
kpisnull· · ·
payment_terms_daysnull· · ·
standstill_end_datenull· · ·
lots[]· · ·
modification_number1✓ 1✓ 1✓ 1
modification_date2026-05-11✓ 2026-05-11✓ 2026-05-11✓ 2026-05-11
modification_descriptionAddition of three annexe buildings to the cleaning and M&E maintenance scope following the transfer of the Riverside offices to the Council, and a 12-month extension of the term to align with the corporate accommodation strategy.✓ Addition of three annexe buildings to the cleaning and M&E maintenance scope following the transfer of the Riverside offices to the Council, and a 12-month extension of the term to align with the corporate accommodation strategy.✓ Addition of three annexe buildings to the cleaning and M&E maintenance scope following the transfer of the Riverside offices to the Council, and a 12-month extension of the term to align with the corporate accommodation strategy.✗ Addition of three annexe buildings to the cleaning and M&E maintenance scope
modification_ground criticals74_below_threshold✓ s74_below_threshold✓ s74_below_threshold✓ s74_below_threshold
original_contract_value_gbp1,800,000✓ 1,800,000✓ 1,800,000– null
revised_contract_value_gbp2,060,000✓ 2,060,000✓ 2,060,000– null
value_change_gbp critical260,000✓ 260,000✓ 260,000✓ 260,000
value_change_percent14.4✓ 14.4✓ 14.4– null
original_end_date2029-03-31✓ 2029-03-31✓ 2029-03-31– null
revised_end_date critical2030-03-31✓ 2030-03-31✓ 2030-03-31✓ 2030-03-31
term_change_months12✓ 12✓ 12✓ 12
contract_change_notice_publishedtrue✓ true✓ true✓ true
voluntary_standstilltrue✓ true✓ true✓ true

Expected rule-engine flags

RuleSeverityDetail
PA23-threshold-in-scopeinfoValue £1,800,000 is at or above the services threshold £207,720 (inc VAT) applicable on 2026-05-04.
PA23-s74-exceeds-below-thresholdhighValue change +14.4% exceeds the 10% below-threshold limit for services in s.74(4).
PA23-s74-substantial-termhighTerm change +12 months is +33.3% of the 36-month maximum term: a substantial modification under s.74(3)(a) with no Schedule 8 ground.

Provenance: Fictional authority, supplier and figures. Generated for extraction testing; not a real notice. Generator crtest.gen 0.1.0, licence CC0-1.0.