ContractRadar test set

CR-001 · contract award notice · 1 page · sha256 72be93e02222eb0e…

Contract award notice, clean layout

Baseline. Bordered key/value table, long-form dates, standard money. Every extractor should get this right.

document.pdf gold.json expected.csv notes.md

Hazards

Pages

CR-001 page 1
Page 1

Gold labels and extractor output

✓ correct · ✗ wrong · – missing. Blank means the field is null in the gold and the extractor returned nothing (not counted).

FieldGoldllm:nim/z-ai/glm-5.3-flash:textllm:nvidia/nemotron-3-ultra-550b-a55b:free:textnaive_text
notice_typecontract_award_notice✓ contract_award_notice✓ contract_award_notice✓ contract_award_notice
notice_reference003118-2026✓ 003118-2026✓ 003118-2026✓ 003118-2026
contracting_authority criticalWexcombe Borough Council✓ Wexcombe Borough Council✓ Wexcombe Borough Council✓ Wexcombe Borough Council
contracting_authority_typesub_central✓ sub_central✓ sub_central✓ sub_central
supplier_name criticalFenwick Grounds Maintenance Ltd✓ Fenwick Grounds Maintenance Ltd✓ Fenwick Grounds Maintenance Ltd✓ Fenwick Grounds Maintenance Ltd
supplier_registration_number06645928✓ 06645928✓ 06645928✓ 06645928
contract_title criticalProvision of Grounds Maintenance Services for Parks and Open Spaces✓ Provision of Grounds Maintenance Services for Parks and Open Spaces✓ Provision of Grounds Maintenance Services for Parks and Open Spaces✓ Provision of Grounds Maintenance Services for Parks and Open Spaces
contract_referenceWBC/2026/0071✓ WBC/2026/0071✓ WBC/2026/0071✓ WBC/2026/0071
procurement_typeservices✓ services✓ services✓ services
light_touchfalse✓ false✓ false✓ false
procedureopen✓ open✓ open✓ open
cpv_codes["77310000", "77311000", "77314000"]✓ ["77310000", "77311000", "77314000"]✓ ["77310000", "77311000", "77314000"]✓ ["77310000", "77311000", "77314000"]
notice_published_date2026-02-16✓ 2026-02-16✓ 2026-02-16✓ 2026-02-16
award_date2026-02-12✓ 2026-02-12✓ 2026-02-12✓ 2026-02-12
contract_signed_datenull· · ·
contract_start_date critical2026-04-01✓ 2026-04-01✓ 2026-04-01✓ 2026-04-01
contract_end_date critical2030-03-31✓ 2030-03-31✓ 2030-03-31✓ 2030-03-31
extension_options_months24✓ 24✓ 24✓ 24
maximum_term_months72✓ 72✓ 72✓ 72
contract_value_gbp critical1,240,000✓ 1,240,000✓ 1,240,000✓ 1,240,000
value_includes_vatfalse✓ false✓ false✓ false
number_of_tenders_received4✓ 4✓ 4✓ 4
kpisnull· · ·
payment_terms_days30✓ 30✓ 30✓ 30
standstill_end_date2026-02-26✓ 2026-02-26✓ 2026-02-26✓ 2026-02-26
lots[]· · ·
modification_numbernull· · ·
modification_datenull· · ·
modification_descriptionnull· · ·
modification_ground criticalnull· · ·
original_contract_value_gbpnull· · ·
revised_contract_value_gbpnull· · ·
value_change_gbp criticalnull· · ·
value_change_percentnull· · ·
original_end_datenull· · ·
revised_end_date criticalnull· · ·
term_change_monthsnull· · ·
contract_change_notice_publishednull· · ·
voluntary_standstillnull· · ·

Expected rule-engine flags

RuleSeverityDetail
PA23-threshold-in-scopeinfoValue £1,240,000 is at or above the services threshold £207,720 (inc VAT) applicable on 2026-02-16.

Provenance: Fictional authority, supplier and figures. Generated for extraction testing; not a real notice. Generator crtest.gen 0.1.0, licence CC0-1.0.