Benchmark Harness — Test Sites

Site IDNameFeaturesTests
site_v_slds_branchingBayshore Utility Assistanceconditional_fields, slds_controls, submission_captureSLDS-style label-interception choice controls + PG&E-shaped branching (BR-1 regression)
site_w_probe_lockoutHarborview Aid Networkprobe_lockout, submission_captureChoice group that defeats every click strategy — probe must fail loud, not conclude linear
site_x_hidden_choiceCrestline Community Fundhidden_native_choice, submission_captureCustom widget hides native radio group (display:none) — locators never resolve; probe must abort, not certify linear
site_ab_decoy_formsFoothill Family Alliancedecoy_forms, submission_captureSearch/newsletter decoy forms precede the real intake form in document order — extraction must rank forms, not take the first two
site_z_interaction_gatedSierra Vista Energy Fundinteraction_gated_js, submission_captureForm hidden until first real user-interaction event (WP Rocket delay-JS pattern) — crawler must nudge, then crawl normally
site_y_readback_echoMeadowbrook Housing Trustreadback_echo, submission_captureTwo-page form whose step 2 echoes the entered income as display text — echo masking must black it out in stored screenshots
site_a_shelterHope House Sheltersubmission_captureBaseline shelter intake form
site_b_legalaidCommunity Legal Aid Societysession_token, submission_captureSession tokens, replay model validation
site_c_veteransVeterans Resource Centerconditional_fields, submission_captureBranching/conditional field visibility
site_d_foodFood For All Community Pantrymalformed_html, submission_captureMalformed HTML, locator stress testing
site_e_housingSafe Harbor Housing Alliancecaptcha, sensitive_fields, submission_captureSensitive fields, consent, CAPTCHA detection
site_f_veterans_requiredVeterans Resource Center (Disability Benefits Unit)conditional_fields, submission_captureRequired conditional field — locator unresolved, Runner pre-flight must block
site_g_sensitive_nocaptchaCommunity Support Servicessensitive_fields, sections, file_upload, consent, submission_captureSensitive fields without CAPTCHA — Runner can run end-to-end; halt test for new required field. Also fieldset/legend sections, an optional multi-file upload (max 3, 10MB), and an unsectioned consent checkbox
site_h_multiservicePacific Community Servicesnested_navigation, submission_captureTwo-layer navigation — top nav plus program sub-nav; simple flat intake form
site_i_dynamic_formNorthwest Family Resourcesnested_navigation, dynamic_form_fields, submission_captureTwo-layer navigation plus intake form with dynamic fields revealed by select/checkbox
site_j_paginatedRiverside Community Servicespagination, file_upload, consent, sections, multiple_rows, admin_fields, submission_capture3-page paginated intake (Step N of 3) with Next traversal, optional file upload, required consent checkbox, a repeatable Household Members section (max 5 rows), and admin fields (assistance, referral source, signature, review confirmation); terminal submit on page 3
site_k_conditionalCascade Mobility Servicespagination, cross_page_branching, submission_capturePage 2 questions are conditioned on page 1 answers ('Given that you selected that you do not drive...'). No same-page branching, so only cross-page dependency detection catches it — Builder must flag cross_page_branching and abort
site_l_gatedSummit Benefits Accessscroll_gated_consent, accordion, details, iframe, sections, consent, submission_captureConsent checkbox stays disabled until a scrollable terms box is scrolled to the bottom; a collapsed accordion hides a REQUIRED field; a
block hides another; a same-origin iframe holds a scrollable notice. Tests prepare_page scroll/expand/iframe handling on arrival
site_m_login_gateGateway Housing Networklogin_required, submission_captureLogin/account-creation gate before intake — Builder halts with login_required; Runner pre-flight blocks
site_n_paymentMeridian Transitional Housingpayment_field, submission_captureApplication-fee credit-card fields — Builder raises payment_field (blocking red flag)
site_o_invisible_captchaHarbor Point Outreachinvisible_captcha, submission_capturereCAPTCHA-v3-style score-based badge (no challenge widget) — captcha_type=invisible, Builder PROCEEDS (no halt)
site_p_crosspage_echoRiverbend Servicescross_page_branching, echo_false_positive, submission_capturePage 2 echoes the page-1 last_name value ('Testerson') with no conditional phrasing → cross_page_branching (medium) → abort. Second flow (/intake_safe) echoes only short/numeric values → NO abort (echo false-positive resistance)
site_q_ambiguous_submitCornerstone Assistanceambiguous_submit, submission_captureTwo type=submit buttons + a 'Continue' label + no progress indicator → ambiguous terminality → ambiguous_submit (LLM-variance; 2 attempts)
site_r_edgecasesAnchor Family Servicesheading_sections, repeatable_false_positive, missing_options, failed_extract, unmappable_full_ssn, file_upload, submission_captureEdge-case kitchen sink: h3 heading-fallback sections; fixed member_1/member_2 fields with no add-row (repeatable false-positive); empty
site_t_challengesNorthgate Relief Centerinteractive_captcha, vision_escalation, submission_captureInteractive human-verification challenges — detection & HALT only (never solve). /intake = text math challenge (DOM-readable); /intake_image = distorted-text CAPTCHA as a data: img with an unlabeled input (text extractor blind → must escalate to vision, then still halt). Both expect interactive_captcha + Runner pre-flight abort.
site_u_other_specifyLakeside Community Resourcesother_specify, submission_capture'Other, specify' reveal fields — a radio (How did you hear about us?) and a select (accommodations) each have an 'Other' option that reveals a single free-text 'please specify' box. Must be captured as conditional companion fields (revealed_by_key + reveal_values + is_specify_field), NOT treated as branching. Dry run selects Other, reveals the box, and fills it.
site_s_variantsLakeshore Aid Societydrift_variants, submission_captureDrift-variant host using the server variant switch. /intake serves v1 (base), v2 (+optional field → non-critical), v3 (+required field → critical halt), v4 (reorder → cosmetic, no version bump). Same URL → same lineage → real drift
site_ac_div_intakeRiverstone Family Centerdiv_form, ambiguous_submit, sensitive_fields, heading_sections, missing_options, failed_extract, unmappable_full_ssn, submission_captureApplication built entirely from divs (no
element) with two type=button controls, h2 heading sections, an empty select, a no-input star widget, and a full 9-digit SSN field
site_ad_wizard_linksBlue Spruce Employment Alliancelink_navigation, pagination, multiple_rows, repeatable_false_positive, admin_fields, echo_false_positive, submission_captureThree-step wizard advancing via styled links (steps 1-2 have no ); step 2 has an add-row jobs section (cap 4), a fixed two-slot references block, and a short numeric readback; step 3 holds staff-assisted questions
site_ae_deep_portalCedar Valley Community Portalnested_navigation, decoy_forms, sections, file_upload, consent, submission_captureApplication reachable only through a four-level navigation chain; the page holds search/newsletter widget forms around the real application, fieldset sections, a 2-file/5MB upload, and a consent checkbox outside every fieldset
site_af_branch_cardsHarvest Hill Assistance Fundconditional_fields, slds_controls, other_specify, submission_captureSLDS-style card controls with three independent one-level reveals - housing radios reveal a required-when-visible field, a referral select's "Other" reveals a specify box, a children checkbox reveals two optional fields; completed submissions are captured and readable at /submissions/latest
site_ag_widget_mazeFoxglove Relief Collectiveprobe_lockout, hidden_native_choice, submission_captureTwo hostile radio groups on one page - an income-band group whose script suppresses all pointer events in the capture phase, and an aid-type group whose native radios are display:none behind pill-styled divs
site_ah_member_gateIronwood Veterans Outreachlogin_required, session_token, div_form, submission_captureDiv-based modal sign-in dialog (no ) with a fresh per-visit session value in a hidden input; the application preview beneath is fully disabled
site_ai_fee_verifySunrise Transitional Servicespayment_field, invisible_captcha, interactive_captcha, vision_escalation, submission_capture/intake asks for card number/expiry/CVC under a silent score-badge notice; /intake_challenge pairs a plain-text math question with a distorted-text image challenge (a data: URI img and an unlabeled input)
site_aj_patience_portalWillowbrook Senior Aidinteraction_gated_js, table_layout, scroll_gated_consent, iframe, details, accordion, submission_captureForm hidden until the first user-interaction event; fields laid out in table rows; terms in a same-origin iframe whose scroll unlocks the disabled consent box; a closed
holds a required select; a fake expander link navigates away
site_ak_flow_dependentAspen Grove Housing Cooperativemalformed_html, cross_page_branching, echo_positive, submission_capture/intake step 1 is malformed HTML and step 2 is phrased around the step-1 heating answer; /intake_echo step 2 repeats the distinctive step-1 last name verbatim with no conditional phrasing
site_al_ledger_driftMaple Union Resource Exchangedrift_variants, readback_echo, sensitive_fields, pagination, submission_captureTwo-step flow whose step 2 repeats the entered income as display text (no pure-black styling); step 1 ships v1-v4 variant files at the same URL (v2 +optional field, v3 +required field, v4 reorder only)

View registry JSON