{"_self":{"principle":"Self-explaining payload — no external context required. This _self block describes what you are reading and where to look next.","widget":"article_topology","feature":"topology","name":"Article topology","what":"Claims, sources, anecdotes, user reports, related embeds, question graph slice — for ask/ROUTER.","contains":"claims, sources, anecdotes, question_graph slice","slug":"nyc-ll144-bias-audit-evidence","urls":{"read":"https://miscsubjects.com/api/articles/nyc-ll144-bias-audit-evidence/topology"},"how_to_use":"Claims, sources, anecdotes, user reports, related embeds, question graph slice — for ask/ROUTER.","write":null,"imessage":null,"router_tag":null,"proof_chain":[{"step":1,"claim":"Articles are voxel graphs of tiered claims, not prose blobs.","verify":"https://miscsubjects.com/api/articles/constitution"},{"step":2,"claim":"Claims link to hash-chained sources via source_ids.","verify":"https://miscsubjects.com/api/articles/nyc-ll144-bias-audit-evidence/sources"},{"step":3,"claim":"Ask reads topology; ingest/claim append to ledger.","verify":"https://miscsubjects.com/api/protocol"},{"step":4,"claim":"Models queue growth: populate → collaborate → repair → reflex.","verify":"https://miscsubjects.com/api/protocol/grow"},{"step":5,"claim":"Graph proves its own shape (reflex) and $/claim (yield).","verify":"https://miscsubjects.com/graph.html?layer=reflex"},{"step":6,"claim":"Full feature index + _explain on every API response.","verify":"https://miscsubjects.com/api/articles/system-map"}],"related_features":[{"id":"ask","name":"Ask protocol","what":"Answer only from topology; creates question_node with gaps and ingest_hint.","urls":{"read":"https://miscsubjects.com/api/articles/nyc-ll144-bias-audit-evidence/prompts","write":"https://miscsubjects.com/api/protocol/ask"}},{"id":"graph_topology","name":"Cross-article graph","what":"Merged claims/sources across condition+stack slugs for one question.","urls":{"read":"https://miscsubjects.com/api/articles/nyc-ll144-bias-audit-evidence/graph-topology?question=..."}},{"id":"question_graph","name":"Question graph","what":"Ask nodes (questions + gaps) and evidence_ingest nodes (pasted model output).","urls":{"read":"https://miscsubjects.com/api/articles/nyc-ll144-bias-audit-evidence/question-graph","write":"https://miscsubjects.com/api/protocol/ask"}},{"id":"voxels","name":"Voxel graph","what":"Claims as atoms, sources as edges (supported_by, posted_by). Per-claim provenance.","urls":{"read":"https://miscsubjects.com/api/articles/nyc-ll144-bias-audit-evidence/voxels","write":"https://miscsubjects.com/api/protocol/claim"}}],"system_map":"https://miscsubjects.com/api/articles/system-map","system_map_markdown":"https://miscsubjects.com/api/articles/system-map?format=markdown","not_medical_advice":true},"_explain":{"feature":"topology","name":"Article topology","what":"Claims, sources, anecdotes, user reports, related embeds, question graph slice — for ask/ROUTER.","why":"Every feature is auditable collective intelligence","how":"Claims, sources, anecdotes, user reports, related embeds, question graph slice — for ask/ROUTER.","model":null,"verifies":null,"urls":{"read":"https://miscsubjects.com/api/articles/nyc-ll144-bias-audit-evidence/topology"},"imessage":null,"router":null,"related":[{"id":"ask","what":"Answer only from topology; creates question_node with gaps and ingest_hint."},{"id":"graph_topology","what":"Merged claims/sources across condition+stack slugs for one question."},{"id":"question_graph","what":"Ask nodes (questions + gaps) and evidence_ingest nodes (pasted model output)."},{"id":"voxels","what":"Claims as atoms, sources as edges (supported_by, posted_by). Per-claim provenance."}],"not_medical_advice":true},"slug":"nyc-ll144-bias-audit-evidence","title":"LL144 requires an annual bias audit of automated hiring tools. It says nothing about the 364 days of decisions in between. Here is the record layer for those.","register":"standard","tags":["governance","employment","adjudication","use-case"],"updated_at":"2026-07-30T17:56:24.841Z","body_excerpt":"## The obligation, and what it actually produces\n\nNew York City Local Law 144 of 2021, enforced by the Department of Consumer and Worker Protection since 5 July 2023, is the first law in the United States to regulate automated hiring directly. If an employer or employment agency uses an **automated employment decision tool** — software that substantially assists or replaces discretionary decisions about hiring or promotion — on candidates or employees in New York City, four things must be true:\n\n1. The tool has had a **bias audit by an independent auditor** within one year before each use, repeated annually.\n2. A **summary of the audit results is published** on the employer's website: selection rates and **impact ratios** broken out by sex categories, race/ethnicity categories, and their intersections.\n3. Candidates get **notice at least ten business days before the tool is used** on them, including the job qualifications and characteristics the tool will assess.\n4. Violations carry civil penalties — **$500 for a first violation, $500 to $1,500 for each subsequent one** — and each day a non-compliant tool is used counts as a separate violation, per tool.\n\nThat is a real obligation with real exposure, and the audit industry that grew around it is competent at what the statute asks for. But look at what the statute produces: **one aggregate table, once a year**. An impact ratio is a group-level statistic about a past period. It is the right instrument for the question it answers — did this tool's selection rates diverge across protected categories over the audited window — and it is silent on every other question anyone actually litigates.\n\n## The gap: 364 days of individual decisions the audit never touches\n\nBetween one annual audit and the next, the tool makes thousands of individual screening decisions. The audit says nothing about any of them. Consider who runs into that silence:\n\n- **The auditor.** An impact ratio flags a disparity but cannot localize it. Was it the criteria, one requisition, one job family, a data-quality failure in March? The audit sees the aggregate; the decisions underneath it are, in most deployments, unreconstructable — a score, a timestamp, and a vendor log line.\n- **The respondent employer.** A candidate files with the NYC Commission on Human Rights or the EEOC over one specific rejection. The published audit summary is aggregate evidence about a period; it is not evidence about *that decision*. \"The tool passed its annual audit\" answers a question nobody asked.\n- **The candidate.** LL144's notice provision tells candidates a tool will be used and what it assesses. It gives them no way to learn what the tool actually did with their file.\n\nThe gap is structural, not a failure of the auditors: the statute mandates a point-in-time aggregate instrument, and point-in-time aggregate instruments do not produce per-decision evidence. What is missing is a **between-audits record layer** — something that makes each individual decision reconstructable after the fact, at the moment it happens, in a form no one can quietly amend.\n\n## What this system is not\n\nSaid before anything else, because a compliance instrument that oversells itself is defective by its own standard: **this system does not compute selection rates or impact ratios, and it is not an LL144 bias audit.** It will not satisfy the annual audit requirement, and nothing on this page should be read as a substitute for an independent auditor. What it is: the per-decision governed record that would let an auditor, a respondent, or a tribunal reconstruct any individual decision the tool made — the evidence layer the annual audit presupposes and does not create.\n\n## The instrument, mechanically\n\nOne governed screening decision works like this. The **rule set** — the job qualifications and screening criteria, the same ones LL144 already requires you to disclose to candidates — is pinned to a content hash, so the version applied to this candidate is beyond ","ranking":"safety-first (interaction_risk/limitations), then quote-gated effective_weight","claims":[{"id":"c1","text":"NYC Local Law 144 requires that an automated employment decision tool used to screen NYC candidates or employees have a bias audit by an independent auditor within one year before use, with a summary of results — selection rates and impact ratios by sex and race/ethnicity categories — published, candidate notice at least ten business days before use, enforcement by DCWP, and civil penalties of $500 for a first violation and $500 to $1,500 for each subsequent one, each day of use counting separately.","tier":"system","section":"The obligation","interaction_risk":false,"status":"active","source_ids":[],"why_material":"The live legal obligation this page addresses, stated with its actual mechanics.","retracted_at":null,"retraction_reason":null,"challenged_by":[],"effective_weight":0.1,"quote_gated":false},{"id":"c2","text":"An LL144 bias audit is point-in-time and aggregate: it establishes group-level impact ratios for a past period and says nothing about any individual decision the tool makes between audits.","tier":"system","section":"The gap","interaction_risk":false,"status":"active","source_ids":[],"why_material":"The gap between what the statute produces and what a complainant, auditor, or respondent needs is the whole subject.","retracted_at":null,"retraction_reason":null,"challenged_by":[],"effective_weight":0.1,"quote_gated":false},{"id":"c3","text":"This system does not compute selection rates or impact ratios and is not an LL144 bias audit; it is a per-decision record layer that would let an auditor or respondent reconstruct any individual decision after the fact.","tier":"system","section":"What this is not","interaction_risk":false,"status":"active","source_ids":[],"why_material":"The honesty boundary: overselling a compliance instrument is a defect in the instrument.","retracted_at":null,"retraction_reason":null,"challenged_by":[],"effective_weight":0.1,"quote_gated":false},{"id":"c4","text":"A governed screening decision pins the rule set to a content hash, requires each of three seats across two model families to derive its verdict clause by clause in machine-readable form, and seals only when a deterministic comparison finds the derivations identical.","tier":"system","section":"The instrument","interaction_risk":false,"status":"active","source_ids":["s1","s3"],"why_material":"The mechanism that converts a screening decision into a reconstructable record.","retracted_at":null,"retraction_reason":null,"challenged_by":[],"effective_weight":0.1,"quote_gated":false},{"id":"c5","text":"A unanimous verdict is refused and escalated to a named human when the seats derived it differently, so agreement that hides divergent reasoning cannot authorise a candidate outcome.","tier":"system","section":"The instrument","interaction_risk":false,"status":"active","source_ids":["s1","s2"],"why_material":"False consensus is precisely the failure a disparate-treatment inquiry probes for.","retracted_at":null,"retraction_reason":null,"challenged_by":[],"effective_weight":0.1,"quote_gated":false},{"id":"c6","text":"Every governed finding must declare the records that were absent and the evidence that would flip the conclusion, and a panel facing a deliberately withheld record abstained and sealed the abstention rather than deciding.","tier":"system","section":"The absence declaration","interaction_risk":false,"status":"active","source_ids":["s4","s5"],"why_material":"In employment disputes the decisive question is often what the tool never saw; here that is a compelled, sealed statement.","retracted_at":null,"retraction_reason":null,"challenged_by":[],"effective_weight":0.1,"quote_gated":false},{"id":"c7","text":"The same machinery audits the rule set itself: a governed critique of a case file found eight defects, the lead one a necessity-stated-as-sufficiency error that had caused every prior derivation divergence.","tier":"system","section":"Auditing the criteria","interaction_risk":false,"status":"active","source_ids":["s8"],"why_material":"Most screening bias lives in the criteria; a specification defect caught with a receipt is evidence about the criteria, not the candidates.","retracted_at":null,"retraction_reason":null,"challenged_by":[],"effective_weight":0.1,"quote_gated":false},{"id":"c8","text":"Per-seat error rates are measured under a fixed rule set, and a 30-case calibration study on synthetic determinate fixtures sealed zero wrongful authorisations, with seat verdict accuracy of 30/30 and 29/30.","tier":"system","section":"Measured, not asserted","interaction_risk":false,"status":"active","source_ids":["s6","s7"],"why_material":"A between-audits record layer must itself carry measured error rates or it is another black box.","retracted_at":null,"retraction_reason":null,"challenged_by":[],"effective_weight":0.1,"quote_gated":false},{"id":"c9","text":"In 72 controlled calls, the auditable structure — declared absences, flip conditions, rejected alternatives — appeared in zero of 48 calls without the governing constitution and only under it.","tier":"system","section":"Measured, not asserted","interaction_risk":false,"status":"active","source_ids":["s5"],"why_material":"The governing text is a measured causal variable, which is what makes the record layer reproducible.","retracted_at":null,"retraction_reason":null,"challenged_by":[],"effective_weight":0.1,"quote_gated":false},{"id":"c10","text":"No employment-domain calibration exists: the measured rates come from synthetic determinate fixtures in other task classes, no study covers resume or candidate data, and no impact-ratio computation is performed anywhere in the system.","tier":"system","section":"What is not satisfied","interaction_risk":false,"status":"active","source_ids":[],"why_material":"The exact gaps a compliance team must not be allowed to overlook.","retracted_at":null,"retraction_reason":null,"challenged_by":[],"effective_weight":0.1,"quote_gated":false}],"sources":[{"id":"s1","type":"live_surface","url":"https://miscsubjects.com/a/auditable-reasoning-hardened","title":"The derivation-agreement gate — reasoning compared step by step","summary":"Independent models under a pinned rule set; the gate refuses to authorise when their clause-by-clause derivations diverge, even on a unanimous verdict.","claim_ids":["c4","c5"],"hash":"fe86c8ddc4ce9a524e6b6f27ef75b7b5be33c023c5d4aa01dac57edb86555b98"},{"id":"s2","type":"live_surface","url":"https://miscsubjects.com/receipt/inv_o6s0exhodd","title":"A unanimous verdict, refused on divergent derivation","summary":"Three seats returned the same verdict citing the same clauses; two derived it differently, so the gate escalated to a named human instead of concluding.","claim_ids":["c5"],"hash":"269c33c04b13ee58db5ced11227e2a1ba8f66999b62bee9cb7cb6871172a9f48"},{"id":"s3","type":"live_surface","url":"https://miscsubjects.com/receipt/inv_wl0rnh136b","title":"The genuine APPROVE — unanimous verdict, identical derivation","summary":"The clean authorisation on record: every seat fired the same clauses in the same trigger states on the same evidence.","claim_ids":["c4"],"hash":"0bd7892b4cf89b2b828259285606a48e8f86a08de968a3fc3b848a81a78f553d"},{"id":"s4","type":"live_surface","url":"https://miscsubjects.com/receipt/inv_7rqy8ywuls","title":"A sealed abstention — the record that was absent, declared","summary":"The first clean NO_ACTION: a record deliberately withheld, named in a manifest, and the panel abstaining rather than deciding on an incomplete file.","claim_ids":["c6"],"hash":"119c0672216c84bba8e2a884241275d8d38f97bcfc5fabf5b60d5647b0ab36c8"},{"id":"s5","type":"live_surface","url":"https://miscsubjects.com/a/auditable-reasoning-audited","title":"The 72-call variance study: what the governing text changes","summary":"Three prompt arms x three models x eight runs. Declared-absent records, flip conditions and rejected alternatives appeared in zero of 48 ungoverned calls, and only under the constitution.","claim_ids":["c6","c9"],"hash":"a8a54a724faf7c0c76ee7c65c0cd5774a67162f2e6f12409d372fc81244fc274"},{"id":"s6","type":"live_surface","url":"https://miscsubjects.com/a/adjudication-probe-report-eu-ai-act","title":"Measured per-seat error rates under a fixed rule set","summary":"Krippendorff alpha, Fleiss kappa, per-model rates and the prevalence paradox — quantified disagreement rather than asserted reliability.","claim_ids":["c8"],"hash":"4fd732e8c1df3f84e0647f470baeab5fd079826c00a0fef09e4a186b1b1f07aa"},{"id":"s7","type":"live_surface","url":"https://miscsubjects.com/a/adjudication-calibration-study","title":"The calibration study: 30 sealed panels, zero wrongful authorisations","summary":"30 oracle-labelled synthetic cases through the production gate: glm-5.2 30/30, kimi 29/30 on verdicts, and no wrongful authorisation sealed. Synthetic determinate fixtures, not employment data.","claim_ids":["c8"],"hash":"90dac5924d4d3433a6e6133498f97e6a2f72c9c0d217bcc610bfb81c5dcaa5ff"},{"id":"s8","type":"live_surface","url":"https://miscsubjects.com/receipt/inv_qh3ge2x74b","title":"The instrument reviewing its own input: eight defects found","summary":"A governed seat asked to critique the case input found the rule set stated only a necessary condition where a sufficient one was needed — the defect was the specification, not the models.","claim_ids":["c7"],"hash":"893e9a6d56bacf7fe90a3cb8fd3eab84e443f262ff83987c55c1d7a95d7f2b37"},{"id":"em_es_3e04dbdbd04147c0943d","type":"email","url":"https://miscsubjects.com/letter-babl-ai-2026-07-30","title":"Letter to Dr. Shea Brown — 2026-07-30","claim_ids":[],"hash":"97091c2b707980fbd62253609ca658674aadcdeeea6c37939d606edbf81ed461"},{"id":"x_2082827977457578108","type":"x","url":"https://x.com/CannibalCapital/status/2082827977457578108","title":"X post announcing nyc-ll144-bias-audit-evidence — 2082827977457578108","quote":"NYC LL144 requires an annual bias audit. It says nothing about the 364 days in between. An evidence layer for the gap.","claim_ids":[],"hash":"0a416448378e22221101ed7582598ef903fd12b6dc082263d175e1d51b3bad49"}],"anecdotal_sources":[{"id":"x_2082827977457578108","type":"x","url":"https://x.com/CannibalCapital/status/2082827977457578108","title":"X post announcing nyc-ll144-bias-audit-evidence — 2082827977457578108","quote":"NYC LL144 requires an annual bias audit. It says nothing about the 364 days in between. An evidence layer for the gap.","claim_ids":[],"hash":"0a416448378e22221101ed7582598ef903fd12b6dc082263d175e1d51b3bad49"}],"scientific_sources":[],"user_reports":[],"related_articles":[],"question_graph":{"slug":"nyc-ll144-bias-audit-evidence","questions":[],"evidence":[],"edges":[],"counts":{"questions":0,"evidence":0,"edges":0}},"honesty":{"active_claims":10,"retracted_claims":0,"cut_claims":0,"challenges":0,"scrub_events":0,"note":"Retracted/cut claims stay on ledger but are excluded from ask unless ?include_inactive=1"},"counts":{"claims":10,"claims_total":10,"sources":10,"anecdotal":1,"scientific":0,"user_reports":0,"questions":0,"evidence_ingests":0}}