Skip to content
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
23 changes: 19 additions & 4 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -201,6 +201,20 @@ because structural coverage does not establish citation correctness, general Bri
benefit, causality, or live freshness. Exact replay returns the historical Decision without new
authorization. This is explicit disposition, not reclassification or proposal application.

P2C5 adds a distinct product-owned outcome rather than broadening the structural score. The named
principal `principal:world-citation-correctness-reviewer` records an exact immutable review over
the Brief, its one cited claim, the exact two citation identities, and the two admitted official
Observation references. Each Core Outcome names that exact result. A matched negative control
retains both citation identities but swaps the two publication dates in the claim: treatment and
control both have `1.0` coverage, while correctness is `1.0` and `0.0` respectively across two
pairs. The domain-neutral evaluator classifies that bounded difference as useful and still emits
only a non-effective proposal requiring separate review.

This candidate establishes exact review provenance and sensitivity to one semantic corruption. It
does not establish reviewer infallibility, current network freshness, source independence, general
Brief quality, causal impact, or human benefit. Citation review vocabulary and policy remain in
World; Core and Intelligence receive only the exact immutable observed-result coordinate.

## What the public World proof demonstrates

Generate a self-contained visual Reality Brief and its exact machine-readable backing data:
Expand Down Expand Up @@ -356,10 +370,11 @@ workspace export followed by separate verification and promotion.

The [World Intelligence roadmap](ROADMAP.md) owns current domain direction. Detailed packet history
remains in [`docs/world-intelligence-roadmap-status-2026-08-06.md`](docs/world-intelligence-roadmap-status-2026-08-06.md),
and release history is in [`CHANGELOG.md`](CHANGELOG.md). P2C4 now demonstrates a separately
authorized reject/no-action disposition of the P2C3 proposal without effective state change. The
next bounded measurement work is an independently reviewed product outcome such as citation
correctness, contradiction coverage, correction quality, detection delay, or false-alert rate.
and release history is in [`CHANGELOG.md`](CHANGELOG.md). P2C4 demonstrates a separately
authorized reject/no-action disposition of the P2C3 proposal without effective state change. P2C5
adds an independently reviewed citation-correctness Outcome and a citation-preserving semantic
negative control. The next bounded measurement work is contradiction/correction coverage,
detection delay, false-alert rate, or independent Market reproduction.
Separately reviewed opt-in network transport and P2D multi-source conflict/correction with LIVE
inputs remain independent work. None of these steps may add autonomous publishing, delivery,
persuasion, or action authority to a Domain Pack.
Expand Down
12 changes: 9 additions & 3 deletions ROADMAP.md
Original file line number Diff line number Diff line change
Expand Up @@ -16,7 +16,7 @@ source code into the platform.

See the [0.9.0 release record](docs/releases/world-intelligence-p2c2-v0.9.0.md).

## Candidate — P2C3/P2C4 measured feedback and reviewed disposition
## Candidate — P2C3–P2C5 measured feedback, disposition, and citation correctness

- The exact 0.9.0 Brief and a World-owned source-only control pass through two matched reviewed
export pairs under one frozen structural citation-coverage criterion.
Expand All @@ -27,12 +27,18 @@ See the [0.9.0 release record](docs/releases/world-intelligence-p2c2-v0.9.0.md).
- A separate authenticated and authorized World reviewer rejects broader promotion with an exact
`no_action` Core Decision. The useful evaluation and promote proposal remain unchanged, and no
effective governed-state head changes.
- This is source-checkout evidence against Core PR #88, not a released World capability, human
- A second frozen criterion requires exact independent review provenance behind every Outcome
score. A citation-preserving date-swap control retains `1.0` citation coverage while correctness
falls from `1.0` to `0.0` over two matched pairs; the bounded evaluation again emits only a
non-effective proposal.
- This is source-checkout evidence against stacked Core candidates, not a released World capability, human
benefit finding, causal claim, network-freshness proof, or applied governance change.

See the [P2C3 candidate work packet](docs/design/world-intelligence-p2c3-measured-feedback-work-packet-v1.md).
The follow-on [P2C4 work packet](docs/design/world-intelligence-p2c4-reviewed-impact-disposition-work-packet-v1.md)
freezes the exact proposal-disposition boundary.
freezes the exact proposal-disposition boundary. The stacked
[P2C5 work packet](docs/design/world-intelligence-p2c5-citation-correctness-outcome-work-packet-v1.md)
freezes independently reviewed citation correctness and its citation-preserving negative control.

## Next — trustworthy live orientation

Expand Down
Original file line number Diff line number Diff line change
@@ -0,0 +1,123 @@
# World Intelligence P2C5 citation-correctness outcome audit — 2026-08-10

Status: **stacked candidate evidence only; not a release, SI4 pass, or applied governance change**

## Source identity

- World base: P2C4 commit `189c81be1812ee32ffc28148fb63539c66417661`
- World branch: `codex/world-citation-correctness`
- Core base: measured-impact disposition commit
`3c920bb5c411bd9d91a5e2a6c96d4014e9b66763`
- Core dependency: stacked `codex/measured-impact-observed-result` candidate
- Released identity intentionally unchanged: `ace-domain-world-intelligence==0.9.0`,
`ace-core>=0.5.0,<0.6`

## Exact point-in-time result

One source-checkout run recorded two independent treatment reviews and two independent control
reviews under product policy
`sha256:ab9b609d9bba9edc4163cdccdbe8761d8494b2bf52789a92f3124b5d3324750c`:

```text
treatment review 1: citation_correctness_review:27b875cf41e4f417cec5715aebeca73b
treatment review 2: citation_correctness_review:d4c7f54c69289eb258c84d65ad7c996b
control review 1: citation_correctness_review:b1c980ee2df061ab00caa6e3a46d6e7c
control review 2: citation_correctness_review:a2122102390c938dd3edf5104f63f415
treatment citation coverage: 1.0, 1.0
control citation coverage: 1.0, 1.0
treatment correctness: 1.0, 1.0
control correctness: 0.0, 0.0
matched pairs: 2
mean effect: 1.0
classification: useful
proposal action: promote
proposal live effect: false
historical replay: true
replay reauthorization: false
```

The exact evaluation was
`impact_evaluation:eef78b8febd33d4b6121d6f8ce6e1335` with material
`sha256:eef78b8febd33d4b6121d6f8ce6e13354dcb09ef743c5de61940021473595d3a`.
The exact non-effective proposal was
`impact_governance_proposal:d928a69adc1984ff89b1225ed87d93fa` with material
`sha256:d928a69adc1984ff89b1225ed87d93fa0881c3e6f981233d08d9e7756a6c8b80`.

The negative control preserved both exact citation identities but changed the cited statement from
the admitted publication dates to `2026-15932 published 2026-08-07` and `2026-16197 published
2026-08-06`. It therefore falsifies the structural-coverage proxy without requiring a different
source set.

## Verification

Stacked source-checkout verification with the Core observed-result candidate and separately
packaged reference action adapter:

```text
python -B -m pytest domain_packs/tests/test_p2c3_measured_feedback.py \
domain_packs/tests/test_p2c4_reviewed_impact_disposition.py \
domain_packs/tests/test_p2c5_citation_correctness_outcome.py -q --tb=short
6 passed in 1.16s

ruff check scripts/p2c3_measured_feedback.py \
scripts/p2c4_reviewed_impact_disposition.py \
scripts/p2c5_citation_correctness_outcome.py \
domain_packs/tests/test_p2c5_citation_correctness_outcome.py
PASS

ruff format --check <the four changed Python files above>
PASS

python -B -m pytest -q --tb=short
89 passed in 15.40s

python -B -m pytest adapters/federal_register_source/tests -q --tb=short
26 passed in 0.23s

python -B -m pytest tests/test_release_contract.py -q --tb=short
7 passed in 0.04s

# Isolated environment with the built World wheel, public ace-core==0.5.0,
# and the separately installed Federal Register source adapter; no Core checkout.
python -B -m pytest -q --tb=short -rs
82 passed, 7 skipped in 15.04s

ruff check .
PASS

uv build --out-dir <temporary-directory>
Successfully built unchanged 0.9.0 source distribution and inert data-only wheel

git diff --check
PASS
```

The seven isolated-environment skips are explicit candidate boundaries: one P2C2 test requires
the separately packaged Core reference action adapter, and two tests each require the unreleased
P2C3, P2C4, and P2C5 Core candidates. The released dependency range and 0.9.0 artifact remain
coherent. Wheel inspection contains only inert Domain Pack JSON and distribution metadata; no
candidate script, test, adapter, or audit Python is shipped.

Repository-wide `ruff format --check .` reports 19 pre-existing files outside this packet that do
not match the Core candidate environment's formatter version. The four changed Python files pass
the scoped formatting gate and the complete repository passes `ruff check .`; this packet does not
rewrite unrelated World history.

## Claim boundary

The World reviewer exact-loads both admitted Observation envelopes and derives the expected
document/date statement from their canonical payloads. Its exact result makes reviewer, source
Observations, policy, claim, citations, verdict, score, time, and limitations inspectable. The Core
Outcome points to that exact result and the evaluator refuses missing or future result provenance
when the criterion requires it.

This demonstrates deterministic product-policy sensitivity over two recorded official public
records. It does not prove a live request, current freshness, legal truth, reviewer infallibility,
source independence, correction handling, population performance, general Brief quality, causal
impact, or human benefit. The resulting proposal remains non-effective and unapplied.

## Remaining work

Contradiction/correction coverage, detection delay, false-alert rate, revision stability, a
materially different Market journey, public artifacts, compatibility/security/release checks,
opt-in live transport, and any explicit proposal application remain future bounded packets.
Original file line number Diff line number Diff line change
@@ -0,0 +1,99 @@
# World Intelligence P2C5 citation-correctness outcome work packet (v1)

**Status:** stacked source-checkout candidate; this packet does not release World Intelligence,
apply a governance proposal, close ACE Core issue #38, pass SI4, or complete ACE 0.6.0.

**Frozen:** 2026-08-10 from World P2C4 commit
`189c81be1812ee32ffc28148fb63539c66417661`, stacked on the Core exact observed-result
provenance candidate.

## Objective

Replace P2C3's structural coverage-only outcome with one independently recorded product-quality
result while preserving the full governed journey:

```text
Observation -> Shift -> Signal -> Brief -> Decision -> reviewed Action
-> exact independent citation review -> observed Outcome
-> useful / harmful / unproven evaluation -> proposal only
```

The packet must distinguish presence from correctness. Its negative control retains the exact two
citation identities used by the Brief but swaps the two official publication dates in the cited
claim. Treatment and control therefore both have `1.0` citation coverage while correctness is
`1.0` for the admitted Brief and `0.0` for the semantic-corruption control.

## Product-owned review policy

World owns `world_official_record_citation_correctness` version `candidate-1`. The frozen rule
reviews cited claims only, requires the exact two Brief citation identities, exact-loads the two
admitted Observation envelopes, derives the expected document/date statement from their canonical
payloads, and compares the cited statement to those exact recorded facts. Score is supported cited
claims divided by reviewed cited claims.

The exact review record names:

- the reviewed Brief or control immutable reference;
- the authenticated reviewer `principal:world-citation-correctness-reviewer`;
- the policy identity, version, and material digest;
- the two exact source Observation references;
- each claim identity, statement, exact citation set, verdict, and rationale;
- coverage, correctness score, limitations, review time, and derived review identity/digest.

Core and Intelligence see only the result's generic immutable reference from the Outcome measures.
Federal Register, citation, reviewer, and source-policy nouns remain in World.

## Exact acceptance

P2C5 must:

1. rerun P2C2 through P2C4 and preserve the earlier structural result and reject/no-action
disposition as immutable history;
2. append one exact citation-preserving corrupted control artifact;
3. create two distinct reviewed treatment/control Action pairs under matched task conditions;
4. append four independently authenticated review records over the exact subjects and source
Observations;
5. record four Core Outcomes whose measures name the exact review records that produced their
scalar scores;
6. require exact observed-result provenance under a frozen correctness criterion;
7. show treatment/control coverage `1.0/1.0` but correctness `1.0/0.0` in both pairs;
8. classify the bounded result `useful`, emit only a non-effective `promote` proposal, and perform
no proposal application;
9. replay the evaluation without reauthorization; and
10. retain explicit non-claims for network freshness, causality, general Brief quality, human
benefit, and autonomous publication.

## Negative and failure controls

The citation-preserving date swap is the primary product negative control: an identifier/string
coverage scorer cannot distinguish it, while the frozen correctness review must. Core's stacked
tests separately require missing observed-result provenance to become unproven, reject cross-
product result coordinates, and exclude post-cutoff result material without loading its payload.
Earlier missing attribution, condition mismatch, Outcome unavailability, duplicate/replay,
interruption, restart, and denied-authority controls remain required.

## Files and rollback

This packet owns:

- `scripts/p2c5_citation_correctness_outcome.py`;
- `domain_packs/tests/test_p2c5_citation_correctness_outcome.py`;
- additive P2C3/P2C4 acceptance-state handoffs;
- this work packet, its audit, and restrained README/roadmap references.

It changes no shipped Domain Pack, connector, package version, dependency range, lockfile, release
record, or public artifact. Rollback removes the harness, tests, state handoffs, and candidate
documentation. Product review and Outcome records already persisted by a host remain immutable
history.

## Non-claims and next packet

The result covers one cited claim, two recorded official records, two matched pairs, and one exact
product rule. It does not validate inference claims, source independence, corrections, live
network freshness, human usefulness, general Brief quality, or causal benefit. The synthetic
control establishes criterion sensitivity, not a population estimate.

The next bounded outcome packet should measure contradiction/correction coverage or detection
delay over additional public records. Independent Market reproduction, public Core artifacts,
compatibility/security/release gates, opt-in live transport, and any separately authorized proposal
application remain separate work.
71 changes: 71 additions & 0 deletions domain_packs/tests/test_p2c5_citation_correctness_outcome.py
Original file line number Diff line number Diff line change
@@ -0,0 +1,71 @@
from __future__ import annotations

import importlib.util

import pytest


def _require_candidate_contracts() -> None:
if importlib.util.find_spec("ace.application.measured_impact") is None:
pytest.skip("P2C5 requires the stacked ACE Core measured-impact candidate")
from ace.intelligence import ImpactOutcomeMeasuresV1Alpha1

if "observed_result" not in ImpactOutcomeMeasuresV1Alpha1.model_fields:
pytest.skip("P2C5 requires exact observed-result provenance from the stacked Core candidate")
if importlib.util.find_spec("ace_reference_workspace_action") is None:
pytest.skip("P2C5 requires the separately packaged Core reference adapter")


@pytest.mark.asyncio
async def test_independent_citation_review_becomes_an_exact_measured_outcome(tmp_path) -> None:
_require_candidate_contracts()
from scripts.p2c5_citation_correctness_outcome import run_citation_correctness_outcome

result = await run_citation_correctness_outcome(tmp_path)

assert result["review_policy"]["reviewer_ref"] == "principal:world-citation-correctness-reviewer"
assert result["evaluation"]["criterion"]["requires_observed_result"] is True
assert result["evaluation"]["classification"] == "useful"
assert result["evaluation"]["matched_pair_count"] == 2
assert result["evaluation"]["mean_effect"] == 1.0
assert result["proposal"]["action"] == "promote"
assert result["proposal"]["live_effect"] is False
assert result["proposal"]["selectable"] is False
assert result["proposal"]["requires_human_review"] is True
assert result["replay"] == {
"historical": True,
"no_reauthorization": True,
"transaction_receipt_id": result["replay"]["transaction_receipt_id"],
}
reviews = (*result["observed_results"]["treatment"], *result["observed_results"]["control"])
assert {item["contract"] for item in reviews} == {"ace.world-intelligence.citation-correctness-review/v1alpha1"}
assert {item["reviewer_context"]["actor_ref"] for item in reviews} == {
"principal:world-citation-correctness-reviewer"
}
assert {len(item["source_observations"]) for item in reviews} == {2}


@pytest.mark.asyncio
async def test_citation_preserving_negative_control_separates_coverage_from_correctness(tmp_path) -> None:
_require_candidate_contracts()
from scripts.p2c5_citation_correctness_outcome import run_citation_correctness_outcome

result = await run_citation_correctness_outcome(tmp_path)
control = result["negative_control"]

assert len(control["citation_ids_preserved"]) == 2
assert control["treatment_citation_coverage"] == (1.0, 1.0)
assert control["control_citation_coverage"] == (1.0, 1.0)
assert control["treatment_correctness"] == (1.0, 1.0)
assert control["control_correctness"] == (0.0, 0.0)
assert "2026-15932 published 2026-08-07" in control["corrupted_statement"]
assert result["scope"] == {
"independent_exact_review": True,
"recorded_official_sources": True,
"network_freshness_claimed": False,
"general_brief_quality_claimed": False,
"human_benefit_claimed": False,
"causality_claimed": False,
"proposal_applied": False,
"autonomous_publication": False,
}
4 changes: 4 additions & 0 deletions scripts/p2c3_measured_feedback.py
Original file line number Diff line number Diff line change
Expand Up @@ -753,6 +753,10 @@ async def run_measured_feedback(
state_sink.update(state)
state_sink.update(
{
"impact_target_ref": target_ref,
"impact_control_ref": control_ref,
"measured_treatments": treatments,
"measured_controls": controls,
"impact_binding": impact_binding,
"impact_criterion": criterion,
"impact_request": request,
Expand Down
Loading
Loading