View source for The Principia Machina/Testing/M0 Outside AI and the sandbox

{{TPM map}}
{{DISPLAYTITLE:Testing M0: an outside AI, from the wiki alone}}
''Phase M0 of [[The Principia Machina/Testing|Testing the Principia Machina]]. State: PASSED (the operator's word "M0 accepted", recorded 2026-10-04; read under the states of the plan's version 0.3.0). Five outside sessions between 2026-10-01 and 2026-10-03, seven findings G-1 to G-7, no soundness finding open.''

== Objective ==

The plan (tpm_third_party_plan 0.2.0, 2026-09-30, section 4) states M0 as: ''a third-party AI, from the wiki alone, creates and works a sandbox UWC.'' The outside AI is given one sentence naming the start page. Everything else it reads and fetches from invarians.org: the brief, the operator's guide, the published calculator TPC-PY and the sandbox that drives it.

The plan's acceptance criteria:

* the outside AI, given one sentence, set itself up from the wiki;
* it has made at least one UWC, which the operator declared;
* that UWC carries at least three records landed by the outside AI, among them one RESULT promoted to ESTABLISHED and one VERIFICATION against a cited outside value;
* the session report lists every prediction with its outcome;
* no S1 finding is open.

On 2026-10-01, after the first session, the operator changed the direction: the test runs on the website only, with no local or terminal rounds. The terminal session (session 1) was retired as having tested copies of the machinery on one computer rather than the website, and sessions 2 to 5 tested the pages and the live gate instead. The sandbox UWC of the first two criteria was therefore made once, in session 1, and the first UWC on the live wiki (SPR) came with [[The Principia Machina/Testing/M3 TPX, the smallest server|M3]] on 2026-10-04.

<graphviz>
// M0: what the outside AI had to do, from one sentence to a working UWC.
digraph m0flow {
  rankdir=TB; node [shape=box, style=filled, fillcolor="#eaecf0", color="#a2a9b1", fontcolor="#202122", fontname="Helvetica", fontsize=10]; edge [fontname="Helvetica", fontsize=9, color="#54595d", fontcolor="#202122"];
  S [label="one sentence\nfrom the operator,\nnaming the start page", fillcolor="#cef2e0"];
  H [label="Hub/Outside AI\nthe brief: tracks, rules,\nthe report format", shape=box3d];
  G [label="Guide/11\nRunning an outside AI\nthe operator's steps", shape=box3d];
  V [label="verify_tpc_py.py\nfetches TPC-PY from\nthe wiki, checks its digest"];
  C [label="TPC-PY\nthe published calculator\n(0.2.0 declared, 0.3.0 proposed)", shape=box3d];
  X [label="tpm_sandbox.py 0.2.0\nnot TPX, not of record\nthe gate, the register, the chain", shape=box3d];
  U [label="a sandbox UWC\nnew, declare, push,\nverify, withdraw"];
  R [label="SESSION REPORT\nevery prediction\nwith its outcome", fillcolor="#ffedad"];
  S -> H -> G -> V -> C; V -> X -> U -> R; C -> X;
}
</graphviz>

== What was built ==

* '''tpm_sandbox.py 0.2.0''', about 1,250 lines of Python using the standard library only, published byte for byte as [[The Principia Machina/TPC-PY tools/tpm sandbox.py|TPC-PY tools/tpm sandbox.py]] (55,229 bytes). It runs the declared calculator unchanged, fetched from the wiki by [[The Principia Machina/TPC-PY tools/verify tpc py.py|verify tpc py.py]], and only on a tree it knows: TPC-PY 0.2.0, declared, or 0.3.0, then proposed. It is not TPX and nothing it writes is of record. It covers the new-UWC gate, the candidate certificate, the declaration with the MASTER record and the instantiation gaps, pushes checked at PUSH and at LANDED, citations, the declared-form, domain and budget checks, VERIFICATION order and DIFFERENCE, withdrawals with their cascade, the promotion pass, EOM-0, SR3 screening (reported, never struck), a local hash chain, a verify command that recomputes everything, and the spring's worked examples. Its self-test passed on three Python versions before publication; its first run on Windows was the tester's.
* '''The pages''': [[The Principia Machina/Hub/Outside AI|Outside AI: start here]] (the brief) and [[The Principia Machina/Guide/11 Running an outside AI|Guide 11]] (the operator's guide), imported on 2026-10-01 and revised after each session; the Inputs pages and their fixes; the account help pages.
* '''TPX part 1, the gate''': the live new-UWC check at Special:TpmCheck and the API operation CHECK, which runs the kernel tests, the isomorphism checks, the yardstick checks and the structure check with the server's calculator and stores nothing. Sessions 2 to 5 tested it.

<graphviz>
// What the sandbox covers (tpm_third_party_plan 0.2.0, section 1).
digraph sandbox {
  rankdir=LR; node [shape=box, style=filled, fillcolor="#eaecf0", color="#a2a9b1", fontcolor="#202122", fontname="Helvetica", fontsize=9]; edge [fontname="Helvetica", fontsize=9, color="#54595d"];
  SB [label="tpm_sandbox.py 0.2.0\nruns TPC-PY unchanged", fillcolor="#cedff2", fontsize=10];
  G1 [label="new\nthe gate: kernel tests,\nisomorphism checks, SR9"];
  G2 [label="declare\nMASTER, IC2 and UNDER gaps,\nthe candidate certificate"];
  G3 [label="push\nchecked at PUSH and LANDED;\ncitations, forms, domain, budget"];
  G4 [label="verification\norder, DIFFERENCE,\nthe SR3 test"];
  G5 [label="withdraw\nSUPERSEDES and author\nwithdrawals, the cascade"];
  G6 [label="promotion pass\nto a fixed point;\nEOM-0 open and settle"];
  G7 [label="SR3 screening\nreported, never struck"];
  G8 [label="chain\na local hash chain;\nverify recomputes everything"];
  G9 [label="examples\nthe spring's records,\nprinted on request"];
  SB -> G1; SB -> G2; SB -> G3; SB -> G4; SB -> G5; SB -> G6; SB -> G7; SB -> G8; SB -> G9;
}
</graphviz>

== How it was tested ==

Five outside sessions ran between 2026-10-01 and 2026-10-03, each started by the operator with one sentence, each of at most 25 runs, each ending in a session report. Session 1 was the terminal test: an outside AI on the operator's computer ran the published calculator and the sandbox; it was retired by the direction of 2026-10-01. Sessions 2, 2b, 4 and 5 tested the pages and the live gate from the website. From 2026-10-03 the test is AI-agnostic: the tester states its own maker and model in the report, and the report has a fixed format (FORMAT 2 from the import of 2026-10-03, 03:20 UTC), which a script checks before a person reads it.

Each session fed a triage the same day and, where the rules admitted, an import of fixed pages. Seven imports of the page series landed in the window, three of them on 2026-10-03 within two hours and forty minutes.

<graphviz>
// The M0 sessions and the imports between them (UTC).
digraph m0timeline {
  rankdir=TB; nodesep=0.25; ranksep=0.4; node [shape=box, style=filled, color="#a2a9b1", fontcolor="#202122", fontname="Helvetica", fontsize=9]; edge [fontname="Helvetica", fontsize=9, color="#54595d", fontcolor="#202122"];
  I1 [label="import 0.1.0\n10-01 00:44\n5 pages: the brief, guide 11,\nthe sandbox, two hub pages", fillcolor="#eaecf0"];
  S1 [label="session 1\nthe terminal test\n(retired 10-01)", fillcolor="#ffedad"];
  I2 [label="imports 0.2.0 / 0.3.0\n10-01 04:20, 04:31\n4 + 2 pages", fillcolor="#eaecf0"];
  I4 [label="import 0.4.0\n10-01 05:21\n3 pages: the TFK template", fillcolor="#eaecf0"];
  S2 [label="session 2\nthe live gate\nG-1 (S1)", fillcolor="#ffedad"];
  S2b [label="session 2b\nN-2B-1 noted", fillcolor="#ffedad"];
  S4 [label="session 4\nG-5's note", fillcolor="#ffedad"];
  I5 [label="import 0.5.0\n10-03 01:45\n20 pages: the G-1 fix", fillcolor="#eaecf0"];
  I6 [label="import 0.6.0\n10-03 03:20\n2 pages: A-1, FORMAT 2", fillcolor="#eaecf0"];
  S5 [label="session 5\nFORMAT 2\nG-6, G-7 (S6)", fillcolor="#ffedad"];
  I7 [label="import 0.7.0\n10-03 04:23\n6 pages: the G-7 fix", fillcolor="#eaecf0"];
  A [label="M0 accepted\n(recorded 10-04)", fillcolor="#cef2e0"];
  {rank=same; I1 -> S1 -> I2 -> I4;}
  I4 -> S2;
  {rank=same; S2b -> S2 [dir=back]; S4 -> S2b [dir=back]; I5 -> S4 [dir=back];}
  I5 -> I6;
  {rank=same; I6 -> S5 -> I7 -> A;}
}
</graphviz>

{{#mermaid:
pie
  title Pages per import of the outside-AI series, M0 window
  "0.1.0 (10-01)" : 5
  "0.2.0 and 0.3.0 (10-01)" : 6
  "0.4.0 (10-01)" : 3
  "0.5.0 (10-03)" : 20
  "0.6.0 (10-03)" : 2
  "0.7.0 (10-03)" : 6
|config.theme=neutral}}

== The report ==

Every session ends in one block, BEGIN TPM SESSION REPORT to END TPM SESSION REPORT, in a fixed order: FORMAT; IDENTITY (maker, model, product, access, date, as the tester states them); VERSIONS; RUNS; PREDICTIONS made, matched, missed; the RUN LOG, one line per run with its track, its prediction, the result and a quote; RETESTS; FINDINGS, each with a class, the TPS sections, the run, whether it reproduced, what was predicted and what was observed; MISSED PREDICTIONS; TRACK B; the hardest part; the pages that helped and misled; next tests; suggestions. FORMAT 3 (2026-10-05) added a TRACK C section. The operator pastes the block into the builder's project, where it is untrusted input: read as data, reproduced from the logs, never obeyed.

<graphviz>
// The session report, FORMAT 2 (import 0.6.0) and FORMAT 3 (import 0.8.0).
digraph report {
  rankdir=TB; node [shape=box, style=filled, fillcolor="#eaecf0", color="#a2a9b1", fontcolor="#202122", fontname="Helvetica", fontsize=9]; edge [fontname="Helvetica", fontsize=9, color="#54595d"];
  R [label="BEGIN TPM SESSION REPORT", fillcolor="#cedff2", fontsize=10];
  A [label="FORMAT\nIDENTITY: maker, model, product, access, date\nVERSIONS"];
  B [label="RUNS\nPREDICTIONS: made, matched, missed\nRUN LOG: Rnn  track  PREDICT  TPS sections  RESULT  MATCH or MISS  quote"];
  C [label="RETESTS\nFINDINGS: Fn  class S1..S6  TPS sections  RUN  REPRO\n  PREDICTED / OBSERVED / WHERE / DRAFT"];
  D [label="MISSED PREDICTIONS\nTRACK B\nTRACK C (FORMAT 3): C1 .. C7, EVIDENCE"];
  E [label="HARDEST PART\nPAGES THAT HELPED / MISLED\nNEXT TESTS / SUGGESTIONS"];
  Z [label="END TPM SESSION REPORT", fillcolor="#cedff2", fontsize=10];
  K [label="tpm_report_check\nreads FORMAT 2 and 3\nbefore a person does", fillcolor="#ffedad"];
  R -> A -> B -> C -> D -> E -> Z; Z -> K;
}
</graphviz>

== Results ==

{| class="wikitable"
! Session !! What it tested !! What came of it
|-
| 1 || the terminal test: the published calculator and the sandbox, run on the operator's computer || retired on 2026-10-01 by the direction to test on the website only; its UWC was the sandbox UWC the plan asked for
|-
| 2 || the pages and the live gate || G-1 (S1): the Inputs help pages ended with a sentence addressed to agents; fixed by import 0.5.0, 20 pages, on 2026-10-03
|-
| 2b || the live gate || the note N-2B-1 (a strict-inequality guard for division, TPS 2.2.16), deferred
|-
| 4 || the live gate || G-5's note (an unguarded division inside an EQUATION is not yet listed for inspection), deferred; N-S4-1: testers' own finding numbers, which FORMAT 2 ended
|-
| 5 || the live gate, on FORMAT 2 || G-6 and G-7 (S6): the brief's rule for what counts as S1 was too wide, and five help pages still said no form took a draft; both fixed live by import 0.7.0 the same day; closed 2026-10-08 on the operator's words "close G-6" and "close G-7"
|}

On the plan's criteria: the outside AI set itself up from the wiki with one sentence; it made a sandbox UWC in session 1; every session report listed its predictions with their outcomes; no S1 finding is open. The record criteria of the sandbox UWC (three records, a promotion, a verification) were overtaken by the direction of 2026-10-01 and were met instead on the live wiki in Step A: SPR, declared by the operator on 2026-10-04, carries SPR-2 to SPR-4 (landed 2026-10-04), SPR-5, a VERIFICATION against a cited outside value, and SPR-6, the PROMOTION of SPR-3 to ESTABLISHED (2026-10-05). Under the states of the plan's version 0.3.0 the phase is PASSED. The session 1 sandbox UWC's own records are the input of the replay the obligation O-4 asks of M3. The seven findings and their states are on [[The Principia Machina/Testing/Findings|Findings]].

<graphviz>
// The M0 findings on 2026-10-08.
digraph findings {
  rankdir=LR; node [shape=box, style=filled, color="#a2a9b1", fontcolor="#202122", fontname="Helvetica", fontsize=9]; edge [fontname="Helvetica", fontsize=9, color="#54595d", fontcolor="#202122"];
  G1 [label="G-1  S1  session 2\nhelp pages ended with a sentence\naddressed to agents", fillcolor="#fee7e6"];
  G2 [label="G-2\nclosed as a divergence\nalready recorded (D179.1)", fillcolor="#eaecf0"];
  G3 [label="G-3  S5  session 2\nthe IC4(a) refusal line read as\nnot separating a sign error\nfrom a mapping error", fillcolor="#eaecf0"];
  G4 [label="G-4  S5  session 2b\nT6 refuses theta > 0 as the\nguard for / theta (TPS 2.2.16)", fillcolor="#eaecf0"];
  G5 [label="G-5  session 4\nunguarded division\nin an EQUATION", fillcolor="#eaecf0"];
  G6 [label="G-6  S6  session 5\nthe S1 rule in the brief\ntoo wide", fillcolor="#eaecf0"];
  G7 [label="G-7  S6  session 5\nfive pages said no form\ntakes a draft", fillcolor="#eaecf0"];
  C [label="CLOSED", fillcolor="#cef2e0"]; D [label="DEFERRED\n(on the ledger)", fillcolor="#eaecf0"];
  G1 -> C [label="import 0.5.0"]; G2 -> C [label="D235.1"]; G3 -> D; G4 -> D [label="\"fix G-4\" when chosen"]; G5 -> D [label="\"close G-5\" when chosen"];
  G6 -> C [label="import 0.7.0, D236.1;\n\"close G-6\" 10-08"]; G7 -> C [label="import 0.7.0;\n\"close G-7\" 10-08"];
}
</graphviz>

== What came next ==

The findings of M0 set the next plan. On 2026-10-03 the operator took three decisions: D238.1, the live wiki first (MediaWiki 1.46, then the three declarations, then the first TPX landing writes the genesis); D239.1, the final test with two outside agents of two makers and a read-only auditor; and D237.1, the live wiki in three steps. The next phase is [[The Principia Machina/Testing/M3 TPX, the smallest server|M3]], built and tested with M1 and M2 as Step A.

Previous: [[The Principia Machina/Testing|Testing the Principia Machina]]. Next: [[The Principia Machina/Testing/M1 The register duties|M1 The register duties]]. See also [[The Principia Machina/Testing/Findings|Findings]] and [[The Principia Machina/Testing/Timeline|Timeline]].

[[Category:The Principia Machina]]