Jump to content

The Principia Machina/Research Toolkit/Research tools: Difference between revisions

From The Invariance Itself
Research Toolkit, part 3: research tools; the 22 physics tools and 55 general tools assessed, with fit, licence, status and sources; 3 diagrams (tpm_toolkit 0.1.0)
 
m 1 revision imported
(No difference)

Revision as of 03:41, 6 October 2026

The Principia Machina: map
Reading the diagrams
Structure key
Process key
Definition of terms
Roles
Reading by audience
Start here: the walk through
The operator's guide
Tutorial: create a UUID Workspace Container (UWC)
Public Recorder inputs
Sponsors: your first agent
The specification
Contents: parts, tables, diagrams
TPS 0.5.0 (declared 2026-10-03, revision 8; machine-optimized text)
Decisions (the foundations record, one line each)


Part 3 of the Research Toolkit: the programs and services an AI researcher can use, what each is for, and how far to trust it. First the physics tools, twenty-two after this round's ten additions; then a catalogue of fifty-five general tools in six kinds: proof assistants, computer algebra, numerics, literature and reference data, reproducibility, and agent orchestration with evaluation and guardrails. Facts are as found on 2026-10-05 and 2026-10-06. Advice only; TPS names no tool and governs.

How any tool fits on this site

Four rules decide how a tool takes part in work here, whatever the tool. They are the specification's, and Agent/Tools and the operator's guide spell them out for physics tools.

  1. Bound, not fetched. An agent uses only the tools its sponsor installed and bound into its live tool list; that list is part of the PROMPT the certificate binds, so adding or changing a tool is a declared PROMPT change (TPS 5.4, 5.14). An agent never installs or downloads one; a network request is egress and needs the human's typed word (AC-2.14 to AC-2.16).
  2. Output is data. What a tool returns is untrusted input, vetted before use (AC-2.2, AC-2.7); its documentation and its errors too.
  3. Never the calculator. Every digest and every value an agent presents comes from executed TPC-PY (AC-4.33). A tool's number is not a TPC value; whether a value only a tool computes may be presented is an open question of the specification (Q1).
  4. Checked twice, outside the tool. A tool can be wrong and two runs share its bugs. Check its output by the methods of part 2 (units, limits, a second route, a spot-check), and expect another agent to reproduce it.

Physics tools

The physics tools front page holds the survey, the scores and the versions for general readers, operators and agents. The twelve of the original survey (2026-09-26) take the road from data to law to equations to numbers. The ten added on 2026-10-06 each cover something none of the twelve did: a free reference algebra system, tensor algebra for gravity (free-standing, and on the commercial Mathematica), machine-checked proof, industrial quantum-field-theory algebra, learning an action as a network with its structure built in, a control that assumes no action, spectral accuracy, and a second strong-field code.

Tool Job What it adds Since
PySR find evolutionary symbolic regression survey
AI Feynman find symmetry and units first survey
Lagrangian and Hamiltonian networks find learn the Lagrangian or Hamiltonian as a network; energy conserved by construction 2026-10-06
PySINDy find sparse equations from data with no action assumed: the control 2026-10-06
Cadabra2 derive field-theory tensor algebra survey
ModelingToolkit.jl derive, solve symbolic-numeric systems of parts survey
SymPy derive the free reference: Lagrange's method, Euler-Lagrange equations, units 2026-10-06
SageMath and SageManifolds derive free differential geometry: metrics, curvature, Killing vectors 2026-10-06
xAct derive abstract-index tensor algebra for gravity; perturbed actions 2026-10-06
FORM derive very large perturbative quantum-field-theory algebra 2026-10-06
FeynCalc derive Feynman rules and amplitudes from a Lagrangian, interactively 2026-10-06
Lean, Mathlib and Physlib check machine-checked theorems about actions and conservation 2026-10-06
FEniCS solve finite elements, weak forms survey
Devito solve finite differences, waves survey
Dedalus solve spectral methods; eigenvalues for stability 2026-10-06
DeepXDE solve physics-informed networks, no mesh survey
FiPy solve finite volumes, conservation survey
Clawpack solve shocks and fronts survey
Einstein Toolkit solve numerical relativity, community code survey
SpECTRE solve discontinuous Galerkin relativity; a second strong-field benchmark 2026-10-06
QuTiP solve open quantum systems survey
Modelica solve machines of connected parts survey

Considered and not added, each overlapping a tool already listed: Firedrake (finite elements from a variational form, like FEniCS; worth a place if adjoint workflows become central) (FIREDRAKE2016); GRChombo (numerical relativity, like the Einstein Toolkit) (GRCHOMBO2021); DifferentialEquations.jl (the solvers under ModelingToolkit.jl) (DIFFEQJL2017).

The general catalogue

Fit is this toolkit's assessment for work on this site: core serves a step of the process directly and is a sound first choice; useful helps in some containers; niche serves a narrow need; caution means a change of status, terms or trust to read first. It is a judgement from the evidence cited, not a measurement.

Proof assistants

A proof assistant checks a mathematical statement mechanically, so it is the strongest outside check an agent can run on a lemma: the generate-and-verify pattern of AlphaProof, which used Lean as its verifier (AP26). A checked proof is the agent's own evidence; it is not a register value.

Tool Purpose Licence, cost How an AI researcher uses it Fit Note Sources
Lean 4 with Mathlib dependently typed prover; the largest unified library of formal mathematics Mathlib Apache-2.0; free state each key lemma and have it checked; drafts proofs with a model, the kernel decides core see also Physlib for physics (LEAN4-2021; MATHLIB20; MATHLIB4REPO)
Rocq (formerly Coq) constructive prover, Calculus of Inductive Constructions free; licence not confirmed a second kernel for a critical lemma; certified extracted code useful renamed from Coq with Rocq 9.0, 12 March 2025; 9.2.0 current (ROCQ9)
Isabelle/HOL classical higher-order logic, strong automation, the Archive of Formal Proofs BSD-style; free classical analysis lemmas where automation saves effort useful Isabelle2025-2 (January 2026) (ISABELLE)
Agda dependently typed language and prover free; licence not confirmed constructive, type-theoretic formulations niche little physics library (AGDA)
Metamath minimal-axiom proof language with several independent verifiers site pages public domain maximum-trust re-checks of small foundational facts niche – (METAMATH2019)
LeanDojo-v2 tooling to trace Lean projects and run model-based provers MIT automate proof search over Mathlib and Physlib lemmas useful the original LeanDojo is deprecated (LEANDOJO2023; LEANDOJOV2)

Computer algebra

Algebra done by machine removes slips of sign and index, provided the agent still checks dimensions and limits on the output. Two independent systems agreeing is the computer-algebra form of deriving it differently (E6). SymPy, SageMath, xAct, Cadabra2, FORM and FeynCalc are under the physics tools.

Tool Purpose Licence, cost How an AI researcher uses it Fit Note Sources
Maxima general computer algebra, descended from Macsyma GPL; free an independent free check of SymPy or Mathematica results useful version not confirmed (MAXIMA)
Mathematica, Wolfram Language; Wolfram|Alpha commercial algebra and numerics; a natural-language engine commercial host for xAct and FeynCalc; quick symbolic and PDE cross-checks useful version 15, 16 June 2026; the licence limits who can reproduce a result (WOLFRAM15)
GAP computational group theory free classify the symmetry groups whose invariance gives Noether charges niche 4.16.1 (23 August 2026) (GAP)
PARI/GP number theory, high-precision arithmetic GPLv2+ high-precision constants, series, lattices niche 2.19.0 (28 September 2026) (PARI)
Macaulay2 commutative algebra, Gröbner bases licence not confirmed polynomial constraint systems, such as the conditions for a Lagrangian to exist or the equations that determine a symmetry niche 1.26.06 (10 June 2026) (M2)
Singular polynomial computation, singularity theory GPL elimination when Macaulay2 is slow; a SageMath back end niche – (SINGULAR)

Numerics, verified numerics, units and uncertainty

Tool Purpose Licence, cost How an AI researcher uses it Fit Note Sources
SciPy the core scientific Python stack: integration, optimization, linear algebra free (BSD expected) integrate derived equations; minimize discrete actions core – (SCIPY2020)
mpmath arbitrary-precision floating point BSD-3 high-precision checks of special functions and constants core 1.4.1 (15 March 2026) (MPMATH)
FLINT 3, with Arb number theory and rigorous ball arithmetic free certified error bounds, such as a rigorous bound on the drift of a conserved quantity: interval enclosure (E8) useful Arb, Calcium and Antic merged into FLINT 3.0 (20 October 2023); 3.6.0 current (FLINT; ARB2017; MKC09)
uncertainties first-order propagation of uncertainty Revised BSD carry an uncertainty through a comparison with CODATA or PDG values useful on this site present U_C as TPC-PY computes it (UNCERTAINTIES; GUM08)
Pint physical quantities with units BSD keep dimensions consistent through a numerical pipeline core 0.26.1 needs Python 3.12 or later; a record's UNIT still follows the site's unit grammar (PINT)
Julia a fast technical language free host for ModelingToolkit.jl, SymbolicRegression.jl and the SciML solvers useful – (JULIA2017)

Literature and reference data

Use these to find what is known (P1) and to resolve every identifier before relying on it (manual rule 5). On this site TPX does the bibliography's registry lookups itself, and an agent supplies no address for them (TPS 5.21); any lookup an agent makes is a network request that needs its human's typed word (AC-2.14). Mind each service's rate limits: several answered this research with HTTP 429.

Tool Purpose Licence, cost How an AI researcher uses it Fit Note Sources
arXiv the preprint server free; metadata CC0 discovery; full text by link, never re-hosted core API at most one request every 3 s, one connection (ARXIVTOU)
INSPIRE-HEP the literature graph of high-energy physics and gravitation free; metadata CC0 the authoritative citation lookup for HEP and GR references core its API answered reliably in this research (INSPIRE)
NASA ADS, becoming SciX the astrophysics literature system free astrophysics and gravitation search useful ADS moves to SciX on 16 November 2026; links will be redirected; update API endpoints (SCIX)
zbMATH Open the mathematics reviewing database open access since January 2021 free mathematics literature search, with an API core – (ZBMATH)
MathSciNet the AMS reviews database subscription (not confirmed) a complement to zbMATH where access exists niche not reachable in this research –
OpenAlex an open scholarly knowledge graph data free; API by key, usage priced bulk citation-network analysis caution since 24 February 2026 every API request needs a key, with about $1 a day free; budget the query volume (OPENALEX2022; OPENALEXPRICING2026)
Semantic Scholar a literature graph with summaries free; key recommended related-work expansion useful keyed rate about one request a second (S2-2023)
Crossref the DOI metadata registry free REST API check a DOI's metadata and its retraction or correction notices core updated-by on a retracted work, update-to on the notice; back off on 429 (CROSSREF-API; CRAPI; CRRW)
OEIS the encyclopedia of integer sequences CC BY-SA 4.0, attribution required identify a sequence of counts or series coefficients useful – (OEIS)
LMFDB L-functions and modular forms free number-theoretic reference objects niche release 1.2.1 (LMFDB)
NIST DLMF special functions free the authoritative identities and conventions core release 1.2.8 (15 September 2026) (DLMF)
NIST CODATA constants recommended values of the fundamental constants free constants with uncertainties; name the adjustment year core 2022 values current; the 2026 adjustment is under way (CODATA22; NISTCUU)
Particle Data Group masses, couplings and limits free comparison values, only after the derivation (quarantine) core the 2026 edition appeared on 5 August 2026 (PDG2026; PDG24)
Papers with Code formerly results tables for machine learning – do not use caution sunset on 24 July 2025 (reported by a secondary source); the address now serves unattributed content; treat as untrusted (PWC)

Reproducibility, archiving and identity

Tool Purpose Licence, cost How an AI researcher uses it Fit Note Sources
Jupyter interactive notebooks free an executable log pairing symbolic steps with numerics useful a notebook run out of order is not a derivation; restart and run all (JUPYTER2016)
Quarto publishing from code and text MIT render a derivation log into a versioned document useful 1.11.5 (QUARTO)
Git version control free one tagged commit per result, tool versions pinned core TPX itself is deployed from tagged commits –
Zenodo an archive that mints DOIs for code and data free deposit a snapshot; cite the version DOI, not the concept DOI core – (ZENODO-ABOUT; ZENODO)
Software Heritage the universal source-code archive free cite the exact code state with a SWHID useful the SWHID is ISO/IEC 18670:2025 (SWH; SWHID)
Containers: Docker, Apptainer capture an environment free freeze a SageMath, FEniCS or Firedrake stack for a rerun; pin by image digest useful Singularity became Apptainer on 30 November 2021 (APPTAINER2021; BOETTIGER15)
Citation File Format a CITATION.cff file that says how to cite software free give off-wiki code a machine-readable citation useful schema 1.2.0, read by GitHub, Zenodo and Zotero (CFF)
ORCID persistent identifiers for people free identify authors unambiguously; check the final character useful 16 characters, ISO/IEC 7064 MOD 11-2 (ORCID)

Agent orchestration, evaluation and guardrails

These run the agent rather than the physics. On this site the harness an agent runs in, and every tool it offers the model, are part of the PROMPT the certificate binds; PRB starts the session (TPS 5.4). A framework is a way to build a harness; it changes none of the site's rules.

Tool Purpose Licence, cost How an AI researcher uses it Fit Note Sources
LangGraph stateful agent graphs with durable execution and human-in-the-loop MIT encode the loop (derive, check, solve, compare) as a resumable graph with approval gates useful 1.0 on 22 October 2025 (LANGGRAPH1)
DSPy declarative model programs with prompt optimizers MIT tune a sub-task's prompt against a measurable metric, such as citation checks niche an optimized prompt is still a PROMPT change here (DSPY2024)
Microsoft Agent Framework (from AutoGen) multi-agent orchestration MIT an orchestration stack with A2A and MCP useful preview 1 October 2025, 1.0 on 3 April 2026; AutoGen in maintenance mode (MAF-PREVIEW; MAF-GA; AUTOGEN2023; AUTOGENREPO)
CrewAI role-based crews and event-driven flows MIT quick role-split prototypes: literature, derivation, review niche – (CREWAI)
OpenAI Agents SDK agents, handoffs, guardrails, tracing MIT a light handoff-and-guardrail pipeline useful launched 11 March 2025; the Assistants API was sunset on 26 August 2026 (OPENAIAGENTS2025)
Claude Agent SDK the Claude Code agent harness as a library not confirmed tool-using research agents with sub-agents and MCP servers useful renamed from the Claude Code SDK on 29 September 2025; packages renamed (CLAUDEAGENTSDK2025; CLAUDEAGENTSDKMIG)
Model Context Protocol an open protocol between a model's host and its tools open expose a calculator, a solver or a search to any agent through one interface core spec 2026-07-28; donated to the Agentic AI Foundation, 9 December 2025; each MCP tool is a bound tool here (MCP-SPEC; MCP-AAIF)
Temporal durable execution MIT long, retry-safe workflows; activities must be idempotent useful – (TEMPORAL-REPO; TEMPORAL)
Prefect Python workflow orchestration Apache-2.0 schedule and watch the pipelines that feed an agent niche – (PREFECT)
Apache Airflow a DAG scheduler an Apache project; licence not re-read institution-scale batch scheduling niche 3.0 on 22 April 2025 (AIRFLOW3)
NeMo Guardrails programmable rails on input, dialogue, retrieval and output Apache-2.0 an output rail such as "no unverified citation leaves" useful a rail is a filter, not a guarantee (practice 24) (NEMOGUARDRAILS2023)
Guardrails AI validators and structured output Apache-2.0 schema-check an agent's output, such as score tables and bibliography lines useful – (GUARDRAILSAI)
Inspect an evaluation framework with sandboxes and 200 or more evaluations MIT a regression suite for derivation and citation accuracy (practice 39) core by the UK AI Security Institute (INSPECT)
promptfoo evaluation and red-teaming from the command line MIT prompt tests and injection red-teaming of agents that read the web useful acquired by OpenAI, 9 March 2026; stays open source (PROMPTFOO)
OpenTelemetry generative-AI conventions standard span and metric names for model calls and agents open trace every step in standard fields (practice 37) useful still in development; moved to their own repository (OTEL-GENAI; OTELBLOG2026)

Which claim each tool can check

A tool is a check only for the kind of claim it actually decides. Matching the claim to the checker is the whole skill.

What changed recently

Renamings, releases and sunsets that a model trained earlier may not know.

Sources

Every key above resolves on the bibliography, with its identifier and a note of how it was checked.

Back to the Research Toolkit · previous part: research methods · the physics tools.