Skip to main content

IES Studio

Help

Checking account…

No active research project.

Reproducibility & Validation

Reproducibility statuses explained

Exact dashboard status names from reproduceNative presentation, and what native EXACT MATCH covers.

Reproducibility statuses explained

Primary dashboard statuses

StatusMeaning
NOT RUNReproduce has not been executed for this link in the current notebook session.
EXACT MATCHNative rerun matched the stored result for a supported path and software version.
MATCH WITHIN TOLERANCENumeric match within configured tolerance (taxonomy includes this status).
MISMATCHRerun disagree with stored values or fingerprints after execution.
UNAVAILABLEPresentation grouping for missing dataset/seed or failed non-executed cases.
FINGERPRINT INCOMPATIBLEStored fingerprint algorithm/version cannot be compared as an exact match.
UNSUPPORTED METHODNo stored native rerun path for this linked method.
DATASET CHANGEDDataset fingerprint no longer matches.
ENGINE VERSION CHANGEDEngine/software version differs.
MISSING DATASET / MISSING SEEDRequired inputs absent (often shown as UNAVAILABLE).
REPRODUCTION FAILEDRerun path failed; may present as UNAVAILABLE when not executed.

Supported native EXACT MATCH paths

  1. Panel entity fixed effects on the built-in sample recorder path.
  2. Scenario supplied-metric comparison records.
  3. Seeded heterogeneous-agent simulation with seed present.

Open related modules