D1

Research and Science

This document adapts Reality Audit to research and science. It does not audit science as one unified authority; it audits the documentable chain from question, observation, and measurement to data, model, inference, publication, correction, and claims about what is.

Audit types used in the domain

Primary audit types

  • A3Model Audit Tests assumptions, model structure, parameters, validation, domain of validity, and assignment to actuality.
  • A4Representation Audit Tests traces, instrument outputs, figures, images, tables, maps, selection, transformation, and presentation.
  • A1Language Audit Tests definitions, operationalisation, hypotheses, conclusions, modality, citation, and communication.

Supporting audit types

  • A7Practice Audit Tests whether documented method and knowledge are followed in performance, deviations, correction, and review.
  • A5System and Institutional Audit Tests incentives, workflows, registers, responsibility, publication systems, funding, and correction channels.
  • A6Authority Audit Tests expertise, peer review, institutional status, mandate, competence, and demands for assent.
  • A2Identity Audit Used where category, researcher role, disciplinary belonging, or identity labelling affects what material or criticism is permitted.

Abstract

Research and science build knowledge through bounded questions, methodical observation, measurement, documentation, modelling, inference, criticism, and review. These stages may be strong without being identical: data are not the phenomenon, the model is not the object, statistical strength is not by itself explanation, peer review is not a truth certificate, and consensus is not identical with correspondence to actuality.

This application document establishes a traceable research chain, requirements for mandate and unit of study, distinctions among observation, measurement, data, model, and inference, assessment of validation and uncertainty, use of the seven audit types, F1–F7 findings, and correction with visible version history. It is intended to protect both research against groundless distrust and actuality against the substitution of method, model, institution, or authority for what is being investigated.

1

Purpose and scope

The purpose is to make research claims traceable from the bounded object of inquiry to the observations, measurements, data, models, inferences, and publication choices supporting them. The document does not decide every disciplinary dispute; it shows what a particular finding rests upon and where its limits lie.

The scope includes empirical, historical, qualitative, quantitative, theoretical, experimental, and computational research insofar as the relevant chains can be documented. Requirements must be adapted to the field: a laboratory experiment, a corpus study, historical source criticism, and a mathematical demonstration do not have the same grounds and must not be reduced to one methodological form.

Reality Audit does not presume that research is captured, false, or dishonest. It begins with mandate, material, and distinctions. It may end in F1 — supported correspondence — just as readily as in uncertainty, insufficient grounds, error, capture risk, or capture identified.

2

The research chain and decisive distinctions

A research claim is rarely produced in one step. It passes through choices concerning question, scope, instrument, registration, cleaning, coding, analysis, model, visualisation, interpretation, and formulation. Each stage may add information, but also selection, loss, assumptions, and uncertainty.

The audit must therefore distinguish what is investigated from the traces and representations used. It must also distinguish a rule-governed inference from the claim about what that inference shows concerning actuality.

Decisive distinctions in the research chain
ConceptFunctionNot automatically
Object of inquiryThe phenomenon, event, text, quantity, relation, or question under investigation.Identical with the dataset or model.
ObservationA registered appearance through sense, instrument, document, or defined procedure.A complete or theory-free reproduction of the object.
MeasurementAssignment of value under a defined quantity, unit, instrument, and procedure.The quantity itself or error-free access to it.
DataRegistered, selected, and structured values, texts, images, codes, or traces.The phenomenon, the whole material, or finished knowledge.
OperationalisationA rule connecting a concept to observable or measurable indicators.Proof that the indicator exhausts the concept.
HypothesisA bounded claim or expectation testable against grounds.An established feature of actuality.
ModelA bounded structuring of variables, relations, mechanisms, or rules.The object or process itself.
TheoryA coherent explanatory or organising framework with concepts and relations.Actuality itself or protection against correction.
CalculationRule-governed operation on symbols, numbers, or represented quantities.Correspondence without valid inputs and reference.
InferenceTransition from grounds to conclusion under stated or reconstructable rules.Stronger than the assumptions and material support.
ExplanationA claim concerning why or how a pattern, event, or effect occurs.The same as description, fit, or prediction.
Assignment to actualityThe claim about what observation, model, or inference shows concerning what is.Built into the model merely because it is coherent or useful.
3

Mandate, unit of study, and object of inquiry

Before method and result are assessed, the question the study actually tests must be clear. An investigation of one dataset, selected group, or period cannot without further grounds become a claim about all persons, all conditions, or a permanent mechanism.

The mandate must distinguish the original research question from the Reality Audit question. Reality Audit may, for example, test traceability, domain of validity, or publication language without reopening the entire study.

RS1

Bounded research question

Record the precise question, central claim, and the kind of answer the study is designed to support.

Minimum basis
Protocol, project plan, hypothesis, research question, or reconstructable principal claim.
RS2

Unit and population

Identify the unit of analysis, sample, population, period, place, and relevant inclusion and exclusion criteria.

RS3

Design and comparison

Make visible whether the inquiry is experimental, observational, historical, qualitative, theoretical, or computational, and what comparisons the design permits.

RS4

Primary and secondary outcomes

Distinguish predefined primary outcomes from secondary, exploratory, or post hoc analyses.

RS5

Prospective commitments and changes

Record protocol, preregistration, or analysis plan where relevant, and disclose later changes with reasons.

RS6

Competence and role

Identify relevant disciplinary, statistical, technical, methodological, and ethical competence, and who decides publication and correction.

RS7

Interests and dependencies

Record funding, ownership, institutional interests, career incentives, and other relations relevant to selection or interpretation.

RS8

Explicit transfer limit

State in advance what the study cannot decide and what additional grounds are required for further generalisation.

4

Observation, instruments, measurement, and data

Data are not simply found; they are registered through instruments, documents, categories, selection, and procedures. This does not make data arbitrary, but it makes the registration chain relevant to what the data can support.

Measurement error, missing data, sampling bias, coding, rounding, filtering, and cleaning must not be collapsed into one vague category. They operate differently and require different documentation and correction.

RS-D1

Provenance

Document where the material comes from, how it was collected, who had access, and which version was analysed.

RS-D2

Instrument and calibration

Record instrument, scale, unit, resolution, calibration, observer procedures, and relevant deviations.

RS-D3

Selection and attrition

Make recruitment, dropout, missing values, exclusions, and their possible effect visible.

RS-D4

Coding and classification

Document how texts, events, persons, or signals are translated into categories and variables, and how disagreement is handled.

RS-D5

Preprocessing

Make cleaning, filtering, normalisation, imputation, transformation, and aggregation traceable from raw material to analysed data.

RS-D6

Quality control

Record controls, blind tests, inter-rater agreement, standard material, or other field-relevant checks.

RS-D7

Access and protection

Distinguish legitimate privacy, source protection, copyright, and safety from absent traceability; document what can be reviewed without breaching protection.

RS-D8

Reproducible data flow

Where possible, make the steps from raw material to analysed data reconstructable through code, versions, logs, or precise procedures.

5

Hypotheses, models, and inference

Models and statistical methods may reveal patterns, compare explanations, and produce precise predictions. They do not acquire ontological content merely by being mathematically consistent or fitting a dataset.

An inference must be reconstructable: which assumptions are used, which alternatives are tested, which parameters are identifiable, and how does the argument move from result to conclusion?

Distinctions in modelling and inference
DistinctionThe first may showIt does not automatically show
Fit / explanationThat a model corresponds to registered material.That the model identifies the actual mechanism.
Correlation / causationThat quantities vary together in the material.That change in one produces change in the other.
Statistical / practical significanceThat a pattern is unlikely under a specified null model or estimated with stated uncertainty.That the difference is large, important, safe, or professionally decisive.
Parameter / propertyA quantity within the selected model.That the same quantity exists as an independent property of the object.
Prediction / post hoc fitHow the model performs on new or held-out material.That the result was predicted before the data were known.
Model selection / truthThat one model performs better than tested alternatives under selected criteria.That all relevant alternatives have been excluded.
Association / generalisationA pattern in the studied population and period.That the pattern holds in other groups, times, or systems.
Mechanism / narrativeA documented process with testable intermediate stages.A plausible story fitted to the result after the fact.
6

Validation, uncertainty, robustness, and replication

Validation is not one yes-or-no stamp. It may concern instrument, measurement, construct, code, model, prediction, external validity, or practical effect. What is validated, against what, and under which conditions must be stated.

In this document, reproduction means obtaining a result again from the same material and analysis, while replication means renewed testing with independent material, sample, or performance. Fields use these terms differently; the local definition must therefore be visible.

RS-V1

Internal checks

Test code, calculation, data flow, logical consistency, and whether the result follows from the stated material.

RS-V2

Calibration

Test whether instrument or model answers to known references within a documented range.

RS-V3

Held-out material

Where relevant, separate development material from testing material and document leakage or repeated adaptation.

RS-V4

Sensitivity

Test how results change under reasonable alternatives in parameters, coding, sample, model, and analysis.

RS-V5

Robustness and alternatives

Test whether the principal finding holds under relevant alternative specifications and explanations without selecting tests only after the desired result is known.

RS-V6

Reproduction

Make it possible to reconstruct the result from the same grounds, or explain precisely which protections or missing materials limit this.

RS-V7

Replication

Test the claim in a new performance or new material where the research question and field make this possible and relevant.

RS-V8

Uncertainty and domain of validity

Report measurement uncertainty, estimation uncertainty, model dependence, knowledge gaps, and the conditions beyond which the result should not be transferred.

7

Peer review, publication, and scientific authority

Peer review, editorial control, disciplinary consensus, and institutional status may be important quality and trust signals. They remain social and professional control arrangements, not direct identity between authority and truth.

A published article may later be corrected, retracted, or bounded. An unpublished or dissenting result may be weak, but status alone does not decide its grounds. Reality Audit examines both the material and the control system around it.

Scientific control and status signals
SignalMay supportCannot by itself establish
Peer reviewMethodological and professional pre-publication control under a journal's process.Truth, replication, or absence of material error.
PublicationA public, citable version with editorial placement.That the claim is no stronger than its grounds or free from conflicts of interest.
Citation countThat a work is used, discussed, or visible.Quality, correspondence, originality, or positive support.
ConsensusThat a field substantially converges on an assessment under available grounds.Infallibility or closure of every open question.
PrestigeHistorical quality, resources, or institutional trust.That the particular analysis is correct.
PreprintEarly public availability and opportunity for open criticism.That formal review has occurred.
Correction or retractionThat the publication system records significant change or error.That every part of the work or the researcher is without value.
8

Visualisation, representation, and communication

Figures, tables, maps, images, diagrams, and summaries are not neutral windows. They select scale, crop, order, category, colour, aggregation, and language. These choices may be professionally necessary, but they must answer to the material and claim they carry.

Public communication may require simplification. Simplification becomes misleading when decisive uncertainty, scope, alternatives, or the distinction between observation and interpretation are removed so that the recipient receives a stronger assignment than the research supports.

RS-R1

Axis, scale, and baseline

Make choices affecting visual magnitude and comparison visible and avoid presentation that exaggerates or conceals differences.

RS-R2

Selection and aggregation

Show which observations, groups, and periods are included and how combining or filtering affects the pattern.

RS-R3

Uncertainty

Display relevant variation, intervals, margins of error, model spread, or qualitative uncertainty where the claim requires it.

RS-R4

Images and reconstruction

Distinguish registered material from illustration, simulation, reconstruction, and artistic representation.

RS-R5

Title and abstract

Test whether title, press release, and abstract retain the same confidence and domain of validity as the analysis.

RS-R6

Modality

Distinguish may, suggests, is consistent with, supports, predicts, and shows; do not convert uncertainty into certainty through language.

RS-R7

Source and version

Connect the representation to the correct dataset, article version, figure grounds, and later corrections.

RS-R8

Public correction

Where an error was communicated publicly, make the correction visible and attach it to the same substantive claim rather than hiding it in a version log.

9

Combining audit types

Research and science are an application domain, not one audit type. A case may contain a correct model but misleading visualisation, sound measurement but overextended language, or a weak institutional correction system without the result itself being false.

Each audit-type finding therefore requires its own material. A finding in one track must not automatically transfer to another.

Common role of A1–A7 in research and science
TypePrimary objectExample research question
A1 LanguageDefinition, hypothesis, operationalisation, modality, citation, and conclusion.Is an association formulated as causation or a bounded measure as a total property?
A2 IdentityResearcher role, disciplinary belonging, participant categorisation, and status labelling of criticism.Is a person or professional identity used instead of testing the argument or material?
A3 ModelAssumptions, structure, parameters, validation, prediction, and domain of validity.What rule generates the result, and what is assigned to actuality on the basis of the model?
A4 RepresentationInstrument output, image, table, map, figure, selection, transformation, and display.What is registered, what is processed, and what is absent from the presentation?
A5 SystemFunding, workflow, data access, publication incentives, record practice, and correction channels.Does the system permit relevant deviations to be registered and corrected?
A6 AuthorityExpertise, peer review, consensus, editorial power, and institutional status.Is status used as relevant weight or as a substitute for testing grounds?
A7 PracticeActual performance, protocol deviations, code use, documentation, correction, and follow-up.Does the performed research correspond to the published method and declared purpose?
10

Findings and formulation

Findings must remain bounded to what the audit examined. An error in a figure is not automatically an error finding for the entire theory; a failed replication is not automatically proof of misconduct; and a robust result is not automatically a complete explanation.

Complex research cases should be divided into partial findings: data grounds, measurement, model, inference, representation, authority system, and practice may receive different F categories and confidence levels.

Examples of bounded findings in research
FindingDefensible formulationOverextended formulation
F1 Supported correspondenceThe result holds under documented measurements, analyses, and robustness checks within the stated domain of validity.The study has proved reality.
F2 Qualified correspondenceThe principal pattern is supported, but effect magnitude and transfer to other populations remain unresolved.The theory is generally true everywhere.
F3 Unresolved uncertaintyThe material does not sufficiently distinguish between the two remaining explanations.Both explanations are equally true.
F4 Insufficient groundsThe claim concerning mechanism extends beyond what observational covariation can establish.The mechanism does not exist.
F5 Error or contradictionThe published figure uses the wrong data series and must be corrected; other parts are not assessed by this finding.The entire research programme is false.
F6 Capture riskThe publication process systematically gives less visibility to null findings and counter-material; the consequence for the particular literature requires further testing.The field is captured.
F7 Capture identifiedWithin the bounded decision process, the selected model is documented as replacing contrary validation data; relevant correction is rejected with a concrete publication or practice consequence.Science has replaced reality with models.
11

Correction, open science, and review

Correction must answer to the finding. Minor documentation errors do not automatically require retraction, while a decisive data or code error cannot be corrected merely through new wording. The measure must reach the point in the research chain where the deviation arose.

Open science may strengthen traceability through sharing protocols, code, materials, preregistration, versions, and negative results. Openness is not unlimited: privacy, source protection, Indigenous and ownership interests, safety, copyright, and legitimate confidentiality must be considered.

RS-C1

Correct data, code, and calculation

Correct errors in material, transformation, analysis, table, or figure and trace which conclusions are affected.

RS-C2

Disclose deviations

Document deviations from protocol, preregistration, analysis plan, or stated method and explain why they occurred.

RS-C3

Bound the claim

Adjust language, domain of validity, causal claim, or ontological interpretation to what the material supports.

RS-C4

Add relevant testing

Perform sensitivity analysis, alternative modelling, independent validation, reanalysis, renewed measurement, or replication where the finding requires it.

RS-C5

Publish visible correction

Use correction, new version, notice, or retraction according to scope and connect public versions to the correction.

RS-C6

Protect participants and sources

Correct without disclosing more personal, source-sensitive, or safety-sensitive material than the purpose requires.

RS-C7

Test system effects

Where the error arises from incentives, workflow, or control systems, test whether change actually reduces the same risk in new cases.

RS-C8

Review and close

Define responsibility, deadline, review material, closure criteria, and what happens if the correction does not work.

12

Limits, misuse, and further research programme

This document is not an anti-science argument and does not justify treating all expertise, methods, or research findings as equivalent. Corrigibility is a strength of research where institutions and practices genuinely permit correction.

Reality Audit must not be used to demand impossible certainty before knowledge can inform action. Decisions often must be made under uncertainty. The requirement is that uncertainty, grounds, alternatives, responsibility, and opportunity for renewed testing remain visible and proportionate to consequence.

Further development should include field-specific appendices for measurement science, statistical inference, qualitative methods, historical source criticism, computational science, research ethics, and open science. Such appendices must be developed with relevant domain competence.

  • Develop field-specific requirements without making one discipline the measure of every other discipline.
  • Build public, anonymised, or synthetic cases demonstrating the difference among data, model, language, and system problems.
  • Develop a research audit template containing protocol, data flow, analysis plan, findings matrix, and correction log.
  • Test the methodology on both disputed and ordinary research findings — including cases ending in F1.

Grounds and references

  1. DET SOM ERFoundational work for the relations among actuality, knowledge, language, models, systems, and practice.
  2. Corrigible RealismPhilosophical placement of correspondence and corrigibility.
  3. Reality AuditMethodological overview and common principles.
  4. Audit StandardNormative requirements for documented audit.
  5. Applicable discipline-specific methods, research ethics, reporting standards, and safety requirementsMust be added according to field, project, and jurisdiction; this document does not replace them.
V

Revision history

Document version
1.0
First published
18 June 2026
1.0

First public edition.