D1
Research and Science
This document adapts Reality Audit to research and science. It does not audit science as one unified authority; it audits the documentable chain from question, observation, and measurement to data, model, inference, publication, correction, and claims about what is.
Audit types used in the domain
Primary audit types
- A3Model Audit Tests assumptions, model structure, parameters, validation, domain of validity, and assignment to actuality.
- A4Representation Audit Tests traces, instrument outputs, figures, images, tables, maps, selection, transformation, and presentation.
- A1Language Audit Tests definitions, operationalisation, hypotheses, conclusions, modality, citation, and communication.
Supporting audit types
- A7Practice Audit Tests whether documented method and knowledge are followed in performance, deviations, correction, and review.
- A5System and Institutional Audit Tests incentives, workflows, registers, responsibility, publication systems, funding, and correction channels.
- A6Authority Audit Tests expertise, peer review, institutional status, mandate, competence, and demands for assent.
- A2Identity Audit Used where category, researcher role, disciplinary belonging, or identity labelling affects what material or criticism is permitted.
Abstract
Research and science build knowledge through bounded questions, methodical observation, measurement, documentation, modelling, inference, criticism, and review. These stages may be strong without being identical: data are not the phenomenon, the model is not the object, statistical strength is not by itself explanation, peer review is not a truth certificate, and consensus is not identical with correspondence to actuality.
This application document establishes a traceable research chain, requirements for mandate and unit of study, distinctions among observation, measurement, data, model, and inference, assessment of validation and uncertainty, use of the seven audit types, F1–F7 findings, and correction with visible version history. It is intended to protect both research against groundless distrust and actuality against the substitution of method, model, institution, or authority for what is being investigated.
Purpose and scope
The purpose is to make research claims traceable from the bounded object of inquiry to the observations, measurements, data, models, inferences, and publication choices supporting them. The document does not decide every disciplinary dispute; it shows what a particular finding rests upon and where its limits lie.
The scope includes empirical, historical, qualitative, quantitative, theoretical, experimental, and computational research insofar as the relevant chains can be documented. Requirements must be adapted to the field: a laboratory experiment, a corpus study, historical source criticism, and a mathematical demonstration do not have the same grounds and must not be reduced to one methodological form.
Reality Audit does not presume that research is captured, false, or dishonest. It begins with mandate, material, and distinctions. It may end in F1 — supported correspondence — just as readily as in uncertainty, insufficient grounds, error, capture risk, or capture identified.
The research chain and decisive distinctions
A research claim is rarely produced in one step. It passes through choices concerning question, scope, instrument, registration, cleaning, coding, analysis, model, visualisation, interpretation, and formulation. Each stage may add information, but also selection, loss, assumptions, and uncertainty.
The audit must therefore distinguish what is investigated from the traces and representations used. It must also distinguish a rule-governed inference from the claim about what that inference shows concerning actuality.
| Concept | Function | Not automatically |
|---|---|---|
| Object of inquiry | The phenomenon, event, text, quantity, relation, or question under investigation. | Identical with the dataset or model. |
| Observation | A registered appearance through sense, instrument, document, or defined procedure. | A complete or theory-free reproduction of the object. |
| Measurement | Assignment of value under a defined quantity, unit, instrument, and procedure. | The quantity itself or error-free access to it. |
| Data | Registered, selected, and structured values, texts, images, codes, or traces. | The phenomenon, the whole material, or finished knowledge. |
| Operationalisation | A rule connecting a concept to observable or measurable indicators. | Proof that the indicator exhausts the concept. |
| Hypothesis | A bounded claim or expectation testable against grounds. | An established feature of actuality. |
| Model | A bounded structuring of variables, relations, mechanisms, or rules. | The object or process itself. |
| Theory | A coherent explanatory or organising framework with concepts and relations. | Actuality itself or protection against correction. |
| Calculation | Rule-governed operation on symbols, numbers, or represented quantities. | Correspondence without valid inputs and reference. |
| Inference | Transition from grounds to conclusion under stated or reconstructable rules. | Stronger than the assumptions and material support. |
| Explanation | A claim concerning why or how a pattern, event, or effect occurs. | The same as description, fit, or prediction. |
| Assignment to actuality | The claim about what observation, model, or inference shows concerning what is. | Built into the model merely because it is coherent or useful. |
Mandate, unit of study, and object of inquiry
Before method and result are assessed, the question the study actually tests must be clear. An investigation of one dataset, selected group, or period cannot without further grounds become a claim about all persons, all conditions, or a permanent mechanism.
The mandate must distinguish the original research question from the Reality Audit question. Reality Audit may, for example, test traceability, domain of validity, or publication language without reopening the entire study.
Bounded research question
Record the precise question, central claim, and the kind of answer the study is designed to support.
- Minimum basis
- Protocol, project plan, hypothesis, research question, or reconstructable principal claim.
Unit and population
Identify the unit of analysis, sample, population, period, place, and relevant inclusion and exclusion criteria.
Design and comparison
Make visible whether the inquiry is experimental, observational, historical, qualitative, theoretical, or computational, and what comparisons the design permits.
Primary and secondary outcomes
Distinguish predefined primary outcomes from secondary, exploratory, or post hoc analyses.
Prospective commitments and changes
Record protocol, preregistration, or analysis plan where relevant, and disclose later changes with reasons.
Competence and role
Identify relevant disciplinary, statistical, technical, methodological, and ethical competence, and who decides publication and correction.
Interests and dependencies
Record funding, ownership, institutional interests, career incentives, and other relations relevant to selection or interpretation.
Explicit transfer limit
State in advance what the study cannot decide and what additional grounds are required for further generalisation.
Observation, instruments, measurement, and data
Data are not simply found; they are registered through instruments, documents, categories, selection, and procedures. This does not make data arbitrary, but it makes the registration chain relevant to what the data can support.
Measurement error, missing data, sampling bias, coding, rounding, filtering, and cleaning must not be collapsed into one vague category. They operate differently and require different documentation and correction.
Provenance
Document where the material comes from, how it was collected, who had access, and which version was analysed.
Instrument and calibration
Record instrument, scale, unit, resolution, calibration, observer procedures, and relevant deviations.
Selection and attrition
Make recruitment, dropout, missing values, exclusions, and their possible effect visible.
Coding and classification
Document how texts, events, persons, or signals are translated into categories and variables, and how disagreement is handled.
Preprocessing
Make cleaning, filtering, normalisation, imputation, transformation, and aggregation traceable from raw material to analysed data.
Quality control
Record controls, blind tests, inter-rater agreement, standard material, or other field-relevant checks.
Access and protection
Distinguish legitimate privacy, source protection, copyright, and safety from absent traceability; document what can be reviewed without breaching protection.
Reproducible data flow
Where possible, make the steps from raw material to analysed data reconstructable through code, versions, logs, or precise procedures.
Hypotheses, models, and inference
Models and statistical methods may reveal patterns, compare explanations, and produce precise predictions. They do not acquire ontological content merely by being mathematically consistent or fitting a dataset.
An inference must be reconstructable: which assumptions are used, which alternatives are tested, which parameters are identifiable, and how does the argument move from result to conclusion?
| Distinction | The first may show | It does not automatically show |
|---|---|---|
| Fit / explanation | That a model corresponds to registered material. | That the model identifies the actual mechanism. |
| Correlation / causation | That quantities vary together in the material. | That change in one produces change in the other. |
| Statistical / practical significance | That a pattern is unlikely under a specified null model or estimated with stated uncertainty. | That the difference is large, important, safe, or professionally decisive. |
| Parameter / property | A quantity within the selected model. | That the same quantity exists as an independent property of the object. |
| Prediction / post hoc fit | How the model performs on new or held-out material. | That the result was predicted before the data were known. |
| Model selection / truth | That one model performs better than tested alternatives under selected criteria. | That all relevant alternatives have been excluded. |
| Association / generalisation | A pattern in the studied population and period. | That the pattern holds in other groups, times, or systems. |
| Mechanism / narrative | A documented process with testable intermediate stages. | A plausible story fitted to the result after the fact. |
Validation, uncertainty, robustness, and replication
Validation is not one yes-or-no stamp. It may concern instrument, measurement, construct, code, model, prediction, external validity, or practical effect. What is validated, against what, and under which conditions must be stated.
In this document, reproduction means obtaining a result again from the same material and analysis, while replication means renewed testing with independent material, sample, or performance. Fields use these terms differently; the local definition must therefore be visible.
Internal checks
Test code, calculation, data flow, logical consistency, and whether the result follows from the stated material.
Calibration
Test whether instrument or model answers to known references within a documented range.
Held-out material
Where relevant, separate development material from testing material and document leakage or repeated adaptation.
Sensitivity
Test how results change under reasonable alternatives in parameters, coding, sample, model, and analysis.
Robustness and alternatives
Test whether the principal finding holds under relevant alternative specifications and explanations without selecting tests only after the desired result is known.
Reproduction
Make it possible to reconstruct the result from the same grounds, or explain precisely which protections or missing materials limit this.
Replication
Test the claim in a new performance or new material where the research question and field make this possible and relevant.
Uncertainty and domain of validity
Report measurement uncertainty, estimation uncertainty, model dependence, knowledge gaps, and the conditions beyond which the result should not be transferred.
Peer review, publication, and scientific authority
Peer review, editorial control, disciplinary consensus, and institutional status may be important quality and trust signals. They remain social and professional control arrangements, not direct identity between authority and truth.
A published article may later be corrected, retracted, or bounded. An unpublished or dissenting result may be weak, but status alone does not decide its grounds. Reality Audit examines both the material and the control system around it.
| Signal | May support | Cannot by itself establish |
|---|---|---|
| Peer review | Methodological and professional pre-publication control under a journal's process. | Truth, replication, or absence of material error. |
| Publication | A public, citable version with editorial placement. | That the claim is no stronger than its grounds or free from conflicts of interest. |
| Citation count | That a work is used, discussed, or visible. | Quality, correspondence, originality, or positive support. |
| Consensus | That a field substantially converges on an assessment under available grounds. | Infallibility or closure of every open question. |
| Prestige | Historical quality, resources, or institutional trust. | That the particular analysis is correct. |
| Preprint | Early public availability and opportunity for open criticism. | That formal review has occurred. |
| Correction or retraction | That the publication system records significant change or error. | That every part of the work or the researcher is without value. |
Visualisation, representation, and communication
Figures, tables, maps, images, diagrams, and summaries are not neutral windows. They select scale, crop, order, category, colour, aggregation, and language. These choices may be professionally necessary, but they must answer to the material and claim they carry.
Public communication may require simplification. Simplification becomes misleading when decisive uncertainty, scope, alternatives, or the distinction between observation and interpretation are removed so that the recipient receives a stronger assignment than the research supports.
Axis, scale, and baseline
Make choices affecting visual magnitude and comparison visible and avoid presentation that exaggerates or conceals differences.
Selection and aggregation
Show which observations, groups, and periods are included and how combining or filtering affects the pattern.
Uncertainty
Display relevant variation, intervals, margins of error, model spread, or qualitative uncertainty where the claim requires it.
Images and reconstruction
Distinguish registered material from illustration, simulation, reconstruction, and artistic representation.
Title and abstract
Test whether title, press release, and abstract retain the same confidence and domain of validity as the analysis.
Modality
Distinguish may, suggests, is consistent with, supports, predicts, and shows; do not convert uncertainty into certainty through language.
Source and version
Connect the representation to the correct dataset, article version, figure grounds, and later corrections.
Public correction
Where an error was communicated publicly, make the correction visible and attach it to the same substantive claim rather than hiding it in a version log.
Combining audit types
Research and science are an application domain, not one audit type. A case may contain a correct model but misleading visualisation, sound measurement but overextended language, or a weak institutional correction system without the result itself being false.
Each audit-type finding therefore requires its own material. A finding in one track must not automatically transfer to another.
| Type | Primary object | Example research question |
|---|---|---|
| A1 Language | Definition, hypothesis, operationalisation, modality, citation, and conclusion. | Is an association formulated as causation or a bounded measure as a total property? |
| A2 Identity | Researcher role, disciplinary belonging, participant categorisation, and status labelling of criticism. | Is a person or professional identity used instead of testing the argument or material? |
| A3 Model | Assumptions, structure, parameters, validation, prediction, and domain of validity. | What rule generates the result, and what is assigned to actuality on the basis of the model? |
| A4 Representation | Instrument output, image, table, map, figure, selection, transformation, and display. | What is registered, what is processed, and what is absent from the presentation? |
| A5 System | Funding, workflow, data access, publication incentives, record practice, and correction channels. | Does the system permit relevant deviations to be registered and corrected? |
| A6 Authority | Expertise, peer review, consensus, editorial power, and institutional status. | Is status used as relevant weight or as a substitute for testing grounds? |
| A7 Practice | Actual performance, protocol deviations, code use, documentation, correction, and follow-up. | Does the performed research correspond to the published method and declared purpose? |
Findings and formulation
Findings must remain bounded to what the audit examined. An error in a figure is not automatically an error finding for the entire theory; a failed replication is not automatically proof of misconduct; and a robust result is not automatically a complete explanation.
Complex research cases should be divided into partial findings: data grounds, measurement, model, inference, representation, authority system, and practice may receive different F categories and confidence levels.
| Finding | Defensible formulation | Overextended formulation |
|---|---|---|
| F1 Supported correspondence | The result holds under documented measurements, analyses, and robustness checks within the stated domain of validity. | The study has proved reality. |
| F2 Qualified correspondence | The principal pattern is supported, but effect magnitude and transfer to other populations remain unresolved. | The theory is generally true everywhere. |
| F3 Unresolved uncertainty | The material does not sufficiently distinguish between the two remaining explanations. | Both explanations are equally true. |
| F4 Insufficient grounds | The claim concerning mechanism extends beyond what observational covariation can establish. | The mechanism does not exist. |
| F5 Error or contradiction | The published figure uses the wrong data series and must be corrected; other parts are not assessed by this finding. | The entire research programme is false. |
| F6 Capture risk | The publication process systematically gives less visibility to null findings and counter-material; the consequence for the particular literature requires further testing. | The field is captured. |
| F7 Capture identified | Within the bounded decision process, the selected model is documented as replacing contrary validation data; relevant correction is rejected with a concrete publication or practice consequence. | Science has replaced reality with models. |
Correction, open science, and review
Correction must answer to the finding. Minor documentation errors do not automatically require retraction, while a decisive data or code error cannot be corrected merely through new wording. The measure must reach the point in the research chain where the deviation arose.
Open science may strengthen traceability through sharing protocols, code, materials, preregistration, versions, and negative results. Openness is not unlimited: privacy, source protection, Indigenous and ownership interests, safety, copyright, and legitimate confidentiality must be considered.
Correct data, code, and calculation
Correct errors in material, transformation, analysis, table, or figure and trace which conclusions are affected.
Disclose deviations
Document deviations from protocol, preregistration, analysis plan, or stated method and explain why they occurred.
Bound the claim
Adjust language, domain of validity, causal claim, or ontological interpretation to what the material supports.
Add relevant testing
Perform sensitivity analysis, alternative modelling, independent validation, reanalysis, renewed measurement, or replication where the finding requires it.
Publish visible correction
Use correction, new version, notice, or retraction according to scope and connect public versions to the correction.
Protect participants and sources
Correct without disclosing more personal, source-sensitive, or safety-sensitive material than the purpose requires.
Test system effects
Where the error arises from incentives, workflow, or control systems, test whether change actually reduces the same risk in new cases.
Review and close
Define responsibility, deadline, review material, closure criteria, and what happens if the correction does not work.
Limits, misuse, and further research programme
This document is not an anti-science argument and does not justify treating all expertise, methods, or research findings as equivalent. Corrigibility is a strength of research where institutions and practices genuinely permit correction.
Reality Audit must not be used to demand impossible certainty before knowledge can inform action. Decisions often must be made under uncertainty. The requirement is that uncertainty, grounds, alternatives, responsibility, and opportunity for renewed testing remain visible and proportionate to consequence.
Further development should include field-specific appendices for measurement science, statistical inference, qualitative methods, historical source criticism, computational science, research ethics, and open science. Such appendices must be developed with relevant domain competence.
- Develop field-specific requirements without making one discipline the measure of every other discipline.
- Build public, anonymised, or synthetic cases demonstrating the difference among data, model, language, and system problems.
- Develop a research audit template containing protocol, data flow, analysis plan, findings matrix, and correction log.
- Test the methodology on both disputed and ordinary research findings — including cases ending in F1.
Grounds and references
- DET SOM ERFoundational work for the relations among actuality, knowledge, language, models, systems, and practice.
- Corrigible RealismPhilosophical placement of correspondence and corrigibility.
- Reality AuditMethodological overview and common principles.
- Audit StandardNormative requirements for documented audit.
- Applicable discipline-specific methods, research ethics, reporting standards, and safety requirementsMust be added according to field, project, and jurisdiction; this document does not replace them.
Revision history
- Document version
- 1.0
- First published
- 18 June 2026
First public edition.