Compatibility ranges as a practical alternative to the “significant/non-significant” statistical dichotomy
Science can be defined as a social system built on the concept of critical agreement on evidentiary states. The latter must be achieved through rational thinking, communication, and the so-called ‘scientific method’, which involves a series of procedures aimed at ensuring the replicability of invest...
Saved in:
| Main Author: | |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
European Publishing
2024-06-01
|
| Series: | Public Health and Toxicology |
| Subjects: | |
| Online Access: | https://www.publichealthtoxicology.com/Compatibility-ranges-as-a-practical-alternative-to-the-significant-non-significant,189530,0,2.html |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849389057509949440 |
|---|---|
| author | Alessandro Rovetta |
| author_facet | Alessandro Rovetta |
| author_sort | Alessandro Rovetta |
| collection | DOAJ |
| description | Science can be defined as a social system built on the concept
of critical agreement on evidentiary states. The latter must
be achieved through rational thinking, communication,
and the so-called ‘scientific method’, which involves a
series of procedures aimed at ensuring the replicability of
investigative experiments. In this regard, the dichotomization
of statistical results into ‘significant’ and ‘non-significant’
has led to a long series of replication failures and fostered
the misleading expectation that a mere numerical criterion
can replace analytical reasoning. Especially in fields like
toxicology and public health, such misuse can have serious
consequences. Indeed, no study can prove that a result is
(not) significant since uncertainty is always part of scientific
research. At most, based on the above considerations and a
comprehensive analysis of costs, risks, and benefits, it can be
decided whether a certain phenomenon meets the threshold
of scientific evidence required to undertake concrete actions.
In light of this, the present manuscript proposes and
discusses alternative concepts to statistical dichotomies,
such as ranges of compatibility and effect size. Furthermore,
it emphasizes the necessity to investigate the compatibility of
the experimental data with all the relevant target hypotheses
(not just the null one) and all the background assumptions.
Finally, it proposes a compact framework for a complete
presentation of results, including effect size. In this regard,
the adoption of multiple confidence/compatibility intervals
or surprisal intervals is recommended. |
| format | Article |
| id | doaj-art-6571a345d0bc4d8e9bdc2b206b07bbfc |
| institution | Kabale University |
| issn | 2732-8929 |
| language | English |
| publishDate | 2024-06-01 |
| publisher | European Publishing |
| record_format | Article |
| series | Public Health and Toxicology |
| spelling | doaj-art-6571a345d0bc4d8e9bdc2b206b07bbfc2025-08-20T03:42:05ZengEuropean PublishingPublic Health and Toxicology2732-89292024-06-01421710.18332/pht/189530189530Compatibility ranges as a practical alternative to the “significant/non-significant” statistical dichotomyAlessandro Rovetta0https://orcid.org/0000-0002-4634-279XR&C Research, Research and Disclosure, Bovezzo, ItalyScience can be defined as a social system built on the concept of critical agreement on evidentiary states. The latter must be achieved through rational thinking, communication, and the so-called ‘scientific method’, which involves a series of procedures aimed at ensuring the replicability of investigative experiments. In this regard, the dichotomization of statistical results into ‘significant’ and ‘non-significant’ has led to a long series of replication failures and fostered the misleading expectation that a mere numerical criterion can replace analytical reasoning. Especially in fields like toxicology and public health, such misuse can have serious consequences. Indeed, no study can prove that a result is (not) significant since uncertainty is always part of scientific research. At most, based on the above considerations and a comprehensive analysis of costs, risks, and benefits, it can be decided whether a certain phenomenon meets the threshold of scientific evidence required to undertake concrete actions. In light of this, the present manuscript proposes and discusses alternative concepts to statistical dichotomies, such as ranges of compatibility and effect size. Furthermore, it emphasizes the necessity to investigate the compatibility of the experimental data with all the relevant target hypotheses (not just the null one) and all the background assumptions. Finally, it proposes a compact framework for a complete presentation of results, including effect size. In this regard, the adoption of multiple confidence/compatibility intervals or surprisal intervals is recommended.https://www.publichealthtoxicology.com/Compatibility-ranges-as-a-practical-alternative-to-the-significant-non-significant,189530,0,2.htmlcompatibilityconfidence intervalhypothesis testingmagnitude fallacynullismsurprisal |
| spellingShingle | Alessandro Rovetta Compatibility ranges as a practical alternative to the “significant/non-significant” statistical dichotomy Public Health and Toxicology compatibility confidence interval hypothesis testing magnitude fallacy nullism surprisal |
| title | Compatibility ranges as a practical alternative to the “significant/non-significant” statistical dichotomy |
| title_full | Compatibility ranges as a practical alternative to the “significant/non-significant” statistical dichotomy |
| title_fullStr | Compatibility ranges as a practical alternative to the “significant/non-significant” statistical dichotomy |
| title_full_unstemmed | Compatibility ranges as a practical alternative to the “significant/non-significant” statistical dichotomy |
| title_short | Compatibility ranges as a practical alternative to the “significant/non-significant” statistical dichotomy |
| title_sort | compatibility ranges as a practical alternative to the significant non significant statistical dichotomy |
| topic | compatibility confidence interval hypothesis testing magnitude fallacy nullism surprisal |
| url | https://www.publichealthtoxicology.com/Compatibility-ranges-as-a-practical-alternative-to-the-significant-non-significant,189530,0,2.html |
| work_keys_str_mv | AT alessandrorovetta compatibilityrangesasapracticalalternativetothesignificantnonsignificantstatisticaldichotomy |