Reproducibility Package for "Significance-Classification Instability Beyond p-Value Variability: A Monte Carlo Study of Effect Direction and Effect-Estimate Compatibility"
This repository contains the complete computational reproducibility package for the study “Significance-Classification Instability Beyond p-Value Variability: A Monte Carlo Study of Effect Direction and Effect-Estimate Compatibility.” The study uses Monte Carlo simulation to examine the relationship...
Guardado en:
| Autores principales: | , , , , , , |
|---|---|
| Formato: | Software |
| Lenguaje: | inglés |
| Publicado: |
2026
|
| Materias: | |
| Acceso en línea: | Enlace permanente (DOI o Handle) |
| Etiquetas: |
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1881700523526062080 |
|---|---|
| author | Evergisto Sare Lara Juan Francisco Agreda Vega L. Montoya Jimmy Aurelio Rosales-Huamaní Ángel Cárdenas-García Magaly Tintaya Quispe Jose Percy Tintaya Quispe |
| author_browse | Evergisto Sare Lara Jimmy Aurelio Rosales-Huamaní Jose Percy Tintaya Quispe Juan Francisco Agreda Vega L. Montoya Magaly Tintaya Quispe Ángel Cárdenas-García |
| author_facet | Evergisto Sare Lara Juan Francisco Agreda Vega L. Montoya Jimmy Aurelio Rosales-Huamaní Ángel Cárdenas-García Magaly Tintaya Quispe Jose Percy Tintaya Quispe |
| author_sort | Evergisto Sare Lara |
| collection | Producción científica |
| description | This repository contains the complete computational reproducibility package for the study “Significance-Classification Instability Beyond p-Value Variability: A Monte Carlo Study of Effect Direction and Effect-Estimate Compatibility.” The study uses Monte Carlo simulation to examine the relationship between statistical-significance classification and the stability of effect direction, magnitude, and precision across independent studies generated under the same population mechanism. The reproducibility package includes the R source code, simulation functions, scenario definitions, random-number streams, aggregated simulation results, conditional analyses, tables, figures, metadata, and session information required to reproduce the reported results. The simulation design comprises 509 unique scenarios: 486 factorial scenarios and 25 directed transition-region scenarios, with two overlapping conditions. The factorial scenarios were evaluated using 100,000 paired replications per scenario, while the directed scenarios used 250,000 paired replications. Statistical inference was based on two-sided Welch tests with alpha = 0.05. Random-number generation used the L'Ecuyer-CMRG generator with master seed 20260927. The package also includes a reproducibility verification workflow. Re-execution of the 25 directed scenarios reproduced the original conditional results to machine precision, with a maximum absolute difference of approximately 4.58 × 10^-16. The README file provides the recommended execution order and a description of the repository structure. |
| format | Software |
| id | openalex:W7214579772 |
| institution | UPeU |
| language | English |
| publishDate | 2026 |
| publishDateRange | 2026 |
| publishDateSort | 2026 |
| record_format | dspace |
| spelling | openalex:W7214579772Reproducibility Package for "Significance-Classification Instability Beyond p-Value Variability: A Monte Carlo Study of Effect Direction and Effect-Estimate Compatibility"Evergisto Sare LaraJuan Francisco Agreda VegaL. MontoyaJimmy Aurelio Rosales-HuamaníÁngel Cárdenas-GarcíaMagaly Tintaya QuispeJose Percy Tintaya Quispedirection of effectstatistical significanceMonte Carlo simulationreproducibilityMeta-analysis and systematic reviewsStatistical Methods and Bayesian InferenceSimulation Techniques and ApplicationsThis repository contains the complete computational reproducibility package for the study “Significance-Classification Instability Beyond p-Value Variability: A Monte Carlo Study of Effect Direction and Effect-Estimate Compatibility.” The study uses Monte Carlo simulation to examine the relationship between statistical-significance classification and the stability of effect direction, magnitude, and precision across independent studies generated under the same population mechanism. The reproducibility package includes the R source code, simulation functions, scenario definitions, random-number streams, aggregated simulation results, conditional analyses, tables, figures, metadata, and session information required to reproduce the reported results. The simulation design comprises 509 unique scenarios: 486 factorial scenarios and 25 directed transition-region scenarios, with two overlapping conditions. The factorial scenarios were evaluated using 100,000 paired replications per scenario, while the directed scenarios used 250,000 paired replications. Statistical inference was based on two-sided Welch tests with alpha = 0.05. Random-number generation used the L'Ecuyer-CMRG generator with master seed 20260927. The package also includes a reproducibility verification workflow. Re-execution of the 25 directed scenarios reproduced the original conditional results to machine precision, with a maximum absolute difference of approximately 4.58 × 10^-16. The README file provides the recommended execution order and a description of the repository structure.Softwarehttps://doi.org/10.5281/zenodo.23018292W7214579772enZenodo (CERN European Organization for Nuclear Research)2026-09-28 |
| spellingShingle | direction of effect statistical significance Monte Carlo simulation reproducibility Meta-analysis and systematic reviews Statistical Methods and Bayesian Inference Simulation Techniques and Applications Evergisto Sare Lara Juan Francisco Agreda Vega L. Montoya Jimmy Aurelio Rosales-Huamaní Ángel Cárdenas-García Magaly Tintaya Quispe Jose Percy Tintaya Quispe Reproducibility Package for "Significance-Classification Instability Beyond p-Value Variability: A Monte Carlo Study of Effect Direction and Effect-Estimate Compatibility" |
| title | Reproducibility Package for "Significance-Classification Instability Beyond p-Value Variability: A Monte Carlo Study of Effect Direction and Effect-Estimate Compatibility" |
| title_full | Reproducibility Package for "Significance-Classification Instability Beyond p-Value Variability: A Monte Carlo Study of Effect Direction and Effect-Estimate Compatibility" |
| title_fullStr | Reproducibility Package for "Significance-Classification Instability Beyond p-Value Variability: A Monte Carlo Study of Effect Direction and Effect-Estimate Compatibility" |
| title_full_unstemmed | Reproducibility Package for "Significance-Classification Instability Beyond p-Value Variability: A Monte Carlo Study of Effect Direction and Effect-Estimate Compatibility" |
| title_short | Reproducibility Package for "Significance-Classification Instability Beyond p-Value Variability: A Monte Carlo Study of Effect Direction and Effect-Estimate Compatibility" |
| title_sort | reproducibility package for significance classification instability beyond p value variability a monte carlo study of effect direction and effect estimate compatibility |
| topic | direction of effect statistical significance Monte Carlo simulation reproducibility Meta-analysis and systematic reviews Statistical Methods and Bayesian Inference Simulation Techniques and Applications |
| topic_facet | direction of effect statistical significance Monte Carlo simulation reproducibility Meta-analysis and systematic reviews Statistical Methods and Bayesian Inference Simulation Techniques and Applications |
| url | https://doi.org/10.5281/zenodo.23018292 |
| work_keys_str_mv | AT evergistosarelara reproducibilitypackageforsignificanceclassificationinstabilitybeyondpvaluevariabilityamontecarlostudyofeffectdirectionandeffectestimatecompatibility AT juanfranciscoagredavega reproducibilitypackageforsignificanceclassificationinstabilitybeyondpvaluevariabilityamontecarlostudyofeffectdirectionandeffectestimatecompatibility AT lmontoya reproducibilitypackageforsignificanceclassificationinstabilitybeyondpvaluevariabilityamontecarlostudyofeffectdirectionandeffectestimatecompatibility AT jimmyaureliorosaleshuamani reproducibilitypackageforsignificanceclassificationinstabilitybeyondpvaluevariabilityamontecarlostudyofeffectdirectionandeffectestimatecompatibility AT angelcardenasgarcia reproducibilitypackageforsignificanceclassificationinstabilitybeyondpvaluevariabilityamontecarlostudyofeffectdirectionandeffectestimatecompatibility AT magalytintayaquispe reproducibilitypackageforsignificanceclassificationinstabilitybeyondpvaluevariabilityamontecarlostudyofeffectdirectionandeffectestimatecompatibility AT josepercytintayaquispe reproducibilitypackageforsignificanceclassificationinstabilitybeyondpvaluevariabilityamontecarlostudyofeffectdirectionandeffectestimatecompatibility |