References
21 CFR part 11: Electronic records; electronic
signatures. (n.d.). Retrieved November 8, 2026, from https://www.govinfo.gov/app/details/CFR-2025-title21-vol1/CFR-2025-title21-vol1-part11
45 CFR 164.514: Other requirements relating to uses and
disclosures of protected health information. (n.d.). Retrieved
October 11, 2026, from https://www.law.cornell.edu/cfr/text/45/164.514
Allaire, J. J., Teague, C., Scheidegger, C., Xie, Y., & Dervieux, C.
(2024). Quarto: An open-source scientific and technical publishing
system. https://quarto.org/
American Journal of Epidemiology. (n.d.). Author guidelines.
Oxford Academic. Retrieved November 8, 2026, from https://academic.oup.com/aje/pages/General_Instructions
Anaconda Inc. (2023). Anaconda software distribution. https://docs.anaconda.com/
Apptainer Project. (2024). Bind paths and mounts. https://apptainer.org/docs/user/1.3/bind_paths_and_mounts.html
Association for Computing Machinery. (2020). Artifact review and
badging — version 1.1. ACM publications policy. https://www.acm.org/publications/policies/artifact-review-and-badging-current
Baker, M. (2016). 1,500 scientists lift the lid on reproducibility.
Nature, 533(7604), 452–454. https://doi.org/10.1038/533452a
Barker, M., Chue Hong, N. P., Katz, D. S., et
al. (2022). Introducing the FAIR principles for
research software. Scientific Data, 9, 622. https://doi.org/10.1038/s41597-022-01710-x
Begley, C. G., & Ellis, L. M. (2012). Raise standards for
preclinical cancer research. Nature, 483(7391),
531–533. https://doi.org/10.1038/483531a
Biostatistics. (n.d.). Author guidelines. Oxford Academic.
Retrieved November 8, 2026, from https://academic.oup.com/biostatistics/pages/General_Instructions
Blischak, J. D., Carbonetto, P., & Stephens, M. (2019). Creating and
sharing reproducible research code the workflowr way. F1000Research, 8,
1749. https://doi.org/10.12688/f1000research.20843.1
Boettiger, C. (2015). An introduction to docker for reproducible
research. ACM SIGOPS Operating Systems Review, 49(1),
71–79. https://doi.org/10.1145/2723872.2723882
Boettiger, C., & Eddelbuettel, D. (2017). An introduction to
Rocker: Docker containers for R.
The R Journal, 9(2), 527–536. https://doi.org/10.32614/RJ-2017-065
Brinckman, A., Chard, K., Gaffney, N., et
al. (2019). Computing environments for reproducibility: Capturing
the Whole Tale. Future Generation Computer
Systems, 94, 854–867. https://doi.org/10.1016/j.future.2017.12.029
Bryan, J. (2018). Excuse me, do you have a moment to talk about version
control? The American Statistician, 72(1), 20–27. https://doi.org/10.1080/00031305.2017.1399928
Bryan, J., & Hester, J. (2024). What they forgot to teach you
about R: Practice safe paths. https://rstats.wtf/practice-safe-paths.html
Bryan, J., the STAT 545 TAs, & Hester,
J. (n.d.). Happy git and GitHub for the useR. Retrieved November 8, 2026, from https://happygitwithr.com
Buckheit, J. B., & Donoho, D. L. (1995). WaveLab and reproducible
research. In Wavelets and statistics (Vol. 103, pp. 55–81).
Springer. https://doi.org/10.1007/978-1-4612-2544-7_5
Chan, A.-W., Boutron, I., Hopewell, S., Moher, D.,
Schulz, K. F., Collins, G. S., et al. (2025). SPIRIT
2025 statement: Updated guideline for protocols of randomised trials.
BMJ, 389, e081477. https://doi.org/10.1136/bmj-2024-081477
Chan, C., & Schoch, D. (2023). Rang: Reconstructing reproducible
R computational environments. PLOS ONE,
18(6), e0286761. https://doi.org/10.1371/journal.pone.0286761
Claerbout, J. F., & Karrenbach, M. (1992). Electronic documents give
reproducible research a new meaning. SEG Technical Program Expanded
Abstracts 1992, 601–604. https://doi.org/10.1190/1.1822162
Collins, G. S., Moons, K. G. M., Dhiman, P., Riley, R. D., Beam, A. L.,
Van Calster, B., Ghassemi, M., Liu, X., Reitsma, J. B., Smeden, M. van,
Boulesteix, A.-L., Camaradou, J. C., Celi, L. A., Denaxas, S.,
Denniston, A. K., Glocker, B., Golub, R. M., Harvey, H., Heinze, G., …
Moher, D. (2024). TRIPOD+AI statement: Updated guidance for
reporting clinical prediction models that use regression or machine
learning methods. BMJ, 385, e078378. https://doi.org/10.1136/bmj-2023-078378
Development Containers Project. (2022). Development containers
specification. https://containers.dev/
Di Tommaso, P., Chatzou, M., Floden, E. W., Prieto Barja, P., Palumbo,
E., & Notredame, C. (2017). Nextflow enables reproducible
computational workflows. Nature Biotechnology, 35(4),
316–319. https://doi.org/10.1038/nbt.3820
Docker Inc. (2024a). Docker desktop WSL 2 backend on
Windows. https://docs.docker.com/desktop/features/wsl/
Docker Inc. (2024b). Multi-platform builds. https://docs.docker.com/build/building/multi-platform/
Dolstra, E., Jonge, M. de, & Visser, E. (2004). Nix: A
safe and policy-free system for software deployment. Proceedings of
the 18th USENIX Conference on System Administration (LISA ’04),
79–92.
European Commission. (n.d.). European health data space regulation
(EHDS). Retrieved November 8, 2026, from https://health.ec.europa.eu/ehealth-digital-health-and-care/european-health-data-space-regulation-ehds_en
European Medicines Agency, GCP Inspectors Working Group. (2023).
Guideline on computerised systems and electronic data in clinical
trials. https://www.ema.europa.eu/en/documents/regulatory-procedural-guideline/guideline-computerised-systems-electronic-data-clinical-trials_en.pdf
European Parliament and Council of the European Union. (2025).
Regulation (EU) 2025/327 of 11 february 2025 on the
european health data space and amending directive
2011/24/EU and regulation (EU) 2024/2847.
Official Journal of the European Union, L series. https://eur-lex.europa.eu/eli/reg/2025/327/oj/eng
Gentleman, R., & Temple Lang, D. (2007). Statistical analyses and
reproducible research. Journal of Computational and Graphical
Statistics, 16(1), 1–23. https://doi.org/10.1198/106186007X178663
GitHub. (n.d.-a). About large files on GitHub.
GitHub Docs. Retrieved November 8, 2026, from https://docs.github.com/en/repositories/working-with-files/managing-large-files/about-large-files-on-github
GitHub. (n.d.-b). Configuring the retention period for
GitHub actions artifacts and logs in your
organization. GitHub Docs. Retrieved November 8, 2026, from https://docs.github.com/en/organizations/managing-organization-settings/configuring-the-retention-period-for-github-actions-artifacts-and-logs-in-your-organization
GitHub. (n.d.-c). Removing sensitive data from a repository.
GitHub Docs. Retrieved October 11, 2026, from https://docs.github.com/en/authentication/keeping-your-account-and-data-secure/removing-sensitive-data-from-a-repository
GitHub. (n.d.-d). Security hardening for GitHub
actions. GitHub Docs. Retrieved October 12, 2026, from https://docs.github.com/en/actions/security-for-github-actions/security-guides/security-hardening-for-github-actions
GitHub Docs. (2024). About CITATION files. https://docs.github.com/en/repositories/managing-your-repositorys-settings-and-features/customizing-your-repository/about-citation-files
Goodman, S. N., Fanelli, D., & Ioannidis, J. P. A. (2016). What does
research reproducibility mean? Science Translational Medicine,
8(341), 341ps12. https://doi.org/10.1126/scitranslmed.aaf5027
Hopewell, S., Chan, A.-W., Collins, G. S., et
al. (2025). CONSORT 2025 statement: Updated
guideline for reporting randomised trials. PLOS Medicine,
22(4), e1004587. https://doi.org/10.1371/journal.pmed.1004587
International Committee of Medical Journal Editors. (2026). Use of
AI by authors. https://www.icmje.org/recommendations/browse/artificial-intelligence/ai-use-by-authors.html
Ioannidis, J. P. A. (2005). Why most published research findings are
false. PLOS Medicine, 2(8), e124. https://doi.org/10.1371/journal.pmed.0020124
Journal of the American Statistical Association. (n.d.).
JASA reproducibility guide. Retrieved November 8,
2026, from https://jasa-acs.github.io/repro-guide/
Knuth, D. E. (1984). Literate programming. The Computer
Journal, 27(2), 97–111. https://doi.org/10.1093/comjnl/27.2.97
Köster, J., & Rahmann, S. (2012). Snakemake — a scalable
bioinformatics workflow engine. Bioinformatics,
28(19), 2520–2522. https://doi.org/10.1093/bioinformatics/bts480
Kurtzer, G. M., Sochat, V., & Bauer, M. W. (2017). Singularity:
Scientific containers for mobility of compute. PLOS ONE,
12(5), e0177459. https://doi.org/10.1371/journal.pone.0177459
Landau, W. M. (2018). The drake R package: A pipeline
toolkit for reproducibility and high-performance computing. Journal
of Open Source Software, 3(21), 550. https://doi.org/10.21105/joss.00550
Landau, W. M. (2021). The targets R package: A dynamic
make-like function-oriented pipeline toolkit for reproducibility and
high-performance computing. Journal of Open Source Software,
6(57), 2959. https://doi.org/10.21105/joss.02959
Leek, J. T., & Peng, R. D. (2015). Reproducible research can still
be wrong: Adopting a prevention approach. Proceedings of the
National Academy of Sciences, 112(6), 1645–1646. https://doi.org/10.1073/pnas.1421412111
Loo, M. van der. (2020). Tinytest: Lightweight and feature complete
unit testing framework. https://CRAN.R-project.org/package=tinytest
Marwick, B., Boettiger, C., & Mullen, L. (2018). Packaging data
analytical work reproducibly using R (and friends). The
American Statistician, 72(1), 80–88. https://doi.org/10.1080/00031305.2017.1375986
McBain, M. (2023). Capsule: Reproducible project libraries via a
lazy renv. https://github.com/MilesMcBain/capsule
Microsoft. (2024a). Install WSL. https://learn.microsoft.com/en-us/windows/wsl/install
Microsoft. (2024b). Working across file systems. https://learn.microsoft.com/en-us/windows/wsl/filesystems
Morris, T. P., White, I. R., & Crowther, M. J. (2019). Using
simulation studies to evaluate statistical methods. Statistics in
Medicine, 38(11), 2074–2102. https://doi.org/10.1002/sim.8086
National Academies of Sciences, Engineering, and Medicine. (2019).
Reproducibility and replicability in science. The National
Academies Press. https://doi.org/10.17226/25303
National Center for Biotechnology Information. (n.d.). dbGaP: Database of genotypes and phenotypes.
Retrieved October 11, 2026, from https://dbgap.ncbi.nlm.nih.gov/home
National Institutes of Health. (n.d.). Writing a data management and
sharing plan. Retrieved November 8, 2026, from https://grants.nih.gov/policy-and-compliance/policy-topics/sharing-policies/dms/writing-dms-plan
National Institutes of Health. (2020). Final NIH policy
for data management and sharing. https://grants.nih.gov/grants/guide/notice-files/NOT-OD-21-013.html
National Institutes of Health. (2023). The use of generative
artificial intelligence technologies is prohibited for the
NIH peer review process. https://grants.nih.gov/grants/guide/notice-files/NOT-OD-23-149.html
National Institutes of Health. (2025a). Protecting human genomic
data when developing generative artificial intelligence tools and
applications. https://grants.nih.gov/grants/guide/notice-files/NOT-OD-25-081.html
National Institutes of Health. (2025b). Supporting fairness and
originality in NIH research applications. https://grants.nih.gov/grants/guide/notice-files/NOT-OD-25-132.html
National Institutes of Health. (2026a). Accelerated implementation
of data management and sharing plan changes for NIH career
development (K) awards. https://grants.nih.gov/grants/guide/notice-files/NOT-OD-26-120.html
National Institutes of Health. (2026b). Implementation update:
NIH data management and sharing plan requirements. https://grants.nih.gov/grants/guide/notice-files/NOT-OD-26-100.html
National Institutes of Health. (2026c). Principles and best
practices for protecting participant privacy. https://grants.nih.gov/policy-and-compliance/policy-topics/sharing-policies/dms/privacy/best-practices
National Institutes of Health, All of Us Research Program. (n.d.-a).
Data and statistics dissemination policy. All of Us Research
Hub. Retrieved November 8, 2026, from https://www.researchallofus.org/?p=4698
National Institutes of Health, All of Us Research Program. (n.d.-b).
Researcher workbench. All of Us Research Hub. Retrieved
November 8, 2026, from https://www.researchallofus.org/data-tools/workbench/
NHS England RAP Community of Practice. (2024). Levels of
RAP. https://nhsdigital.github.io/rap-community-of-practice/introduction_to_RAP/levels_of_RAP/
Nicholls, A., Bargo, P. R., & Sims, J. (2020). A risk-based
approach for assessing R package accuracy within a
validated infrastructure. R Validation Hub. https://www.pharmar.org/white-paper/
Nüst, D., Boettiger, C., & Marwick, B. (2018). How to read a
research compendium. arXiv Preprint arXiv:1806.09525. https://arxiv.org/abs/1806.09525
Nüst, D., Eddelbuettel, D., Bennett, D., Cannoodt,
R., Clark, D., Daroczi, G., Edmondson, M., Fay, C., Hughes, E., et
al. (2020). The Rockerverse: Packages and
applications for containerisation with R. The R
Journal, 12(1), 437–461. https://doi.org/10.32614/RJ-2020-007
Nüst, D., & Eglen, S. J. (2021). CODECHECK: An open
science initiative for the independent execution of computations
underlying research articles during peer review to improve
reproducibility. F1000Research, 10, 253. https://doi.org/10.12688/f1000research.51738.2
Nüst, D., Sochat, V., Marwick, B., Eglen, S. J., Head, T., Hirst, T.,
& Evans, B. D. (2020). Ten simple rules for writing
Dockerfiles for reproducible data science. PLOS
Computational Biology, 16(11), e1008316. https://doi.org/10.1371/journal.pcbi.1008316
Open Science Collaboration. (2015). Estimating the reproducibility of
psychological science. Science, 349(6251), aac4716. https://doi.org/10.1126/science.aac4716
OpenChain Project. (2025). From heritage to hash: SWHID
becomes a global ISO/IEC standard. https://openchainproject.org/news/2025/04/29/from-heritage-to-hash-swhid-becomes-a-global-iso-iec-standard
OWASP GenAI Security Project. (2025a). LLM01:2025
prompt injection. https://genai.owasp.org/llmrisk/llm01-prompt-injection/
OWASP GenAI Security Project. (2025b). LLM06:2025
excessive agency. https://genai.owasp.org/llmrisk/llm062025-excessive-agency/
Patil, P., Peng, R. D., & Leek, J. T. (2016). A statistical
definition for reproducibility and replicability. bioRxiv,
066803. https://doi.org/10.1101/066803
Peng, R. D. (2011). Reproducible research in computational science.
Science, 334(6060), 1226–1227. https://doi.org/10.1126/science.1213847
Peng, R. D. (2009). Reproducible research and
Biostatistics. Biostatistics, 10(3),
405–408. https://doi.org/10.1093/biostatistics/kxp014
Peng, R. D., Dominici, F., & Zeger, S. L. (2006). Reproducible
epidemiologic research. American Journal of Epidemiology,
163(9), 783–789. https://doi.org/10.1093/aje/kwj093
Posit Software, PBC. (n.d.). Managing execution. Quarto
documentation. Retrieved November 8, 2026, from https://quarto.org/docs/projects/code-execution.html
prefix.dev. (2024). Pixi: A fast
software package manager. https://pixi.sh/
Project Jupyter, Bussonnier, M., Forde, J., Freeman, J., Granger, B.,
Head, T., Holdgraf, C., Kelley, K., Nalvarte, G., Osheroff, A., Pacer,
M., Panda, Y., Perez, F., Ragan-Kelley, B., & Willing, C. (2018).
Binder 2.0 — reproducible, interactive, sharable environments for
science at scale. Proceedings of the 17th Python in Science
Conference (SciPy 2018), 113–120. https://doi.org/10.25080/Majora-4af1f417-011
R Consortium. (2026). Beyond feasibility: Learning from
FDA’s response to WebAssembly and
container-based submissions. https://r-consortium.org/posts/beyond-feasibility-learning-from-fdas-response-to-webassembly-and-container-based-submissions/
R Core Team. (2019). R: A language and environment for statistical
computing. R Foundation for Statistical Computing. https://www.R-project.org/
R Core Team. (2020). R: A language and environment for statistical
computing. R Foundation for Statistical Computing. https://www.R-project.org/
Ram, K. (2013). Git can facilitate greater reproducibility and increased
transparency in science. Source Code for Biology and Medicine,
8(1), 7. https://doi.org/10.1186/1751-0473-8-7
Rodrigues, B., & Baumann, P. (2024). Rix: Reproducible data
science environments with Nix. https://docs.ropensci.org/rix/
Saju, L. et al. (2025). Computational
reproducibility of R code supplements on OSF.
arXiv Preprint arXiv:2505.21590. https://arxiv.org/abs/2505.21590
Sandve, G. K., Nekrutenko, A., Taylor, J., & Hovig, E. (2013). Ten
simple rules for reproducible computational research. PLOS
Computational Biology, 9(10), e1003285. https://doi.org/10.1371/journal.pcbi.1003285
SATRE Community. (2026). Standard architecture for trusted research
environments (SATRE), release 2.0.1. https://satre-specification.readthedocs.io/en/stable/
Simonsohn, U. (2026). Groundhog: Version-control for
CRAN, GitHub, and GitLab
packages. https://groundhogr.com/
Software Carpentry. (2024). The Unix shell. The
Carpentries. https://swcarpentry.github.io/shell-novice/
Software Heritage. (2024). swh-model:
Persistent identifiers (SWHID). https://raw.githubusercontent.com/SoftwareHeritage/swh-model/master/README.rst
Stodden, V., Seiler, J., & Ma, Z. (2018). An empirical analysis of
journal policy effectiveness for computational reproducibility.
Proceedings of the National Academy of Sciences,
115(11), 2584–2589. https://doi.org/10.1073/pnas.1708290115
team, rgtlab curriculum. (2026).
Zzcollab: A flexible extension of rrtools for reproducible,
collaborative research compendia in R [Unpublished
manuscript].
The Turing Way Community. (2022). The Turing
Way: A handbook for reproducible, ethical and collaborative
research. Zenodo. https://doi.org/10.5281/zenodo.3233853
Trisovic, A., Lau, M. K., Pasquier, T., & Crosas, M. (2022). A
large-scale study on research code quality and execution. Scientific
Data, 9(1), 60. https://doi.org/10.1038/s41597-022-01143-6
UK Data Service. (n.d.). What is the five safes framework?
Retrieved November 8, 2026, from https://ukdataservice.ac.uk/help/secure-lab/what-is-the-five-safes-framework/
U.S. Food and Drug Administration. (2002). General principles of
software validation; final guidance for industry and FDA
staff. https://www.fda.gov/regulatory-information/search-fda-guidance-documents/general-principles-software-validation
U.S. Food and Drug Administration. (2003). Guidance for industry.
Part 11, electronic records; electronic signatures scope
and application. https://www.fda.gov/regulatory-information/search-fda-guidance-documents/part-11-electronic-records-electronic-signatures-scope-and-application
U.S. Food and Drug Administration, Center for Drug Evaluation and
Research, Office of Biostatistics. (2026). Statistical review and
evaluation: R pilot 4 submission (BLA
111111). Review of the R Consortium R Submissions Working Group’s
Pilot 4. https://github.com/RConsortium/submissions-wg/blob/main/_Documents/Summary_R_Pilot4_Submission.pdf
Ushey, K., & Wickham, H. (2026). Renv: Project
environments. https://CRAN.R-project.org/package=renv
Vandewalle, P., Kovacevic, J., & Vetterli, M. (2009). Reproducible
research in signal processing. IEEE Signal Processing Magazine,
26(3), 37–47. https://doi.org/10.1109/MSP.2009.932122
Vilhuber, L., Connolly, M., Koren, M., Llull, J., & Morrow, P.
(2022). A template README for social science
replication packages (Version v1.1). Zenodo. https://doi.org/10.5281/zenodo.7293838
Wickham, H. (2015). R packages: Organize, test, document, and share
your code. O’Reilly Media.
Wickham, H., & Bryan, J. (2023). R packages: Organize, test,
document, and share your code (2nd ed.). O’Reilly Media. https://r-pkgs.org
Wilkinson, M. D., Dumontier, M., Aalbersberg, Ij.
J., Appleton, G., et al. (2016). The FAIR guiding
principles for scientific data management and stewardship.
Scientific Data, 3, 160018. https://doi.org/10.1038/sdata.2016.18
Wilson, G., Aruliah, D. A., Brown, C. T., Chue Hong, N. P., Davis, M.,
Guy, R. T., Haddock, S. H. D., Huff, K. D., Mitchell, I. M., Plumbley,
M. D., Waugh, B., White, E. P., & Wilson, P. (2014). Best practices
for scientific computing. PLOS Biology, 12(1),
e1001745. https://doi.org/10.1371/journal.pbio.1001745
Wilson, G., Bryan, J., Cranston, K., Kitzes, J., Nederbragt, L., &
Teal, T. K. (2017). Good enough practices in scientific computing.
PLOS Computational Biology, 13(6), e1005510. https://doi.org/10.1371/journal.pcbi.1005510
Xie, Y. (2011). Cache: Examples for the cache feature. knitr
documentation. https://yihui.org/knitr/demo/cache/
Xie, Y. (2015). Dynamic documents with R and knitr
(2nd ed.). Chapman; Hall/CRC.
Xie, Y., Allaire, J. J., & Grolemund, G. (2018). R markdown: The
definitive guide. Chapman; Hall/CRC. https://bookdown.org/yihui/rmarkdown/