10 years from the Reproducibility PI Manifesto, it’s time to Transform to Open Science
Keynote at the ISC Conference, Hamburg, May 31, 2022
Ten years ago, I gave a talk at a workshop in the form of a pledge called the Reproducibility PI Manifesto. It was a public commitment to lead my research group with a consistent policy aiming to improve reproducibility practices. My simple 12-slide presentation on Figshare has more than a thousand downloads, and nearly 10 thousand views, and it sparked many conversations since. Living up to the pledge, and in fact devoting a chunk of my professional pursuits to reproducibility over the years, has led me to the conviction that it’s time to fully transform to open science. In January 2020 there were only about a hundred known cases of COVID-19 outside China, but already the first genome sequence of the SARS-CoV-2 virus had been shared openly with the scientific community. The open science ethos was core to the international response to the pandemic, and accelerated the progress of science immeasurably. It was a paradigm shift in how we conduct science. If the pandemic catalyzed adoption of open science practices, leading to faster results and greater impact, why go back? Recently, NASA committed a five-year multi-million-dollar program called TOPS (Transform to Open Science), and declared 2023 the year of open science. The agency recognized that open source software accelerates science, making us more agile and collaborative. It is committed to open data on the cloud, and to supporting an inclusive open science community over the next decade. We, the computing research community, must be part of the transformation, and examine how we operate in regards to open access, open data, open source, and even open peer review. We can tackle genuine concerns like equity and mitigation of bias with transparency and culture changes, instead of systems based on anonymity (blind reviews). It’s time to transform to open science. I will review the major strides of the last decade on transparency and reproducibility, and the challenges that remain, as well as make the case for open science broadly. I will also talk about the new policies and programs, including NASA’s, to accelerate scientific progress through open science.