For a given research question, there are usually a large variety of possible analysis strategies acceptable according to the scientific standards of the field, and there are concerns that this multiplicity of analysis strategies plays an important role in the non-replicability of research findings. Here, we define a general framework on common sources of uncertainty arising in computational analyses that lead to this multiplicity, and apply this framework within an overview of approaches proposed across disciplines to address the issue. Armed with this framework, and a set of recommendations derived therefrom, researchers will be able to recognize strategies applicable to their field and use them to generate findings more likely to be repli...
The replicability of a research claim is often positioned as an important step in establishing the c...
Replications are often taken to play both epistemic and demarcating roles in science: they provide e...
International audienceMany areas of computer science research (e.g., performance analysis, software ...
For a given research question, there are usually a large variety of possible analysis strategies acc...
For a given research question, there are usually a large variety of possible analysis strategies acc...
Findings from 162 researchers in 73 teams testing the same hypothesis with the same data reveal a un...
Exploratory Factor Analysis (EFA) is a powerful and commonly-used tool for investigating the underly...
The reproducibility of scientific discoveries is a hallmark of scientific research. Although its cen...
This study explores how researchers’ analytical choices affect the reliability of scientific finding...
The replicability of a research claim is often positioned as an important step in establishing the c...
Replications are often taken to play both epistemic and demarcating roles in science: they provide e...
International audienceMany areas of computer science research (e.g., performance analysis, software ...
For a given research question, there are usually a large variety of possible analysis strategies acc...
For a given research question, there are usually a large variety of possible analysis strategies acc...
Findings from 162 researchers in 73 teams testing the same hypothesis with the same data reveal a un...
Exploratory Factor Analysis (EFA) is a powerful and commonly-used tool for investigating the underly...
The reproducibility of scientific discoveries is a hallmark of scientific research. Although its cen...
This study explores how researchers’ analytical choices affect the reliability of scientific finding...
The replicability of a research claim is often positioned as an important step in establishing the c...
Replications are often taken to play both epistemic and demarcating roles in science: they provide e...
International audienceMany areas of computer science research (e.g., performance analysis, software ...