Benchmarking Flaws Undermine Security Research
- Van Der Kouwe, Erik
- Heiser, Gernot
- Andriesse, Dennis
- Bos, Herbert
- Giuffrida, Cristiano
Publication date
May 2020
DOI Publisher
Institute of Electrical and Electronics Engineers (IEEE)Abstract
Benchmarking systems is difficult. Mistakes can compromise guarantees and threaten reproducibility and comparability. We conduct a study to show that benchmarking flaws are widespread in systems security defense papers, even at tier-1 venues. We aim to raise awareness and provide recommendations for safeguarding the scientific process in our community
Add to ORKG