|Title||Repeatability, reproducibility, and rigor in systems research|
|Publication Type||Conference Paper|
|Year of Publication||2011|
|Authors||Vitek, J, Kalibera T|
|Conference Name||Proceedings of the ninth ACM international conference on Embedded software|
|Conference Location||New York, NY, USA|
|Keywords||repeatability, Reproducibility, scientific method|
Computer systems research spans sub-disciplines that include embedded and real-time systems, compilers, networking, and operating systems. Our contention is that a number of structural factors inhibit quality research and decrease the velocity of science. We highlight some of the factors we have encountered in our work and observed in published papers and propose solutions that, if widely adopted, could both increase the productivity of researchers and the quality of their output.