Saturday, September 15, 2007

On The Repeatability of Experiments

As someone with an experimental background, I have found this initiative by the organizers of PODS/SIGMOD quite interesting.

In their page about guidelines for research papers, the program committee not only present the format guideline, but also a set of steps to help the committee to assess the "repeatability level" of an experimental research.

From their page:

we attempt to establish that the code developed by the
authors exists, runs correctly on well-defined inputs,
and performs in a manner compatible with that presented
in the paper.