Dear Participant,
Welcome to the experiment on code review efficiency! In this experiment, you will review three code changes in Java and look for defects in the code.
With this experiment:
- we compare the performance of code review under different circumstances
- your data will only be stored and used in anonymized form
The commits to review are based on a Java project, so basic Java skills are needed.
Basic instructions:
- Stay focused on the experiment until it ends, otherwise we won't be able to use your data (if you have to interrupt the experiment for unexpected reasons during the reviews, please use the "pause" button that will appear in the upper right corner during the review tasks).
- Do not share information about this experiment; the reliability of this experiment depends on the participants not knowing its content
beforehand.
- Do not restart once you started reviewing.
- Set your browser to full-screen mode now. Often this can be done by pressing F11.
Data handling policy
In the experiment, we ask you some demographic data such as your level of education, gender,
and your experience as a developer; we will not ask any further sensitive information.
Please do not share personal and/or sensitive information in the open questions you will find in the survey.
Your answers are anonymized to the best of our capabilities, moreover the IP address from which you complete the survey is not saved.
Your anonymized data will be analyzed in the current study and shared in a publicly available research dataset.
This will allow other researchers and the public to benefit from your answers and effort.
The data of this experiment are stored internally on a server at the University of Zurich and are protected by strict Swiss privacy laws.
All the data are used for research purposes only; the data will not be sold to third parties.
At the end of the experiment you will receive a unique identifier that you can use to check your results once they will be published online in an anonymised dataset. This ID will be used in case you want us to remove your answer from the dataset, whether you completed the experiment or not. Please, do not share this ID with anyone besides people responsible for the study (Enrico Fregnan, fregnan@ifi.uzh.ch, Pavlína Wurzel Gonçalves, p.goncalves@ifi.uzh.ch, and Alberto Bacchelli bacchelli@ifi.uzh.ch). Email us with your ID if you decide to delete your data. In this case, we will not check your answers under any circumstances
By pressing "Start", you agree with our data handling policy.
Thank you and we really hope you enjoy participating in our study!
Please contact fregnan@ifi.uzh.ch in case you encounter any problems with the experiment.