Authors
Daniel Kulesz, Verena Kafer, & Stefan Wagner
Abstract
Spreadsheets are powerful tools which play a business-critical role in many organizations. However, many bad decisions taken due to faulty spreadsheets show that these tools need serious quality assurance.
Furthermore, while collaboration on spreadsheets for maintenance tasks is common, there has been almost no support for ensuring that the spreadsheets remain correct during this process. We believe that spreadsheet users should be supported in putting test rules into their spreadsheets from which subsequent users can profit.
We have developed an approach named Spreadsheet Guardian which separates the specification of spreadsheet test rules from their execution. By automatically executing user-defined test rules, our approach is able to detect semantic faults. It also protects all collaborating spreadsheet users from introducing faults during maintenance, even if only few end-users specify test rules. We implemented Spreadsheet Guardian as an add-in for Microsoft Excel.
We evaluated Spreadsheet Guardian in two empirical evaluations with 29 typical end-users and 42 computer science students. The results indicate that our approach to specifying spreadsheet test rules is easy to learn and to apply.
Furthermore, participants with spreadsheets "protected" by Spreadsheet Guardian recognize more faults during maintenance of complex spreadsheets and are more realistic about the correctness of their spreadsheets than participants who employ only "classic", non-interactive test rules based on static analysis techniques. Hence, we believe Spreadsheet Guardian can be of use for any business-critical spreadsheet.
Sample
We compared the actual correctness of the maintained spreadsheets in relation to the participants' confidence about them being correct.
Many participants of the control groups were very sure about the spreadsheets' correctness while in fact most were wrong. On the other hand, the self-confidence of the participants in the experiment groups was more balanced.
Publication
2017, Journal of Software: Evolution and Process, Volume 30, Number 9
