Heuristic Walkthroughs: Finding the Problems Without the Noise

Abstract Inspection-based evaluation techniques are popular because they require less formal training, are quick, can be used throughout the development process, do not require test users, and can result in finding numerous usability problems. A new technique is described that combines the benefits of heuristic evaluations, cognitive walkthroughs, and usability walkthroughs. This technique, a heuristic walkthrough, provide more structure than heuristic evaluations but less than cognitive walkthroughs. The result is an effective task-oriented evaluation technique that is easy to learn and apply. Methods are proposed for comparing the validity, thoroughness, and reliability of evaluation techniques. Finally, heuristic walkthroughs are compared to heuristic evaluations and cognitive walkthroughs in a controlled study. The results indicate that heuristic walkthroughs are more thorough than cognitive walkthroughs and more valid than heuristic evaluations. In other words, heuristic walkthroughs resulted in finding more problems than cognitive walkthroughs and fewer false positives than heuristic evaluations.