Usability Evaluation of Windows 8 with Keyboard and Mouse: Challenges Related to Operating System Migration in Large Organizations

Abstract

The purpose of this study has been to evaluate the usability of Windows 8 when using keyboard and mouse. Sub goals have been to uncover the usability problems and to generate recommendations for organizations upgrading to Windows 8.Usability testing according to ISO/IEC 25062:2006 was performed on users that had experience from Windows 7. Tests were performed on both Windows 7 and 8 for comparison purposes. Interviews with administrators involved in the operating system migration process were conducted. The interviews were performed to identify problems with previous migration processes.This study uncovered usability problems in Windows 8. Usability tests performed gave negative results in categories of effectiveness, efficiency and satisfaction for Windows 8. The severity of the usability problems uncovered was high and affected the usability of the system. Problems were caused by fundamental Human Computer Interaction mistakes made by the design and from introducing a new mental model for navigation. Hidden functions proved to be one of the large problems for users when trying to execute their daily tasks.The interviews of the administrators uncovered experiences made from earlier migration processes. The lack of training provided to the employees and the introduction of new IT solutions in an organization resulted in a lower satisfaction score on the yearly employee report. Comparing results from the usability testing with feedback from the interviews have been used to suggest topics for training. The topics for training cover the elements and functions that users struggled with during the usability testing of Windows 8. Other measures for an easier transition when upgrading to a new operating system have been proposed.