Abstract
This study investigates how user experience (UX) practitioners consider bias in their research by reviewing and analyzing published materials in tandem with ethnographic methods.
Research bias refers to the ways in which the researcher influences the systematic investigation towards a specific outcome away from the objective truth. The subject of research bias is under-discussed in user experience design (UXD) which can be problematic when awareness is key to mitigating the effect of bias. This should be concerning for UX practitioners because user research is a central element of user-centered design.
Preliminary research of recommended texts for UX designers found that when bias is discussed in relation to UXD, it is commonly connected to the cognitive bias of the user. Brief mentions are made about response bias, with little to no mention of the designer or how they impart bias upon their research. To investigate the considerations UX practitioners afford to research bias, eight semi-structured interviews were conducted with participants from four UX teams working in Norway. In addition, autoethnographic journaling was used to record and reflect on personal experiences of design education and UX work.
Through thematic and comparative analysis four cases were developed. The analysis shows common methods used in UXR along with factors that affect research in practice. Some participants were more aware of research bias than others, most were able to identify different types of bias related to research but not clearly articulate the consequences or how to mitigate them. It was therefore concluded that the topic of research bias does not currently receive adequate consideration from the interviewed teams. Finally, activities and tools are recommended to raise awareness and address the potential for bias in user experience research and design.