Introducing fNIRS to multimodal in-situ experiments in design research

Abstract

This PhD dissertation introduces fNIRS to multimodal, in-situ experiments in design research. Design serves physical, intellectual, and emotional human needs. Design solves problems. Through design and development of products, technology, interactions, experiences, etc., the design field responds to new challenges—for a better world and the people in it. In pursuit of improving the outcome of designing, design research develops scientific knowledge about design—and how to improve it—by increasing our understanding of designers' processes and tools, and users' experience or interaction with designed artifacts. Experiments are foundational for generating scientific knowledge and impactful guidance of design. Physiological sensors and neuroimaging enable better experimental studies of design’s impact on the human experience, by accounting for individual variation and human unpredictability, while providing objective information of human cognition. Triangulation of multiple sensor- and neuroimaging modalities is beneficial as it reduces bias and error, while increasing rigor and validity of results. Further, experiments conducted in the real world, i.e., in-situ, establish how humans design and appropriate designed artifacts in their intended contexts, avoiding experimental biases common in constrained laboratory environments, ultimately evidencing more generalizable results. Therefore, in our design research, we are working towards conducting in-situ multimodal experiments. Electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) are historically the most frequently used neuroimaging modalities in design. However, they cannot be used in-situ, as both are extremely prone to motion artifacts. Functional nearinfrared spectroscopy (fNIRS) is in comparison relatively robust to motion, while offering a good tradeoff between spatial- and temporal resolution. Thus, fNIRS opens a venue of research opportunities. fNIRS allow in-situ investigation of high-performing, established design teams working in industry/companies, their design processes, and team dynamics. We could evaluate different interface designs of e.g., a shore control center for remote ship operation, based on users’ cognitive load. fNIRS could quantify the effects of architecture on humans’ cognitive state and well-being. Therefore, this dissertation aims to introduce fNIRS to multimodal experiments in design. Thereby, enabling multimodal in-situ experiments, advancing our scientific knowledge of design, to ultimately improve design, i.e., better responding to human needs. First, we provide a foundation for multimodal experimental design research conducted insitu. Thereafter, we introduce fNIRS, its theoretical and technical principles, design and analysis of experiments, fNIRS applied in-situ, and in design research. Lastly, we discuss current limitations, implications, and recommendations for future research.