Which Threshold Concepts do Computing Students Encounter while Learning Empirical Research Methods?

Abstract

A strong foundation in empirical research methods is essential for computing students due to the societal impacts of digital technologies. However, learning empirical research is challenging because of a lack of a research-based approach and the absence of an established pedagogical culture for teaching empirical research methods. In this paper, we ask the research question: Which Threshold Concepts (TCs) do computing students encounter while learning empirical research methods? First, we conducted a systematic mapping review of the literature to identify the candidate TCs in learning empirical research methods. Next, we evaluated the candidate TCs in an explanatory case study of an introductory course in research methods offered to master’s students at the Department of Computer Science at the Norwegian University of Science and Technology (NTNU). We found that a particularly challenging and overarching TC may be developing and operationalizing a conceptual framework, and many other TCs can be linked to the conceptual framework. We also found that it can be difficult for computing students to grasp the nature of research and how empirical research is done. These findings may help understand student challenges while learning empirical research methods and developing solutions to address these challenges.