Integration of visual focus into marine operation simulator for behavior observation and analysis

Abstract

This paper presents a framework of visual focus integration into marine operation simulator for behavior observation and analysis. Towards an evaluation of trainees' situation awareness in simulators, the eye tracking device is considered an important facility of understanding trainees' operational proficiency and response capacity to uncertain disturbances. Taking advantages of programmability of Tobii pro glasses 2, the process flow for remote manipulation of the Tobii glasses from creating projects to start/stop recordings is implemented. Meanwhile, taking real-time interaction in the training program into consideration, live video transmission of visual focus is realized by means of multi-threading and pipeline streaming technology. Furthermore, visualization of both statistical data and sensor data according to the recording result of Tobii glasses is achieved, enabling intuitive behavior observation and further behavior analysis. A case study of heavy lifting operation is carried out, from which the integration of the eye tracking system is verified useful for the training of marine operation in simulators.