Visual Attention Assessment for Expert-in-the-loop Training in a Maritime Operation Simulator

Abstract

Improving the training programs for maritime operations is beneficial to enhance maritime safety in practice. In this paper, we propose a novel approach to the assessment of visual attention in a maritime operation so as to support an expert-in-the-loop training program. Experts' knowledge of maritime operation and experiences in the simulator are incorporated into the training program in three ways. First, through a questionnaire, information about task division, identification of critical operation, and definitions of areas of interest (AOIs) is incorporated as prior knowledge for modeling visual attention. Second, a weight scale factor that emphasizes the high importance of visual focus in critical operations is utilized to generate an operations-dependent attention map. Third, based on an expert's attention map and visual switch between AOIs, a similarity metric is designed as a comprehensive evaluation between saliency and visual transition. A case study of heavy lifting operation is performed by two groups of trainees who have received different briefings about “critical operation”. The assessment result shows the group with more detailed briefing obtains a 6% similarity score higher than the other group, which is consistent with the debriefing result of a superior performance of that group. The proposed approach is thus verified effective in assessing visual attention for the expert-in-the-loop training program.