Tensor decomposition for painting analysis. Part 1: pigment characterization

Abstract

Photo-sensitive materials tend to change with exposure to light. Often, this change is visible when it affects the reflectance of the material in the visible range of the electromagnetic spectrum. In order to understand the photo-degradation mechanisms and their impact on fugitive materials, high-end scientific analysis is required. In a two-part article, we present a multi-modal approach to model fading effects in the spectral, temporal (first part) and spatial dimensions (second part). Specifically, we collect data from the same artwork, namely “A Japanese Lantern” by Norwegian artist, Oda Krohg, with two techniques, point-based microfading spectroscopy and hyperspectral imaging. In this first part, we focus on characterizing the pigments in the painting based on their spectral and fading characteristics. To begin with, using microfading data of a region in the painting, we analyze the color deterioration of the measured points. Then, we train a tensor decomposition model to reduce the measured materials to a spectral basis of unmixed pigments and, at the same time, to recover the fading rate of these endmembers (i.e. pure, unmixed chemical signals). Afterwards, we apply linear regression to predict the fading rate in the future. We validate the quality of these predictions by spectrally comparing them with temporal observations not included in the training part. Furthermore, we statistically assess the goodness of our model in explaining new data, collected from another region of the painting. Finally, we propose a visual way to explore the artist’s palette, where potential matches between endmembers and reference spectral libraries can be evaluated based on three metrics at once.