3D reconstruction of gastrointestinal regions using shape-from-focus

Abstract

3D shape reconstruction from images is an active topic in computer vision. Shape-from-Focus (SFF) is an important approach which requires image stack in a focus controlled manner to infer the 3D shape. In this article, 3D reconstruction of synthetic gastrointestinal regions is done using SFF. Image stack is generated in Blender software with focus controlled camera. A color focus measure is applied for shape recovery followed by a weighted L2 regularizer to estimate for inaccurate depth values. A precise comparison is done between recovered shape and ground truth data by measuring the depth error and correlation between them. Results shows that SFF technique will be practical for 3D reconstruction of GI regions with focus and motion controlled pillcams which is technologically feasible to implement.