Using photo-consistency to register 2D optical images of the humanface to a 3D surface model
Clarkson, M.J.; Rueckert, D.; Hill, D.L.G.; Hawkes, D.J.
Pattern Analysis and Machine Intelligence, IEEE Transactions on
Volume 23, Issue 11, Nov 2001 Page(s):1266 - 1280
Digital Object Identifier 10.1109/34.969117
Summary:The authors propose a novel method to register two or more optical
images to a 3D surface model. The potential applications of such a
registration method could be in medicine for example, in image guided
interventions, surveillance and identification, industrial inspection,
or telemanipulation in remote or hostile environments. Registration is
performed by optimizing a similarity measure with respect to the
transformation parameters. We propose a novel similarity measure based
on "photo-consistency." For each surface point, the similarity measure
computes how consistent the corresponding optical image information in
each view is with a lighting model. The relative pose of the optical
images must be known. We validate the system using data from an
optical-based surface reconstruction system and surfaces derived from
magnetic resonance (MR) images of the human face. We test the accuracy
and robustness of the system with respect to the number of video images,
video image noise, errors in surface location and area, and complexity
of the matched surfaces. We demonstrate the algorithm working on 10
further optical-based reconstructions of the human head and skin
surfaces derived from MR images of the heads of five volunteers.
Matching four optical images to a surface model produced a 3D error of
between 1.45 and 1.59 mm, at a success rate of 100 percent, where the
initial misregistration was up to 16 mm or degrees from the registration
position
View citation and abstract |
Cart
