Multi-View Image Enhancement Inconsistency Decoupling Guided 3D Gaussian Splatting | IEEE Conference Publication | IEEE Xplore

Multi-View Image Enhancement Inconsistency Decoupling Guided 3D Gaussian Splatting


Abstract:

3D Gaussian Splatting (3DGS) has recently made breakthrough progress in radiance field reconstruction but struggles with multi-view inconsistency. Modern cameras often ap...Show More

Abstract:

3D Gaussian Splatting (3DGS) has recently made breakthrough progress in radiance field reconstruction but struggles with multi-view inconsistency. Modern cameras often apply tailored enhancements to each view when capturing multi-view images. While this improves individual image quality, it inevitably disrupts the multi-view consistency assumption, particularly in challenging conditions like nighttime scenes. This disrupts 3DGS’s ability to accurately reconstruct the scene, resulting in the emergence of artifacts such as "floaters". To tackle this challenge, we propose equipping each training view with a 4D bilateral affine grid to decouple the inconsistencies across multi-view images, guiding more accurate 3DGS reconstruction. To solve the problem of less visually appealing renderings caused by the absence of certain enhancements, our 4D bilateral affine grid also serves a dual purpose: it propagates enhanced features from a single edited image throughout the entire 3D scene, allowing for comprehensive 3D editing with just one image. Experiments demonstrate that our method not only effectively decouples inconsistencies in multi-view images, enabling more precise 3DGS reconstruction, but also facilitates refined 3D editing, further improving the visual quality of otherwise monotonous scenes.
Date of Conference: 06-11 April 2025
Date Added to IEEE Xplore: 07 March 2025
ISBN Information:

ISSN Information:

Conference Location: Hyderabad, India

References

References is not available for this document.