A new stereoscopic road network extraction framework based on the decision-level fusion of optical and Synthetic Aperture Radar (SAR) imagery is proposed in this paper. Three steps are included in this framework: 1) road segment extraction and structure optimization through SAR imagery, 2) road segment extraction and stereoscopic information collection through optical imagery, and 3) fusion of the SAR result with the optical image and the stereoscopic information. In this study, our new road network grouping algorithm called road network grouping based on the multi-scale geometric analysis of detector Response is used, with the improved footprint method, and the stereoscopic inversion algorithm. The most important finding of our work lies in the fusion step, by which a stereoscopic road network can be acquired after going through the three aforementioned processes and by fusing the stereoscopic information obtained from optical imagery and road network extracted from SAR imagery. Our algorithm is tested on the real TerraSAR-X and QuickBird data.