To solve the problem of holes and noise in lowquality depth maps, a depth maps inpainting algorithm based on fused texture information is proposed. Firstly, the cavity is optimized by morphological operation, and the segmentation of the cavity is completed by a region based segmentation algorithm. Secondly, the extracted cavity region is filled with texture information, and the local structural similarity between the cavity region and the same scene color image is analyzed. Finally, the gray scale image reconstruction algorithm is utilized to fill the edge hole region and smooth the region. Compared with the fast marching algorithm, the adaptive median filtering algorithm and the morphological reconstruction algorithm on the standard dataset Middlebury, the proposed algorithm completes the large area cavity information. While getting better inpainting results, the algorithm maintains the structural integrity and overall smoothness of the image.