Abstract: The quality of the virtual viewpoint determines the effect of the 3D video on the display terminal. To fill the holes generated in the depth image-based rendering algorithm, we propose the dual texture + dual depth multi-view rendering algorithm in this paper. The left reference texture image and its corresponding depth image are used to render the virtual image by applying DIBR technology, and to draw the mask image from the filtered virtual image. Then each point coordinate of large holes in the mask image is inversely transformed to the corresponding pixel coordinate in the right reference texture image to get the hole-filling image of the virtual image based on the judgment of whether the depth value of the pixel belongs to the background. Finally, fuse the hole-filling image with the virtual image obtained through DIBR from the left view to fill the large holes, and fill the small holes by using the interpolation algorithm. Experiments show that our method can effectively inpaint the big holes due to DIBR, so that virtual images with good quality can be got.