Abstract: View synthesis framework based on cylindrical panoramic images is proposed, and image rectification and interpolation of cylindrical panoramic images are mainly investigated. Advantage of epiline sampling in rectification of cylindrical image is analyzed, and reference images are sampled efficiently and sufficiently by calculating the startend position, number, range of epiline. The approach of epiline sampling on cylindrical images is adopted in order to reduce image deformation, object distortion and resolution losing due to perspective transformation in some other algorithms. For novel view interpolation, according to the imaging model of cylindrical panoramic images, position and color calculation of pixels on novel view is formulated. Results of our approach applied to both synthetic and real scene are given at the end of this paper.