Abstract: Multi-view video brought lively and vivid picture scope, but also needed huge amount of data. Aimed at the issue of large amount of calculation of the mode selection technology in Joint Multi-view Video Coding model(JMVC), through the analysis and research on the correlation among the macro-block modes, such as the mode of current macro-block , the mode of encoded adjacent macro block and the mode of reference frame in the corresponding position, according to the connection between the macro-block modes, the optimized macro-block mode selection algorithm is proposed, which can effectively reduce segmentation and searching to small pieces. Experimental results show that under the premise of the reconstruction of video quality and bit-rate overhead basically remain unchanged; the improved algorithm had better performance. Compared with the original algorithm in JMVC, the improved algorithm can reduce the average encoding time by 67% to all test sequence, and especially can reduce the encoding time by 73% to gentle motion video sequence.