Abstract: This paper focuses on the pedestrian detection in video. With regard to the shortcomings of the traditional integral channel feature algorithm, such as, the error detection of background targets and lost targets, the original detection algorithm is optimized and the template adaptive integral channel feature algorithm is proposed in this paper based on the pedestrian detection algorithm of integral channel feature. This optimized algorithm can effectively detect the lost target and suppress the background interference to improve detection accuracy by applying the preprocessing optimization and adaptive template. The experiment results suggests that the overall performance of the optimized algorithm can be improved, especially in improving the accuracy of detecting lost targets and reduce the error detection of background targets comparing with traditional integral channel feature algorithm.