Abstract: In order to improve reconstruction video quality in the case of smoothing compression stream and bandwidth constraint, the rate-distortion properties of compressed video sequence are analyzed and simplified by Weibull Density Distribution. And then the novel rate control algorithm that is frame bit allocation on H.264 compressed video is proposed based on frame control for the buffer fullness and reconstruction video quality. With the simplified rate distortion model, the algorithm is considered on H.264 JM16.1 system platform, which is allocated and adjusted in each frame in GOP, meanwhile the parameters of algorithm and model are updated in each frame. Simulation experiments results show that a 0.3dB average peak signal-to-noise ratio (PSNR) improvement over the JVT-H017 rate control algorithm and we can obtain more smoothly quality video output. The results also show that we can obtain lower actual output rate and more smoothly buffer status that avoid overflow and underflow conditions.