Abstract: Since there are the low-efficiency preservation of the layering and details of the original fabric image, and the high-complexity algorithm in the traditional fabric image color transfer method, an improved fabric image color transfer method with significant color extraction is proposed in this paper. By employing the significant color extraction, more representative main colors and segmentation regions of the original fabric image are obtained to make the layering of the resulting image more faithful to the original fabric image. In addition, image details of the resulting image are better preserved by using the image decomposition and anti-overflow color transfer strategy. The simulation results show that, compared with the traditional fabric image color transfer method, the newly proposed method can not only effectively maintain the layering and details of the original fabric image, but also significantly improve the operation efficiency. The newly proposed method is simple and efficient, and can be better applied to the color design work of fabric images.