基于语义通信的低比特率图像语义编码方法
A Low Bitrates Image Semantic Coding Method Based on Semantic Communication
-
摘要: 近年来森林火灾给环境与人类带来巨大的损失,传统基于卫星、无人机技术的探测手段效率低且成本高,而布置在山区等偏远地区的大规模传感器网络因性能受限,难以负载大数据量业务,尤其是图片等可以清楚提供现场周围环境变化的有效信息。针对以上问题,本文将基于深度学习与语义通信技术,提出一种图像语义编码方法,对火灾中传感器拍摄到的图片所包含的语义进行提取、编码、传输,在接收端利用对抗生成网络完成从语义到图片的重建,进而实现比传统图像压缩编码方法更加稳定且具有更高压缩比率,从而减轻了传感器网络的负载,其中,为了避免对复杂无线信道的学习,该方法采用成熟的LDPC码进行信道编码,以保证语义传输的可靠性。仿真结果表明,该方法能够实现比传统BPG图片压缩方法具有更低的压缩比特率和更高的清晰度。Abstract: Wildfire has caused heavy damage to the environment and human in recent years. However, commonly used detection methods are based on the satellites or UAVs, which was inefficient and high-cost. Massive sensor network settled in remote area can not afford the big data transmission because of the limited capability, especially images transmission, which can provide useful and clear information about the change of surrounding during the disaster. To solve the above question, this paper proposed a GAN(Generative Adversarial Networks) based framework for image compression using deep learn and semantic communication, by extracting the semantic information of the captured photos and transmitting the semantic label. The generator of GAN reconstructed the corresponding image based on the received semantic information. To avoid learning the complex physical channel feature, channel coding took the convention solution like LDPC code in our method. The experimental results show that the proposed method achieves lower bitrate and less distortion than BPG, the state of the art coding format in traditional image compression.