无线信道预测:联邦学习与集中式学习的通信开销
Wireless Channel Prediction: Communication Overhead of Federated Learning and Centralized Training
-
摘要: 通过预测无线信道可以解决高速移动导致的信道过时问题、或利用预测资源分配提升无线系统的资源利用率和用户体验。尽管对机器学习进行离线训练的时间较长,但利用训练后得到的模型进行在线推断时计算复杂度低,有望解决信道预测这类对实时性要求高的无线任务。联邦学习可以充分利用移动设备采集的数据和计算资源,同时保护隐私敏感的用户数据。对于隐私不敏感的无线数据,应用联邦学习的主要动机之一是相对于需上传原始训练数据的集中式学习能降低通信开销。本文考虑平均信道、瞬时信道和未来接入小区这三个预测问题,对经过模型压缩后联邦学习的上行总数据量与集中式学习进行了比较。研究结果表明,对于所考虑的预测任务,即使经过了几千倍的压缩,联邦学习所需的上行数据量也不一定低于集中式学习,这意味着联邦学习的通信效率依然需要大幅度提高。
Abstract: Channel prediction can be leveraged to mitigate the performance loss caused by the outdated channels of mobile users, or improve resource usage efficiency and user experience by predictive resource allocation for wireless systems. Despite that the time consumed for training a machine learning model is usually long, the computational complexity of online inference with a well-trained model is low. Hence, machine learning is expected to be applicable for real-time wireless tasks such as channel prediction. Federated learning can take the advantage of the gathered data and computing resources at mobile devices, meanwhile protecting privacy-sensitive user data. In many privacy-insensitive wireless communication problems, the main motivation for using federated learning is to reduce communication overhead with respect to centralized learning, which needs to upload dataset for training. In this paper, we compare the total amount of data required by federated learning and centralized learning for uploading compressed model parameters or training data to the central processor when predicting average channel gain, instantaneous channel gain and the next cell to associate. Our results show that the amount of uplink data required for federated learning is not always smaller than centralized learning, even after several thousand folds of compression. This suggests that the communication efficient of federated learning still needs to be reduced significantly.