基于SAC动态权重与聚类约束的车联网联邦学习客户端选择方法
Soft Actor-Critic-Based Dynamic Weighting and Clustering-Constrained Client Selection Method for Vehicular Federated Learning
-
摘要: 针对车联网联邦学习场景下,客户端通信条件、计算资源以及数据分布存在显著异构性,导致传统客户端选择方法存在模型收敛速度慢,训练稳定性差以及数据覆盖不足等问题,提出了一种基于Soft Actor-Critic(SAC)动态权重与聚类约束的客户端选择方法。首先,该方法建立了融合客户端通信成本、计算资源与数据分布差异的车联网联邦学习系统模型,用于刻画影响联邦学习训练性能的关键因素,并将客户端选择过程建模为多目标动态优化问题。其次,采用SAC算法,根据当前系统状态动态调节数据质量、低时延与历史贡献等目标的重要性权重,实现了客户端选择策略的自适应优化。同时,为避免客户端选择长期集中于部分相似客户端,引入了聚类约束的客户端选择机制,通过对客户端异构特征进行聚类划分,提高被选客户端集合的数据覆盖能力与选择多样性。最后,在模型聚合方面,采用异步联邦学习更新机制,提高联邦学习训练效率,降低系统等待时延。数值仿真结果表明,本文方法对比随机方法、FedCS方法和HiCS-FL方法,模型收敛速度快,平均准确率最高提升2.93%,数据质量分别提升19.92%、23.06%、36.03%。并在保证较低系统时延的同时,与全局数据分布差异分别降低13.59%、17.86%、21.85%,有效提高客户端数据代表性与整体数据覆盖能力,缓解数据非独立同分布带来的模型震荡问题,提升联邦学习模型在车联网场景下的训练稳定性与泛化性能。Abstract: To address slow model convergence, poor training stability, and insufficient data coverage caused by client heterogeneity in vehicular-to-everything (V2X) federated learning, a dynamic weighting and clustering-constrained client selection method based on the soft actor-critic (SAC) algorithm is proposed. First, a vehicular federated learning system model characterizes key performance factors by integrating communication cost, computational resources, and data distribution heterogeneity, formulating client selection process as a multi-objective dynamic optimization problem. Subsequently, the SAC algorithm dynamically adjusts the importance weights of data quality, low latency, and historical contribution according to the current system state, enabling adaptive client selection strategy optimization. Meanwhile, a clustering-constrained mechanism prevents long-term selection concentration on similar clients. By clustering heterogeneous client features, the proposed method enhances the data coverage and diversity of the selected client set. Finally, an asynchronous aggregation mechanism improves training efficiency and reduces latency. Numerical simulation results demonstrate that, compared with random selection, FedCS, and HiCS-FL methods, the proposed method accelerates convergence, improves average accuracy by up to 2.93%, and increases data quality by 19.92%, 23.06%, and 36.03%, respectively. It also reduces global data distribution discrepancies by 13.59%, 17.86%, and 21.85%, respectively. Consequently, this method enhances client data representativeness, expands overall data coverage, mitigates model oscillation caused by non-IID data distributions, and improves the stability and generalization performance of federated learning models in V2X scenarios.
下载: