Abstract: Millimeter wave massive multiple input multiple output (MIMO) technology is one of the key technologies of the fifth-generation of mobile communication. It can serve multiple users at the same time, greatly improve the system throughput. However, it will face many security threats and be vulnerable to attacks because of the high-speed data transmission, Existing schemes usually use encryption algorithms to encrypt information to ensure the security. Its security is based on the computational complexity of the algorithms and it cannot detect eavesdropping. Quantum key distribution is based on the basic principle of quantum mechanics, which makes the two sides of communication generate and share a random key. Once a third party tries to eavesdrop, the two sides of communication will notice, so it has higher security. In this paper, a secure transmission scheme is proposed to integrate quantum key distribution into millimeter wave massive MIMO system. The method of angle estimation is used to generate a reference sequence as the basis for quantum key distribution to select quantum bases. It not only uses the characteristics of quantum states to ensure the security of system, but also uses the angle information of signal in wireless communication system to improve the efficiency of key generation. The experimental results show that the scheme proposed in this paper cannot only guarantee the security of the system, but also improve the efficiency of key generation.