Abstract: In this paper, firstly the advantages and disadvantages and flow block diagram of the OFDM and single carrier frequency domain equalization(SC-FDE) modes in IEEE 802.11aj protocol the millimeter-wave WLAN system were analyzed, and then we proposed a IEEE 802.11aj SC millimeter wave ultra-high speed WLAN prototype design scheme, which implemented based on the NI-PXIe millimeter wave platform using LabVIEW language. The system based on IEEE 802.11aj base-band processing included scrambling and descrambling, channel coding and decoding, constellation mapping and demapping, Fast Fourier Transform(FFT) and IFFT, synchronization, channel estimation and equalization, phase compensation and other modules. Among those modules synchronization and equalization were introduced in detail. The equalization module adopted the method of fractional-space frequency domain equalization to improve the system performance effectively. WDP (Wide Data Path) data structure was used in base-band data processing for parallel processing, effectively reducing the requirement of FPGA clock rate. The system supports a variety of modulation methods. Testing results showed that the prototype had good feasibility and applicability, which could achieve well collected of data constellation point, low bit error rate, high real-time transmission rate, as well as supporting the high-definition video stable and real-time transmission.