Abstract:Millimeter wave (mmWave) band, i.e., 30 ~ 300 GHz, supports multi-gigabit communication making it a main component of fifth generation (5G) and future six generation (6G) wireless communications. Wireless gigabit (WiGig) is the standardized 60 GHz mmWave band for WLAN applications. MmWave has intermittent short-range transmissions necessitating the installation of multiple WiGig access points (APs) using antenna beamforming training (BT) to fully cover a target indoor area. WiGig user equipment (UE) should select the best AP among the installed ones maximizing its achievable data rate. Conventionally, UE should exhaustively search the best AP having the highest received power using BT with all available APs, which reduces the attainable throughput in consequence. In this paper, the problem of WiGig AP selection is formulated as a multi-armed bandit (MAB) game, where, the UE is considered as the player aiming to maximize its long-term average throughput, i.e., the reward, through playing over the available APs, i.e., the arms of the bandit. Non-contextual MAB algorithms, namely upper confidence bound (UCB) and Thompson sampling (TS) are adopted to address the formulated problem. Moreover, as standardized WiGig devices are multi-band capable containing 2.4/5 GHz Wi-Fi and 60 GHz mmWave bands, Wi-Fi signal characteristics are used as contexts of the mmWave links to further enhance the WiGig AP selection policy. Thus, contextual MAB (CMAB) algorithms, namely linear UCB (LinUCB) and contextual TS (CTS) are also suggested. Simulation analyses confirm the superior performance of the CMAB algorithms over the non-contextual ones in addition to the conventional approaches accompanied with high convergence rates. For example, at no blockage and using too narrow beams of θ-3dB=10∘\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$${\theta }_{-3{\text{dB}}}={10}^{^\circ }$$\end{document}, the proposed CTS, LinUCB, TS, and UCB schemes obtain 98.7%, 96.8%, 89%, 84% of the optimal performance, while the benchmark schemes obtain 49%, and 1.8%, respectively.

Millimeter-wave Wireless LAN and its Extension toward 5G Heterogeneous Networks

MAC-layer integration of multiple radio bands in indoor millimeter wave networks

Millimeter-Wave Enhanced Local Area Systems: A High-Data-Rate Approach for Future Wireless Networks.

Where, When, and How mmWave is Used in 5G and Beyon

AI-empowered millimeter wave communication and networking

IEEE 802.11ad: directional 60 GHz communication for multi-Gigabit-per-second Wi-Fi [Invited Paper]

Unlicensed Spectrum Sharing with WiGig in Millimeter-wave Cellular Networks in 6G Era

Millimeter Wave Communications for Future Mobile Networks

Millimetre-Wave Backhaul for 5G Networks: Challenges and Solutions.

Millimeter-wave Gbps Broadband Evolution towards 5G: Fixed Access and Backhaul

Cellular Communications over Unlicensed Mmwave Bands with Hybrid Beamforming

Joint User Association and Resource Allocation for Multi-Band Millimeter-Wave Heterogeneous Networks.

Massive MIMO and Millimeter Wave for 5G Wireless HetNet: Potentials and Challenges

Wi-Fi 8: Embracing the Millimeter-Wave Era

Emerging GaN Technologies for Next-Generation Millimeter-Wave Applications

The Role of Millimeter-Wave Technologies in 5G/6G Wireless Communications

Millimeter-Wave Cellular Wireless Networks: Potentials and Challenges

MmWave massive-MIMO-based wireless backhaul for the 5G ultra-dense network

Low-Latency Heterogeneous Networks with Millimeter-Wave Communications

Multi-gigabit Millimeter Wave Wireless Communications for 5G: from Fixed Access to Cellular Networks

WiGig access point selection using non-contextual and contextual multi-armed bandit in indoor environment