Abstract:Multipath TCP (MPTCP) has been standardized by the IETF as an extension of conventional TCP and it allows the system to utilize multiple paths simultaneously, which can aggregate bandwidth to improve network throughput. However, MPTCP needs to open multiple interfaces at the same time, which makes MPTCP consume more energy to maintain multiple interface connections. Thus, how to manage subflows with the MPTCP's scheduling system to determine which paths should be used for data transmission is of critical importance to reduce energy consumption and ensure network throughput. Due to the path heterogeneity and random packet losses in wireless networks, existing scheduling systems, and selecting paths based on the path's delay or energy cost, may suffer from performance degradation. In this article, we propose a reinforcement learning-based multipath scheduler called MPTCP-RL to determine the optimal path set for different flows. MPTCP-RL adopts deep reinforcement learning as well as MPTCP transmission model to manage path usage among multiple connections to make sure that the sender can adaptively select the optimal path set for a certain application according to the current network environment. MPTCP-RL is an asynchronous reinforcement learning framework, which separates the processes of offline training and online decision to ensure that the learning process will not introduce extra delay and overhead on the decision making process in MPTCP path management. The extensive experimental results show that MPTCP-RL can improve the aggregate throughput and reduce energy consumption significantly compared to the state-of-the-art mechanisms in a variety of network scenarios.

Energy Efficient Based Splitting for MPTCP in Heterogeneous Networks.

A Dynamic Packet Scheduling Method for Multipath TCP in Heterogeneous Wireless Networks

Inter-cell Interference Coordination Via Multi-Layer Rate Splitting Scheme in Heterogeneous Networks.

Application of Rate Splitting Transmission Scheme for LTE-Advanced Systems

Multi-layer rate splitting scheme for interference mitigation in tri-sectored wireless networks

Energy Efficient Congestion Control for Multipath TCP in Heterogeneous Networks.

A Mutual-Information Based Power Allocation Algorithm for Multi-Layer Rate Splitting Scheme in Tri-Sectored Wireless Networks

Survey of MPTCP-Based Multipath Transmission Optimization

Energy Efficiency Model of Parallel Transmission in Heterogeneous Networks

QoE-driven energy-aware multipath content delivery approach for MPT CP-based mobile phones

Can MPTCP Increase System Efficiency and Fairness in 802.11 Multirate WLAN Environment?

Energy Efficient Semantic Communication over Wireless Networks with Rate Splitting

Power-Efficient Transmission for User-Centric Networks with Limited Fronthaul Capacity and Computation Resource

Adaptive subflow allocation for multipath data transmission in mobile edge networks

STMS: Improving MPTCP Throughput under Heterogeneous Networks.

Modeling Multi-Path Tcp Throughput With Coupled Congestion Control And Flow Control

wCompound: Enhancing Performance of Multipath Transmission in High-speed and Long Distance Networks

BBR-Based Congestion Control and Packet Scheduling for Bottleneck Fairness Considered Multipath TCP in Heterogeneous Wireless Networks

Utility-Based Optimal Multi-Flow Rate Allocation for Concurrent Multipath Transport among Cooperative Terminals

Multipath TCP Meets Reinforcement Learning: A Novel Energy-Efficient Scheduling Approach in Heterogeneous Wireless Networks

ADPSM: An Adaptive Delay-based Packet Splitting Mechanism for Concurrent Multipath Transfer over heterogeneous paths