Efficient data transfers over high-speed, long-distance shared networks
require proper utilization of available network bandwidth. Using parallel TCP
streams enables an application to utilize network parallelism and can improve
transfer throughput; however, finding the optimum number of parallel TCP
streams is challenging due to nondeterministic background traffic sharing the
same network. Additionally, the non-stationary, multi-objectiveness, and
partially-observable nature of network signals in the host systems add extra
complexity in finding the current network condition. In this work, we present a
novel approach to finding the optimum number of parallel TCP streams using deep
reinforcement learning (RL). We devise a learning-based algorithm capable of
generalizing different network conditions and utilizing the available network
bandwidth intelligently. Contrary to rule-based heuristics that do not
generalize well in unknown network scenarios, our RL-based solution can
dynamically discover and adapt the parallel TCP stream numbers to maximize the
network bandwidth utilization without congesting the network and ensure
fairness among contending transfers. We extensively evaluated our RL-based
algorithm's performance, comparing it with several state-of-the-art online
optimization algorithms. The results show that our RL-based algorithm can find
near-optimal solutions 40% faster while achieving up to 15% higher throughput.
We also show that, unlike a greedy algorithm, our devised RL-based algorithm
can avoid network congestion and fairly share the available network resources
among contending transfers.

本文提出了一种利用深度强化学习的方法来寻找最适宜的并行 TCP 流数量，以使网络带宽得到合理利用，并确保在争用传输之间的公平性。与规则和贪心算法相比，我们的 RL 算法可以在未知网络情况下动态发现和使并行 TCP 流适应不同的网络环境。研究证明，我们的算法可以更快地找到接近最优的解决方案，同时提高达 15% 的吞吐量，并避免网络拥塞和资源浪费。