This paper explores the use of XGBoost for composite quantile regression.
XGBoost is a highly popular model renowned for its flexibility, efficiency, and
capability to deal with missing data. The optimization uses a second order
approximation of the loss function, complicating the use of loss functions with
a zero or vanishing second derivative. Quantile regression -- a popular
approach to obtain conditional quantiles when point estimates alone are
insufficient -- unfortunately uses such a loss function, the pinball loss.
Existing workarounds are typically inefficient and can result in severe
quantile crossings. In this paper, we present a smooth approximation of the
pinball loss, the arctan pinball loss, that is tailored to the needs of
XGBoost. Specifically, contrary to other smooth approximations, the arctan
pinball loss has a relatively large second derivative, which makes it more
suitable to use in the second order approximation. Using this loss function
enables the simultaneous prediction of multiple quantiles, which is more
efficient and results in far fewer quantile crossings.

本文探讨了 XGBoost 在复合分位数回归中的应用，提出了一种平滑逼近的 arctan pinball 损失函数，其相对较大的二阶导数使其更适合于 XGBoost 的二阶逼近优化方法，可同时预测多个分位数，更高效且减少了分位数交叉问题。