Stock trend analysis has been an influential time-series prediction topic due
to its lucrative and inherently chaotic nature. Many models looking to
accurately predict the trend of stocks have been based on Recurrent Neural
Networks (RNNs). However, due to the limitations of RNNs, such as gradient
vanish and long-term dependencies being lost as sequence length increases, in
this paper we develop a Transformer based model that uses technical stock data
and sentiment analysis to conduct accurate stock trend prediction over long
time windows. This paper also introduces a novel dataset containing daily
technical stock data and top news headline data spanning almost three years.
Stock prediction based solely on technical data can suffer from lag caused by
the inability of stock indicators to effectively factor in breaking market
news. The use of sentiment analysis on top headlines can help account for
unforeseen shifts in market conditions caused by news coverage. We measure the
performance of our model against RNNs over sequence lengths spanning 5 business
days to 30 business days to mimic different length trading strategies. This
reveals an improvement in directional accuracy over RNNs as sequence length is
increased, with the largest improvement being close to 18.63% at 30 business
days.

本文利用 Transformers 模型和情感分析结合了技术股票数据和头条新闻数据，以准确预测股票趋势。与 RNN 相比，我们的模型在预测时间窗口为 30 个工作日的情况下将方向准确性提高了近 18.63％。