backpropagation through time (BPTT) is a technique of updating tuned
parameters within recurrent neural networks (RNNs). Several attempts at
creating such an algorithm have been made including: Nth Ordered Approx
Anticipated Reweighted Truncated Backpropagation (ARTBP) allows for variable truncation lengths and compensation factors to provide unbiasedness, as opposed to Truncated Backpropagation Through Time (truncated BPTT), which suffers from biased gradient estimation and unreliable performance on certain tasks.