Language evolves over time in many ways relevant to natural language
processing tasks. For example, recent occurrences of tokens 'BERT' and 'ELMO'
in publications refer to neural network architectures rather than persons. This
type of temporal signal is typically overlooked, but is imp