Although the fully-connected attention-based model transformer has achieved great successes on many nlp tasks, it has heavy structure and usually requires large training data. In this paper, we present the Star-<