Neural Machine Translation With GRU-Gated Attention Model.
Zhang Biao, Xiong Deyi, Xie Jun, +1 more·IEEE transactions on neural networks and learning systems
Neural machine translation (NMT) heavily relies on context vectors generated by an attention network to predict target words. In practice, we observe that the context vectors for different target words are quite similar to one another and translations with such nondiscriminatory context vectors tend to be degenerative.…