Tencent AI Lab 官网
Directional Skip-Gram: Explicitly Distinguishing Left and Right Context forWord Embeddings

In this paper, we present directional skipgram (DSG), a simple but effective enhancement of the skip-gram model. By introducing an additional vector to explicitly distinguish left and right context in word prediction, each word’s embedding is learned by not only word co-occurrence patterns in its context, but also the directions of its contextual words. Compared to other extensions of the skip-gram model,our model has lower complexity and therefore can be trained efficiently. Experimental results show that our model outperforms other models on different datasets in semantic and syntactic evaluations.

NAACL 2018
Publication Time
Yan Song, Shuming Shi, Jing Li, Haisong Zhang