word embedding和contextual embedding

embedding可以描述为Many models of source code are based on learned representation called embedding。

word embedding可以看作为word vector

contextual embedding可以表述为it captures the context, since the hidden states are computed based on the previous hidden states。