skip to content
nlp · 2 posts

Why Do Transformers Divide Attention Scores by √d?

nlp ·transformers ·mathematics

Word2Vec, Negative Sampling, and the Geometry of Meaning

nlp ·embeddings ·deep-learning