AI ART Discover · Learn · Create
W AI Glossary Term • Term 221 of 224
Plain English Definition

What does “Word Embedding” mean?

Core Definition

A dense vector representation of words capturing semantic relationships.

Operational Mechanism

How Word Embedding Works

Word Embedding: king, queen, banana feed into Word embedding space, which produces king and queen close, banana far away.

Real-World Scenario

Practical Example

In a word-embedding model, words used in similar contexts get similar vectors. 'Doctor' ends up near 'nurse' and far from 'banana'. Classic examples such as word2vec showed that directions in the space can capture relationships.

Core Significance

Why It Matters

Word embeddings were an early step toward machines handling meaning numerically. They also pick up biases that appear in text.

Expert Q&A

Common Questions About Word Embedding

Q: Which methods made them popular?

Word2vec and GloVe, around 2013 and 2014.

Q: Word vs contextual embeddings?

A word embedding gives each word one vector. Modern models produce vectors that change with the surrounding context.

Q: Do they carry bias?

Yes. They can reflect stereotypes present in the training text.