AI ART Discover · Learn · Create
AI Art > Glossary > Self-Supervised Learning
Browse Full AI Glossary
S AI Glossary Term • Term 188 of 224
Plain English Definition

What does “Self-Supervised Learning” mean?

Core Definition

Learning representations from unlabeled data by predicting masked or transformed parts.

Operational Mechanism

How Self-Supervised Learning Works

1

Unlabeled text: 'The cat sat on the ___'

2

Hide part of the input

3

Model predicts the hidden part

4

Check against the original, learn.

Real-World Scenario

Practical Example

A language model is shown sentences with the next word hidden and learns by guessing it. The text itself supplies the answers, so nobody has to label billions of examples.

Core Significance

Why It Matters

Self-supervision makes use of vast unlabeled data, which is the basis of modern language and many vision models.

Expert Q&A

Common Questions About Self-Supervised Learning

Q: Self-supervised vs unsupervised?

Both avoid human labels. Self-supervised creates its own prediction task from the data, such as filling in missing parts.

Q: Which models use it?

Large language models and many image and audio models are pre-trained this way.

Q: Does it still need labels?

Not for pretraining, though later stages may use labeled examples.