AI ART Discover · Learn · Create
R AI Glossary Term • Term 173 of 224
Plain English Definition

What does “Red Teaming” mean?

Core Definition

Stress-testing an AI system with adversarial prompts to reveal failures and risks.

Operational Mechanism

How Red Teaming Works

1

Testers attack: tricky and harmful prompts

2

Record failures

3

Developers fix: training, filters, rules

4

Retest

5

back to the start.

Real-World Scenario

Practical Example

Before a model launches, specialists try to coax it into giving dangerous instructions, leaking private data, or showing biased behavior. Each failure is logged and used to improve the system, then the tests are repeated.

Core Significance

Why It Matters

It finds weaknesses before the public does. It cannot prove a system is safe, only show what was found with the effort spent.

Expert Q&A

Common Questions About Red Teaming

Q: Who does red teaming?

Internal teams, external experts, and sometimes open challenges where members of the public try to break a model.

Q: Where does the name come from?

From security and military practice, where a 'red team' plays the adversary to test defenses.

Q: Is it a one-time step?

No. Models and uses change, so testing continues after release.