AI ART Discover · Learn · Create
C AI Glossary Term • Term 39 of 224
Plain English Definition

What does “Compute” mean?

Core Definition

The processing resources required to train and run models, often measured in FLOPS or GPU hours.

Operational Mechanism

How Compute Works

Compute: Model size, Amount of data, Training steps feed into Compute: chips x time, which produces Training cost, Capability gains.

Real-World Scenario

Practical Example

Training a large language model can occupy thousands of GPUs for weeks, while answering one question takes a tiny fraction of that effort. Providers pay for both, and the totals show up in their hardware and electricity bills.

Core Significance

Why It Matters

Compute is a main limit on what AI labs can build and who can afford to build it. It also drives energy use and costs that end up in product pricing.

Expert Q&A

Common Questions About Compute

Q: How is compute measured?

Often in FLOPs (floating-point operations) for total work, or in GPU hours for rented time on hardware.

Q: Why does compute matter for AI progress?

Research on scaling laws found that, within limits, performance tends to improve as compute, data, and model size grow together.

Q: Is compute only needed for training?

No. Running a trained model, called inference, also needs compute, and for popular products it can add up to more than training.