What does “Inference Endpoint” mean?
A deployed API interface that receives model requests and returns predictions in production.
How Inference Endpoint Works
Your app
HTTPS request to the endpoint URL
Hosted model runs
JSON response.
Practical Example
A developer deploys a model and receives a URL. The mobile app sends text to that URL and receives the model's prediction back, without the app itself containing the model.
Why It Matters
Endpoints put models behind a stable interface that scales and can be monitored. They also define access control and cost.
Common Questions About Inference Endpoint
Q: Endpoint vs API?
An endpoint is a specific URL within an API where requests are sent.
Q: How is it secured?
With authentication keys or tokens, network rules, and rate limits.
Q: Can it scale?
Yes, many services add or remove servers based on traffic.