A model is serving live users on GPUs. Which life cycle stage is this?
Why C is the answer
Inference
Inference applies a trained model to new inputs.
In detail
- Inference applies a trained model to new inputs.
- Training happened earlier.
Use case
An illustrative scenario, not a real incident.
A chatbot answers live users on GPUs, which is inference.
See it in different ways
flowchart TD A["Training"] --> B["Large clusters, fast networks, long jobs"] C["Inference"] --> D["Low latency, many requests, scaling with demand"]
mindmap
root((AI))
Machine learning
Deep learning
Generative AI
Drivers
GPUs
Data
Algorithms
Stages
Training
Inferenceflowchart LR S0["Training"] --> S1["Validation"] --> S2["Deployment"] --> S3["Inference"]
Key point: Serving a model is inference.
Why the other options are wrong
- A. Pretraining
- That trains a model.
- B. Dataset curation
- That prepares data.
- D. Data labeling
- That prepares data.