How do you optimize models for latency and cost (quantization, distillation, batching)?

Optimize the full system, not just the model. Techniques: - Quantization (INT8) - Distillation to smaller models - Efficient runtimes (ONNX/TensorRT) - Request batching Trade-off accuracy vs latency vs cost. Validate with representative traffic and monitor p95/p99 latency.