Pricing Overview
Serverless API (LoRA) supports two billing plans:- Pay as You Go: standard hourly rates by machine tier.
- Pro (subscription): 20%–30% discount on Pay as You Go rates.
How Billing Works
Billing is usage-based and calculated per second:- Billing starts when an instance is signaled to wake up.
- Billing stops when the instance is fully shut down.
minimum_instances and maximum_instances.
Persistent Instances
- Set
minimum_instances> 0 to keep that many instances running. - You are billed for the full uptime (including idle time) until you scale down.
On-Demand Instances
- Additional instances spin up to handle demand above
minimum_instances(or all demand whenminimum_instances= 0). - They scale down after the keep-warm period.
- You are billed for cold start, execution, and keep-warm time.
Instance Cost Breakdown
- Cold start / warm-up time: instance boots and loads models/assets. Duration depends on machine tier, workflow complexity, and model size.
- Execution time: workflows run. This is the main compute time.
- Keep-warm time: idle time before scale-down. This time is billed.
Note: You may also see Queue Time (waiting for resources or concurrency). Queue time is not billed.
Controlling cost
- Scale to zero: set minimum instances = 0 to avoid idle cost (first request may be slower due to cold start).
- Cap concurrency: keep maximum instances conservative to limit parallel capacity and spend.
- Tune keep-warm: shorter keep-warm lowers idle cost; longer keep-warm reduces cold starts during bursty traffic.
