Python
- The SDK installs on Python 3.10 to 3.13.
- Containers run Python 3.12. An image built on your own base image may use any Python; see images.
GPUs
- 1, 2, 4 or 8 GPUs of one type per container, on one machine. More than one needs a paid workspace.
- A GPU type can be unavailable for a while.
klio gpusshows what can start now, and a list ingpu=falls back to another type.
Defaults you can change
| Setting | Default |
|---|---|
@function(timeout=) | 3600 seconds |
@endpoint(timeout=) | 180 seconds |
@endpoint(keep_warm_seconds=) | 180 seconds |
klio model deploy --keep-warm | 300 seconds |
Not available
- Machines, pools and workers are managed for you, so there are no commands for them.
- From the Modal API:
@modal.clustered,@modal.batched,@modal.web_server,@modal.wsgi_app,.remote_gen(),CloudBucketMount,region=andcloud=. See coming from Modal.
Billing limits
Purchases are between $10 and $1,000 each, up to a monthly limit of $500 unless you change it. See pricing.