CLI
For VM-based backends as well as SSH fleets, the CLI now shows Docker image pull progress in the format <extracted>/<downloaded>/<total>.
Offers
This update reduces the time required to fetch backend offers and initialize backends, making both dstack offer and dstack apply faster:
- runpod — 0.66s => 0.03s (22x)
- amddevcloud — 2.26s => 0.85s (2.7x)
- cudo — 2.48s => 1.02s (2.4x)
- verda — 3.27s => 1.74s (1.9x)
- lambda — 3.24s => 1.89s (1.7x)
- vastai — 3.27s => 1.77s (1.8x)
- gcp — 3.74s => 2.54s (1.5x)
- azure — 5.83s => 3.11s (1.9x)
- aws — 6.58s => 3.56s (1.8x)
Secrets
The Manager project role can now manage secrets if the allow_managers_manage_secrets property is enabled in the server’s default_permissions config:
default_permissions:
allow_managers_manage_secrets: truePreviously, only the Admin role was allowed to manage secrets.
GPUs
This update adds support for GeForce RTX 2, 3, 4, and 5 series GPUs, which were previously not detected properly across both backend and SSH fleets.
GCP
The gcp backend now requires the compute.projects.get permission. Make sure this permission is granted to any custom IAM roles used by dstack.
What's changed
- Optimize GCP offers by @r4victor in dstackai/dstack#3793
- Optimize InstanceOffer construction by @r4victor in dstackai/dstack#3794
- Speed up GCP validate_credentials by @r4victor in dstackai/dstack#3795
- Support secrets management by Manager role by @r4victor in dstackai/dstack#3801
- Fix
update_default_project()crash on server without TTY by @un-def in dstackai/dstack#3797 - Kubernetes: fix
is_hard_taintcheck by @un-def in dstackai/dstack#3803 - Fix deleting idle instance from fleet with runs by @jvstme in dstackai/dstack#3807
- [Docs] Update examples by @peterschmidt85 in dstackai/dstack#3798
- Display image pull progress in CLI by @jvstme in dstackai/dstack#3805
- [Docs] Add an inline
kubeconfigexample to thekubernetesbackend documentation by @peterschmidt85 in dstackai/dstack#3813 - Avoid Verda instance termination warnings by @jvstme in dstackai/dstack#3810
- [Internal] Improve warning message in
ServerConfigManager.apply_config()by @un-def in dstackai/dstack#3804 - Add missing join to volumes query in JobSubmittedWorker by @un-def in dstackai/dstack#3816
- Add CLI deprecation warnings about gateway routers by @jvstme in dstackai/dstack#3814
- Bump
gpuhunt, add support for all GeForce RTX 2..5 series by @un-def in dstackai/dstack#3818 - Add misssing
compute.projects.getGCP permission by @un-def in dstackai/dstack#3820
Full changelog: dstackai/dstack@0.20.17...0.20.18