Skip to content

cmg: Auto deploy throws "Failed to deploy model" #6

@lawrencelai

Description

@lawrencelai

cmg throw exception when calling /[models/{mode_name}/tasks/{tasks}]not running on-demand model

{
    "detail": "Model 'medcat-icd10-20260116' is not available. Running models: ['medcat-icd10']. On-demand models: ['medcat-icd10-20260116']. List all models at /models"
}

In the server log in gateway:

INFO:cmg.gateway.auto_deploy:Model 'medcat-icd10-20260116' is not currently running
2026-01-16T11:44:52.991784417Z INFO:cmg.gateway.auto_deploy:Model 'medcat-icd10-20260116' not available, initiating auto-deployment
2026-01-16T11:44:53.061906110Z INFO:cmg.gateway.auto_deploy:Starting deployment of on-demand model: medcat-icd10-20260116
2026-01-16T11:44:53.077672977Z ERROR:cmg.gateway.auto_deploy:Failed to deploy model 'medcat-icd10-20260116': 'DeployResources' object has no attribute 'get'
2026-01-16T11:44:53.082762167Z ERROR:cmg.gateway.auto_deploy:Failed to deploy model 'medcat-icd10-2026011

Metadata

Metadata

Assignees

Labels

bugSomething isn't working

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions