Add micro batching and enpoints for v1 list_models and get_model#41

Merged

baixiac merged 3 commits intomainfrom

Mar 13, 2026

Commits on Mar 6, 2026

feat: add the enpoint for v1 models and list models
baixiac
committed

Commits on Mar 9, 2026

docker: add the GPU image build and remove per-model Dockerfiles
baixiac
committed

Commits on Mar 10, 2026

chore: upgrade uv and tidy up the docker folder
baixiac
committed