Conversation
lucaspar
added
feature
lucaspar
force-pushed
the
lp/sfs
branch
2 times, most recently
from
bc33793 to
dc567ea
Compare
lucaspar
force-pushed
the
lp/sfs
branch
4 times, most recently
from
bcc648e to
b3bec15
Compare
- rewrite compose.production.yaml: 5 volume servers (1 per 22TB drive) with leveldb index, admin+worker for erasure coding, pushgateway+prometheus+grafana, filer backup, x-logging - enable s3 sink in replication.toml for async backup to minio - add s3-config.json with admin + backup identities - switch prometheus to pushgateway scrape mode - add jwt security env var docs to security.toml - update .env templates with secrets scaffolding (jwt, sse, grafana) - document audit and changes in progress.md
Rename SFS_* settings to PRIMARY_* and MINIO_* to SECONDARY_* across the storage backend (settings, dual storage, client, tests, monitoring). Introduce OBJECT_STORE_READ_FALLBACK_TO_SECONDARY_ENABLED flag. Fix duplicate dead code block in get_minio_client().
Replace MinIO service with RustFS (local/CI) and add secondary RustFS (production). Rename associated networks/volumes. Consolidate env_file references to storage.env. Remove old CI workflow.
Replace minio.env and sfs.env with storage.env (local/CI) and storage.prod.env (production). Update generate-secrets and deploy scripts to use new names and PRIMARY/SECONDARY env vars. Update seaweedfs justfile and deploy.sh for renamed env vars.
Update documentation to reflect the rename from SFS/MINIO to PRIMARY/SECONDARY and from minio/sfs.env to storage.env.
standardize ci and local compose files to follow production patterns: - upgrade image tag to 4.23_large_disk_full - add x-logging anchor with default logging config - mount individual config files instead of entire config directory - use yaml block scalar format for commands - standardize healthcheck parameters across all services - use bind mounts under ./data/ instead of named volumes for local/ci - remove obsolete compose.yaml not used by any environment - fix data-setup justfile recipe for new directory structure
Add dedicated postgres network to ci/local/prod compose files. Switch postgres to its own network instead of sharing rustfs/minio networks. Port primary service to 19000:9000 and load storage.env for access credentials. Update justfile to include storage.env in docker compose command. Add access key generation to generate-secrets.sh.
Add container/S3 logs to wait loops for debugging. Use current user uid/gid instead of hardcoded 1000 for data directory ownership in seaweedfs deploy.
- update generate-secrets.sh to configure secondary (seaweedfs) credentials for local env - add secondary credentials to example storage.env template - skip secondary bucket creation in management cmd when creds are unset - load and configure secondary s3 identity on seaweedfs during deploy
… ci resilience - init_indices: use contextlib.suppress(exception) for reset_create_block - test_capture_endpoints: replace try/except/pass with contextlib.suppress - test_opensearch: same suppress pattern for _clear_create_index_block helper - test_admin_dashboard: use primary-storage service name, remove unused var - gateway deploy: add nuke_ci_opensearch_volume for ci volume cleanup - opensearch config: raise disk watermark thresholds to 98%/99% - seaweedfs deploy: add debug logs and ci sfs.env generation helper
…(primary-storage, secondary, postgres)
klpoland
approved these changes
May 15, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Note
Do not merge before May 26.
Integration of SeaweedFS and RustFS as additional storage backends, replacing MinIO for local, CI, and production environments.
minio.envis not used anymore: generate local secrets to create astorage.envwith the new configuration format.chmod-ing.envfiles to600upon (re-)generation.