From 83c685205c8e4d0c6e5750c81b23286ab9b67f07 Mon Sep 17 00:00:00 2001 From: Gernot Maier Date: Tue, 3 Feb 2026 13:53:39 +0100 Subject: [PATCH 1/2] v0.27.0-rc --- CHANGELOG.md | 70 ++++++++++++++++++++++++++++++++ docs/changes/1911.feature.md | 1 - docs/changes/1938.feature.md | 1 - docs/changes/1940.maintenance.md | 1 - docs/changes/1953.doc.md | 1 - docs/changes/1960.feature.md | 1 - docs/changes/1970.feature.md | 1 - docs/changes/1972.feature.md | 1 - docs/changes/1975.feature.md | 2 - docs/changes/1977.maintenance.md | 2 - docs/changes/1981.maintenance.md | 1 - docs/changes/1982.api.md | 4 -- docs/changes/1982.feature.md | 2 - docs/changes/1982.maintenance.md | 1 - docs/changes/1983.feature.md | 1 - docs/changes/1984.api.md | 1 - docs/changes/1985.feature.md | 1 - docs/changes/1987.api.md | 10 ----- docs/changes/1987.feature.md | 1 - docs/changes/1988.maintenance.md | 1 - docs/changes/1991.doc.md | 1 - docs/changes/1992.doc.md | 1 - docs/changes/1994.bugfix.md | 1 - docs/changes/1995.feature.md | 1 - docs/changes/1998.feature.md | 2 - docs/changes/1999.maintenance.md | 1 - docs/changes/2000.maintenance.md | 2 - docs/changes/2001.feature.md | 1 - docs/changes/2002.maintenance.md | 1 - docs/changes/2003.maintenance.md | 1 - docs/changes/2017.doc.md | 1 - docs/changes/2017.maintenance.md | 1 - 32 files changed, 70 insertions(+), 48 deletions(-) delete mode 100644 docs/changes/1911.feature.md delete mode 100644 docs/changes/1938.feature.md delete mode 100644 docs/changes/1940.maintenance.md delete mode 100644 docs/changes/1953.doc.md delete mode 100644 docs/changes/1960.feature.md delete mode 100644 docs/changes/1970.feature.md delete mode 100644 docs/changes/1972.feature.md delete mode 100644 docs/changes/1975.feature.md delete mode 100644 docs/changes/1977.maintenance.md delete mode 100644 docs/changes/1981.maintenance.md delete mode 100644 docs/changes/1982.api.md delete mode 100644 docs/changes/1982.feature.md delete mode 100644 docs/changes/1982.maintenance.md delete mode 100644 docs/changes/1983.feature.md delete mode 100644 docs/changes/1984.api.md delete mode 100644 docs/changes/1985.feature.md delete mode 100644 docs/changes/1987.api.md delete mode 100644 docs/changes/1987.feature.md delete mode 100644 docs/changes/1988.maintenance.md delete mode 100644 docs/changes/1991.doc.md delete mode 100644 docs/changes/1992.doc.md delete mode 100644 docs/changes/1994.bugfix.md delete mode 100644 docs/changes/1995.feature.md delete mode 100644 docs/changes/1998.feature.md delete mode 100644 docs/changes/1999.maintenance.md delete mode 100644 docs/changes/2000.maintenance.md delete mode 100644 docs/changes/2001.feature.md delete mode 100644 docs/changes/2002.maintenance.md delete mode 100644 docs/changes/2003.maintenance.md delete mode 100644 docs/changes/2017.doc.md delete mode 100644 docs/changes/2017.maintenance.md diff --git a/CHANGELOG.md b/CHANGELOG.md index 8fccfc5a49..9f4b7621d7 100644 --- a/CHANGELOG.md +++ b/CHANGELOG.md @@ -7,6 +7,76 @@ This changelog is generated using [Towncrier](https://towncrier.readthedocs.io/) +## [0.27.0](https://github.com/gammasim/simtools/releases/tag/0.27.0) - 2026-02-03 + +### API Changes + +- Changes to the setting of seeds for sim_telarray: + + - use `sim_telarray_random_instrument_instances` and `sim_telarray_instrument_seed` to generate a random seed file for the given number of configurations. + - use `sim_telarray_seed` together with `sim_telarray_instrument_seed` to set both instrument (configuration) and simulation seeds. These parameters completely fix the seeds and should only be used for testing purposes. + + ([#1982](https://github.com/gammasim/simtools/pull/1982)) +- Update naming of simtools-prod images to `-corsika--simtel`. ([#1984](https://github.com/gammasim/simtools/pull/1984)) +- CORSIKA interactions tables are not part of the CORSIKA7 container anymore and also not added to the simtools-dev container. + CORSIKA tables are available from the new [CTAO gitlab repository corsika7-interaction-tables](https://gitlab.cta-observatory.org/cta-computing/dpps/simpipe/simulation_software/corsika7-interaction-tables). This includes QGSJet-II, QGSJet-III, EPOS, EGS4, etc tables. + + To install and use the interaction tables for both production and development: + + - clone that repository into a separate directory from simtools (recommend the example such that it is reachable from inside the simtools-dev container by `/workdir/external/simpipe/simulation_software/corsika7-interaction-tables/interaction-tables/` + - ensure [Git LFS](https://git-lfs.com/) is installed and, after cloning, run `git lfs install` (once per system) and `git lfs pull` in the cloned repository so that the actual interaction table files (and not only pointer files) are downloaded + - Add a new env variable called `SIMTOOLS_CORSIKA_INTERACTION_TABLE_PATH` pointing to that path (see example in `.env_table`) + + Integration tests are cloning this repository and making the interaction tables available during testing. + + ([#1987](https://github.com/gammasim/simtools/pull/1987)) + +### Bugfixes + +- Correct calculation of lateral photon densities for histograms generated from CORSIKA. ([#1994](https://github.com/gammasim/simtools/pull/1994)) + +### Documentation + +- Improve documentation on available container images. Add new page to users guide with most important available images. ([#1953](https://github.com/gammasim/simtools/pull/1953)) +- Improve documentation for CORSIKA and related container images. ([#1991](https://github.com/gammasim/simtools/pull/1991)) +- Add disclosure on using AI tools. ([#1992](https://github.com/gammasim/simtools/pull/1992)) +- Improve documentation for integration tests with additional details on the different types of tests. ([#2017](https://github.com/gammasim/simtools/pull/2017)) + +### New Features + +- Implement gradient descent for the derivation of mirror_reflection_random_angle. Implement general tools for multiprocessing. ([#1911](https://github.com/gammasim/simtools/pull/1911)) +- Rename simtools-calculate-incident-angles to simtools-derive-incident-angle, add histogram calculation and writing functionality and output metadata. ([#1938](https://github.com/gammasim/simtools/pull/1938)) +- Add functionality to overwrite simulation model parameters from the command line using `--overwrite_model_parameters`. ([#1960](https://github.com/gammasim/simtools/pull/1960)) +- Use `DATDIR` CORSIKA input file flag to point to directory with interaction table files. ([#1970](https://github.com/gammasim/simtools/pull/1970)) +- Add EPOS as interaction model and include input flags to CORSIKA input file writer. ([#1972](https://github.com/gammasim/simtools/pull/1972)) +- Simplified and consistent simtools, CORSIKA, and sim_telarray package tagging: + i.e.,`simtools-prod-`, `simtools-dev-`, `corsika7--`, `sim_telarray-`. ([#1975](https://github.com/gammasim/simtools/pull/1975)) +- Add random seed module to generate seeds based on numpy.SeedSequence. + Add SimtelSeeds data class to hold and generate seeds for sim_telarray simulations. ([#1982](https://github.com/gammasim/simtools/pull/1982)) +- Add CORSIKA v78050, see [release notes (KIT gitlab; requires access)](https://gitlab.iap.kit.edu/AirShowerPhysics/corsika-legacy/corsika7/-/releases/v7.8050). ([#1983](https://github.com/gammasim/simtools/pull/1983)) +- Add sim_telarray, hessio, stdtools tagging using the CTAO gitlab release tags. ([#1985](https://github.com/gammasim/simtools/pull/1985)) +- Change of the default interaction model from qgs3 to epos (this allows to avoid to download the Gigabyte large QGSJet tables). ([#1987](https://github.com/gammasim/simtools/pull/1987)) +- Adds support for simulating arbitrary telescope layouts with CORSIKA (including “probe” telescopes for lateral density comparisons), and refactors overwrite-parameter handling to be read/validated once and reused across models. Expand functionality to generated regular arrays of telescopes with different shapes. ([#1995](https://github.com/gammasim/simtools/pull/1995)) +- Add functionality to `simtools-validate-camera-efficiency` to print fraction of light below 290 nm (as required for B-TEL-0095). + Introduce simple module describing the atmosphere. ([#1998](https://github.com/gammasim/simtools/pull/1998)) +- Add `git-lfs` to simtools-prod containers. ([#2001](https://github.com/gammasim/simtools/pull/2001)) + +### Maintenance + +- Add search patterns in integration tests and fix bug when using an isotropic angular distribution in the illuminator simulations. ([#1940](https://github.com/gammasim/simtools/pull/1940)) +- Unify execution of run scripts by consistently always use `job_manage.submit()`. + Improved `_make_run_command` for better readability. ([#1977](https://github.com/gammasim/simtools/pull/1977)) +- Improve file management for light emission simulations (flasher/illuminators). Change of output file naming and directory tree. ([#1981](https://github.com/gammasim/simtools/pull/1981)) +- Simplified setting of `corsika_seeds` and `sim_telarray_seeds`. ([#1982](https://github.com/gammasim/simtools/pull/1982)) +- Solve sphinx errors after update to sphinx 9.10. ([#1988](https://github.com/gammasim/simtools/pull/1988)) +- Add the ability to pass a label to RayTracing instead of using a cached label from the telescope model. ([#1999](https://github.com/gammasim/simtools/pull/1999)) +- Ensure that model data writer is not changing the general output path for all other modules. + Change and simplify model data writer API. ([#2000](https://github.com/gammasim/simtools/pull/2000)) +- Reduce the number of unnecessary debug statements. ([#2002](https://github.com/gammasim/simtools/pull/2002)) +- Improve model parameter overwrite function with an explicit `flat_dict` statement to avoid being flooded by warnings like `WARNING::model_parameter(l519)::overwrite_parameters::Parameter MSTS-05 not found in model MSTS-12, cannot overwrite it.` (note the error in the warning). ([#2003](https://github.com/gammasim/simtools/pull/2003)) +- Add values for camera efficiency application to test against reference values. Add YAML-type output for validate_camera_efficiency. ([#2017](https://github.com/gammasim/simtools/pull/2017)) + + ## [v0.26.0](https://github.com/gammasim/simtools/releases/tag/v0.26.0) - 2026-01-08 ### API Changes diff --git a/docs/changes/1911.feature.md b/docs/changes/1911.feature.md deleted file mode 100644 index a8f49efd7f..0000000000 --- a/docs/changes/1911.feature.md +++ /dev/null @@ -1 +0,0 @@ -Implement gradient descent for the derivation of mirror_reflection_random_angle. Implement general tools for multiprocessing. diff --git a/docs/changes/1938.feature.md b/docs/changes/1938.feature.md deleted file mode 100644 index 1eaf8264ff..0000000000 --- a/docs/changes/1938.feature.md +++ /dev/null @@ -1 +0,0 @@ -Rename simtools-calculate-incident-angles to simtools-derive-incident-angle, add histogram calculation and writing functionality and output metadata. diff --git a/docs/changes/1940.maintenance.md b/docs/changes/1940.maintenance.md deleted file mode 100644 index 4d01b23dd1..0000000000 --- a/docs/changes/1940.maintenance.md +++ /dev/null @@ -1 +0,0 @@ -Add search patterns in integration tests and fix bug when using an isotropic angular distribution in the illuminator simulations. diff --git a/docs/changes/1953.doc.md b/docs/changes/1953.doc.md deleted file mode 100644 index 8e79eeec5d..0000000000 --- a/docs/changes/1953.doc.md +++ /dev/null @@ -1 +0,0 @@ -Improve documentation on available container images. Add new page to users guide with most important available images. diff --git a/docs/changes/1960.feature.md b/docs/changes/1960.feature.md deleted file mode 100644 index cf9b996326..0000000000 --- a/docs/changes/1960.feature.md +++ /dev/null @@ -1 +0,0 @@ -Add functionality to overwrite simulation model parameters from the command line using `--overwrite_model_parameters`. diff --git a/docs/changes/1970.feature.md b/docs/changes/1970.feature.md deleted file mode 100644 index 4987313a8f..0000000000 --- a/docs/changes/1970.feature.md +++ /dev/null @@ -1 +0,0 @@ -Use `DATDIR` CORSIKA input file flag to point to directory with interaction table files. diff --git a/docs/changes/1972.feature.md b/docs/changes/1972.feature.md deleted file mode 100644 index ddb0b75777..0000000000 --- a/docs/changes/1972.feature.md +++ /dev/null @@ -1 +0,0 @@ -Add EPOS as interaction model and include input flags to CORSIKA input file writer. diff --git a/docs/changes/1975.feature.md b/docs/changes/1975.feature.md deleted file mode 100644 index 7eadb224db..0000000000 --- a/docs/changes/1975.feature.md +++ /dev/null @@ -1,2 +0,0 @@ -Simplified and consistent simtools, CORSIKA, and sim_telarray package tagging: -i.e.,`simtools-prod-`, `simtools-dev-`, `corsika7--`, `sim_telarray-`. diff --git a/docs/changes/1977.maintenance.md b/docs/changes/1977.maintenance.md deleted file mode 100644 index 36801fcd17..0000000000 --- a/docs/changes/1977.maintenance.md +++ /dev/null @@ -1,2 +0,0 @@ -Unify execution of run scripts by consistently always use `job_manage.submit()`. -Improved `_make_run_command` for better readability. diff --git a/docs/changes/1981.maintenance.md b/docs/changes/1981.maintenance.md deleted file mode 100644 index 2b5ec983a6..0000000000 --- a/docs/changes/1981.maintenance.md +++ /dev/null @@ -1 +0,0 @@ -Improve file management for light emission simulations (flasher/illuminators). Change of output file naming and directory tree. diff --git a/docs/changes/1982.api.md b/docs/changes/1982.api.md deleted file mode 100644 index 0c11862c23..0000000000 --- a/docs/changes/1982.api.md +++ /dev/null @@ -1,4 +0,0 @@ -Changes to the setting of seeds for sim_telarray: - -- `sim_telarray_random_instrument_instances` and `sim_telarray_instrument_seed` to generate a random seed file for the given number of configurations. -- use `sim_telarray_seed` together with `sim_telarray_instrument_seed` to set both instrument (configuration) and simulation seeds. These parameters completely fix the seeds and should only be used for testing purposes. diff --git a/docs/changes/1982.feature.md b/docs/changes/1982.feature.md deleted file mode 100644 index 4bb08e0dd1..0000000000 --- a/docs/changes/1982.feature.md +++ /dev/null @@ -1,2 +0,0 @@ -Add random seed module to generate seeds based on numpy.SeedSequence. -Add SimtelSeeds data class to hold and generate seeds for sim_telarray simulations. diff --git a/docs/changes/1982.maintenance.md b/docs/changes/1982.maintenance.md deleted file mode 100644 index 00a69e06ab..0000000000 --- a/docs/changes/1982.maintenance.md +++ /dev/null @@ -1 +0,0 @@ -Simplified setting of `corsika_seeds` and `sim_telarray_seeds`. diff --git a/docs/changes/1983.feature.md b/docs/changes/1983.feature.md deleted file mode 100644 index 3a62786c5e..0000000000 --- a/docs/changes/1983.feature.md +++ /dev/null @@ -1 +0,0 @@ -Add CORSIKA v78050, see [release notes (KIT gitlab; requires access)](https://gitlab.iap.kit.edu/AirShowerPhysics/corsika-legacy/corsika7/-/releases/v7.8050). diff --git a/docs/changes/1984.api.md b/docs/changes/1984.api.md deleted file mode 100644 index 4e587109d8..0000000000 --- a/docs/changes/1984.api.md +++ /dev/null @@ -1 +0,0 @@ -Update naming of simtools-prod images to `-corsika--simtel`. diff --git a/docs/changes/1985.feature.md b/docs/changes/1985.feature.md deleted file mode 100644 index b468b9a413..0000000000 --- a/docs/changes/1985.feature.md +++ /dev/null @@ -1 +0,0 @@ -Add sim_telarray, hessio, stdtools tagging using the CTAO gitlab release tags. diff --git a/docs/changes/1987.api.md b/docs/changes/1987.api.md deleted file mode 100644 index 01d4b9070f..0000000000 --- a/docs/changes/1987.api.md +++ /dev/null @@ -1,10 +0,0 @@ -CORSIKA interactions tables are not part of the CORSIKA7 container anymore and also not added to the simtools-dev container. -CORSIKA tables are now available from the new [CTAO gitlab repository corsika7-interaction-tables](https://gitlab.cta-observatory.org/cta-computing/dpps/simpipe/simulation_software/corsika7-interaction-tables). This includes QGSJet-II, QGSJet-III, EPOS, EGS4, etc tables. - -To install and use the interaction tables for both production and development: - -- clone that repository into a separate directory from simtools (recommend the example such that it is reachable from inside the simtools-dev container by `/workdir/external/simpipe/simulation_software/corsika7-interaction-tables/interaction-tables/` -- ensure [Git LFS](https://git-lfs.com/) is installed and, after cloning, run `git lfs install` (once per system) and `git lfs pull` in the cloned repository so that the actual interaction table files (and not only pointer files) are downloaded -- Add a new env variable called `SIMTOOLS_CORSIKA_INTERACTION_TABLE_PATH` pointing to that path (see example in `.env_table`) - -Integration tests are cloning this repository and making the interaction tables available during testing. diff --git a/docs/changes/1987.feature.md b/docs/changes/1987.feature.md deleted file mode 100644 index 96c4dc8b6e..0000000000 --- a/docs/changes/1987.feature.md +++ /dev/null @@ -1 +0,0 @@ -Change of the default interaction model from qgs3 to epos (this allows to avoid to download the Gigabyte large QGSJet tables). diff --git a/docs/changes/1988.maintenance.md b/docs/changes/1988.maintenance.md deleted file mode 100644 index f2f34e36c9..0000000000 --- a/docs/changes/1988.maintenance.md +++ /dev/null @@ -1 +0,0 @@ -Solve sphinx errors after update to sphinx 9.10. diff --git a/docs/changes/1991.doc.md b/docs/changes/1991.doc.md deleted file mode 100644 index 3078e030ae..0000000000 --- a/docs/changes/1991.doc.md +++ /dev/null @@ -1 +0,0 @@ -Improve documentation for CORSIKA and related container images. diff --git a/docs/changes/1992.doc.md b/docs/changes/1992.doc.md deleted file mode 100644 index 83f8bccc55..0000000000 --- a/docs/changes/1992.doc.md +++ /dev/null @@ -1 +0,0 @@ -Add disclosure on using AI tools. diff --git a/docs/changes/1994.bugfix.md b/docs/changes/1994.bugfix.md deleted file mode 100644 index 82bf146305..0000000000 --- a/docs/changes/1994.bugfix.md +++ /dev/null @@ -1 +0,0 @@ -Correct calculation of lateral photon densities for histograms generated from CORSIKA. diff --git a/docs/changes/1995.feature.md b/docs/changes/1995.feature.md deleted file mode 100644 index ea9b1d1c5a..0000000000 --- a/docs/changes/1995.feature.md +++ /dev/null @@ -1 +0,0 @@ -Adds support for simulating arbitrary telescope layouts with CORSIKA (including “probe” telescopes for lateral density comparisons), and refactors overwrite-parameter handling to be read/validated once and reused across models. Expand functionality to generated regular arrays of telescopes with different shapes. diff --git a/docs/changes/1998.feature.md b/docs/changes/1998.feature.md deleted file mode 100644 index 5885448619..0000000000 --- a/docs/changes/1998.feature.md +++ /dev/null @@ -1,2 +0,0 @@ -Add functionality to `simtools-validate-camera-efficiency` to print fraction of light below 290 nm (as required for B-TEL-0095). -Introduce simple module describing the atmosphere. diff --git a/docs/changes/1999.maintenance.md b/docs/changes/1999.maintenance.md deleted file mode 100644 index 9a58884aec..0000000000 --- a/docs/changes/1999.maintenance.md +++ /dev/null @@ -1 +0,0 @@ -Add the ability to pass a label to RayTracing instead of using a cached label from the telescope model. diff --git a/docs/changes/2000.maintenance.md b/docs/changes/2000.maintenance.md deleted file mode 100644 index 31ec648a48..0000000000 --- a/docs/changes/2000.maintenance.md +++ /dev/null @@ -1,2 +0,0 @@ -Ensure that model data writer is not changing the general output path for all other modules. -Change and simplify model data writer API. diff --git a/docs/changes/2001.feature.md b/docs/changes/2001.feature.md deleted file mode 100644 index a6e833d223..0000000000 --- a/docs/changes/2001.feature.md +++ /dev/null @@ -1 +0,0 @@ -Add `git-lfs` to simtools-prod containers. diff --git a/docs/changes/2002.maintenance.md b/docs/changes/2002.maintenance.md deleted file mode 100644 index c1f6916d2f..0000000000 --- a/docs/changes/2002.maintenance.md +++ /dev/null @@ -1 +0,0 @@ -Reduce the number of unnecessary debug statements. diff --git a/docs/changes/2003.maintenance.md b/docs/changes/2003.maintenance.md deleted file mode 100644 index fb6e9a4733..0000000000 --- a/docs/changes/2003.maintenance.md +++ /dev/null @@ -1 +0,0 @@ -Improve model parameter overwrite function with an explicit `flat_dict` statement to avoid being flooded by warnings like `WARNING::model_parameter(l519)::overwrite_parameters::Parameter MSTS-05 not found in model MSTS-12, cannot overwrite it.` (note the error in the warning). diff --git a/docs/changes/2017.doc.md b/docs/changes/2017.doc.md deleted file mode 100644 index a18c016544..0000000000 --- a/docs/changes/2017.doc.md +++ /dev/null @@ -1 +0,0 @@ -Improve documentation for integration tests with additional details on the different types of tests. diff --git a/docs/changes/2017.maintenance.md b/docs/changes/2017.maintenance.md deleted file mode 100644 index 5ed2cff42f..0000000000 --- a/docs/changes/2017.maintenance.md +++ /dev/null @@ -1 +0,0 @@ -Add values for camera efficiency application to test against reference values. Add YAML-type output for validate_camera_efficiency. From 8b05fb84ace50decc8891a8452822d88a6fbe7cf Mon Sep 17 00:00:00 2001 From: Gernot Maier Date: Tue, 3 Feb 2026 13:54:44 +0100 Subject: [PATCH 2/2] switcher --- docs/_static/switcher.json | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-) diff --git a/docs/_static/switcher.json b/docs/_static/switcher.json index dcbfd18d4b..bf56b00755 100644 --- a/docs/_static/switcher.json +++ b/docs/_static/switcher.json @@ -8,5 +8,6 @@ {"version": "v0.23.0", "url": "https://gammasim.github.io/simtools/v0.23.0/"}, {"version": "v0.24.0", "url": "https://gammasim.github.io/simtools/v0.24.0/"}, {"version": "v0.25.0", "url": "https://gammasim.github.io/simtools/v0.25.0/"}, - {"version": "v0.26.0", "url": "https://gammasim.github.io/simtools/v0.26.0/"} + {"version": "v0.26.0", "url": "https://gammasim.github.io/simtools/v0.26.0/"}, + {"version": "v0.27.0", "url": "https://gammasim.github.io/simtools/v0.27.0/"} ]