v0.43.90

This release adds improved debug facilities and fixes to the core and executor, as well as improvements to the Apricot HTTP API.

• Apricot:

  • [apricot][OCTRL-554] Apricot HTTP Service returns the complete result of /inventory/detectors.

• Debug:

  • [core] Improved logging and timetracking in scheduler, taskman, cmdq
  • [executor] Launch refactor + improved logging and timetracking

• Miscellaneous:

  • [core] Ensure the run number is correctly returned before_START_ACTIVITY

v0.43.0

This release adds the auto-stop feature to environment, as well as bug fixes and improvements to error message clarity and relevance.

• Auto-stop:

  • [core] Add auto-stop functionality for environments
  • [core] Auto-stop: use getKV and improve error logging

• Miscellaneous:

  • [coconut] Update default apricot endpoint
  • [core] Only send curated properties to ODC
  • [core] New --version convenience parameter for manual deployment
  • [core] Increase commandqueue max length and improve error handling
  • [core] Show list of inactive roles on deployment failure
  • [core] String representation of descriptors slice
  • [core] Increase TaskMan queue size and improve error handling
  • [core] Improve error output of undeployed task descriptors
  • [core] Env deployment timeout is now governed by var deploy_timeout
  • [core] Improve core/scheduler debug output (utils.TimeTrack)
  • [executor] Ensure stdout/stderr pipes are closed
  • [task] Add a random sleep of up to 10s before each task for debugging purposes

v0.42.2

This patch release contains a fix for a known crash in the DDscheduler client.

• [core] Prevent DD from crashing AliECS core with a bad response

v0.42.1

This patch release contains a fix for a known issue with deployment of large workflows (or generally workflows with tasks that configure many channels).

• [occ] Fix large cfg payloads cut off because of gRPC slices

v0.42.0

The present release includes improvements to the OCClite plugin for FairMQ devices and other fixes and improvements.

• OCC:
  • [occ] Add debug spam to SetProperty calls
  • [occ] Correct path of channel configuration keys
  • [occ] Remove --channel-config workaround and rely on implicit creation
  • [occ] Build with C++17
  • [occ] Make debug output parsable
  • [occ] Query back chans. properties for debug purposes
  • [occ] Reduce debug output volume
• Miscellaneous:
  • [core] Add GetRootRole and SetGlobalVar to workflow & refactor callable
  • [core] Run the cleanup binary only for readout-dataflow
  • [core][OCTRL-574] The odc_topology_fullname value is generated in a separate function.

v0.41.1

This patch release contains a single hotfix to restore GenerateEPNWorkflowScript functionality.

• [core] Disable ODC topology fullname output

v0.41.0

The present release includes a major improvement of the Bookkeeping integration plugin, fixes to the recently introduced Kafka integration plugin, and other miscellaneous improvements and fixes.

• Bookkeeping improvements:

  • [build] Bump Bookkeeping package and related dependencies
  • [core] The Bookkeeping integration plugin is extended to support environment updates.
  • [core] Bookkeeping plugin handles errors for better debugging, and handles the DESTROY hook.
  • [core] Bookkeeping plugin handles the errors from CreateFlp after reponse type correction.
  • [core][OCTRL-621] Making sure CreateLog is called from Bookkeeping plugin.
  • [core][OCTRL-621] Bookkeeping plugin now handles Bookkeeping API errors correctly.
  • [core][OCTRL-621] Bookkeeping plugin handles errors correctly.

• Miscellaneous improvements:

  • [core] Handle hooks for leave_state trigger upon environment destruction
  • [core] make kafka notify upon leaving states
  • [core] Set odc_topology_fullname as a runtime variable available to the API.
  • [core][OCTRL-574] Errors are handled correctly in GenerateEPNWorkflowScript.

v0.40.1

This patch release fixes a critical issue which caused the new Bookkeeping integration plugin to fail to initialize.

• [core] Add bookkeepingBaseUri to list of viper flags
• [core] Fix initialization of Bookkeeping instance singleton

v0.40.0

The present release includes a refactor of Bookkeeping integration facilities as a new Bookkeeping integration plugin, fixes to the recently introduced Kafka integration plugin, and other miscellaneous improvements and fixes.

• Bookkeeping integration plugin:

  • [core][OCTRL-621] The Bookkeeping should become an integration plugin to take advantage of hooks.
  • [core][OCTRL-621] Bookkeeping is an integration plugin that can take advantage of hooks.
  • [core][OCTRL-621] Bookkeeping integration plugin related files are cleaned up.
  • [core][OCTRL-621] Resolving PR comments for the Bookkeeping integration plugin.

• Kafka integration plugin:

  • [core] kafkaBroker -> kafkaEndpoint
  • [core] Add kafkaEndpoint as known cli flag
  • [core] Allow auto topic creation in Kafka client + improved logging

• Miscellaneous:

  • [core] Push lhc_period, run_type and detectors to EPN tasks
  • [core] Introduce START counter as __fmq_cleanup_count variable
  • [core] Push cleanup variable (__fairmq_cleanup_count) to FLP and EPN
  • [apricot][OCTRL-547] ListRuntimeEntries returns the correct flattened tree.

v0.39.0

The present release includes fixes to TRG response handling, cleanup facilities, and a new Kafka integration plugin.

• Kafka integration plugin:

  • [core] Kafka plugin to publish FSM state transitions
  • [core] Check if kafka message status can be read
  • [core] Store environment state in varStack and make kafka plugin get it from there
  • [core] Use UnixMilli(), since Go 1.17 supports it
  • [core] Initialize loggers in CCDB and Kafka plugins
  • [core] A different (working) approach to obtaining current state
  • [core] Update kafka topics to the agreed convention
  • [core] rename kafkaBroker to kafkaEndpoint for consistency, fix log
  • [core] Publish an empty env list to kafka at init
  • [core] Publish Error state and react to DESTROY in kafka plugin
  • [core] Use one common callback in the kafka plugin
  • [core] several improvements to logging in kafka and ccdb plugins
  • [core] make some member of kafka plugin private
  • [core] include STANDBY in the states which can initiate GO_ERROR
  • [core] Port kafka plugin to kafka-go package
  • [core] Minor string fixes in kafka plugin

• Other integration plugin fixes:

  • [core] Make TRG RunList line parsing forward-compatible
  • [core] TRG: Improve run parsing
  • [core] TRG should ignore the daq trigger
  • [core] Handle daq & standalone trg reconciliation gracefully

• Miscellaneous:

  • [core] Add dirty hack for FLP cleanup before DEPLOY
  • [core] Properly set facility & partition for shmcleaner logs