Skip to content

BF: Queue-based multitasking #1210

@detlefarend

Description

@detlefarend

Description/Motivation
During workflow processing, tasks are triggered by their predecessors using MLPro's event handling. The data itself is handed over via the workflow's shared object. This mechanism shall be replaced by a queue-based approach to improve the overall processing performance and

Task list

  • 1. Evaluation of queues in multi-threading and multi-processing
  • 2. Preparation and execution of meaningful benchmark tests
  • 3. Redesign of classes Task and Workflow
  • 4. Redesign of classes StreamTask, StreamWorkflow, StreamShared
    • 4.1 Processing and forwarding of single instances via queue
    • 4.2 Refactoring of all methods using p_instances : InstDict
  • 5. Execution of benchmark tests using the reworked classes
  • 6. RTD
    • 6.1 Update API
    • 6.2 Update description of mlpro.bf.mt

Cross references
Queues in multi-threading
Queues in multi-processing

Metadata

Metadata

Assignees

Labels

enhancementNew feature or request

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions