Events as a Basis for Workflow Scheduling

Publikation: Bidrag til bog/antologi/rapportKonferencebidrag i proceedingsForskningfagfællebedømt

This paper evaluates using event-based scheduling as a basis for dynamic workflow management. To do this, the WorkflowRunner is introduced as a tool for conducting event driven scheduling in a robust manner. It is evaluated in comparison to Slurm and the WorkflowRunner is found to schedule analysis ~2.5x quicker, in the majority of use cases. An example workflow is also presented, demonstrating how this style of scheduling allows for complete modification of the workflow structure at runtime, something very difficult to achieve in traditional workflow management systems. These developments are expected to be of particular use to dynamic scheduling systems, as well as for distributed, or heterogeneous systems such as those looking to accommodate human-in-the-loop interactions.
OriginalsprogEngelsk
TitelProceedings of WORKS 2022 : 17th Workshop on Workflows in Support of Large-Scale Science, Held in conjunction with SC 2022: The International Conference for High Performance Computing, Networking, Storage and Analysis
Antal sider8
ForlagIEEE
Publikationsdato2022
Sider52-59
ISBN (Elektronisk)9781665451918
DOI
StatusUdgivet - 2022
Begivenhed17th IEEE/ACM Workshop on Workflows in Support of Large-Scale Science, WORKS 2022 - Dallas, USA
Varighed: 13 nov. 202218 nov. 2022

Konference

Konference17th IEEE/ACM Workshop on Workflows in Support of Large-Scale Science, WORKS 2022
LandUSA
ByDallas
Periode13/11/202218/11/2022

Bibliografisk note

Funding Information:
This project has received funding from the European Union’s Horizon 2020 research and innovation programme under the Marie Skłodowska-Curie grant agreement No 765604.

Publisher Copyright:
© 2022 IEEE.

ID: 344725898