Events as a Basis for Workflow Scheduling
Publikation: Bidrag til bog/antologi/rapport › Konferencebidrag i proceedings › Forskning › fagfællebedømt
This paper evaluates using event-based scheduling as a basis for dynamic workflow management. To do this, the WorkflowRunner is introduced as a tool for conducting event driven scheduling in a robust manner. It is evaluated in comparison to Slurm and the WorkflowRunner is found to schedule analysis ~2.5x quicker, in the majority of use cases. An example workflow is also presented, demonstrating how this style of scheduling allows for complete modification of the workflow structure at runtime, something very difficult to achieve in traditional workflow management systems. These developments are expected to be of particular use to dynamic scheduling systems, as well as for distributed, or heterogeneous systems such as those looking to accommodate human-in-the-loop interactions.
Originalsprog | Engelsk |
---|---|
Titel | Proceedings of WORKS 2022 : 17th Workshop on Workflows in Support of Large-Scale Science, Held in conjunction with SC 2022: The International Conference for High Performance Computing, Networking, Storage and Analysis |
Antal sider | 8 |
Forlag | IEEE |
Publikationsdato | 2022 |
Sider | 52-59 |
ISBN (Elektronisk) | 9781665451918 |
DOI | |
Status | Udgivet - 2022 |
Begivenhed | 17th IEEE/ACM Workshop on Workflows in Support of Large-Scale Science, WORKS 2022 - Dallas, USA Varighed: 13 nov. 2022 → 18 nov. 2022 |
Konference
Konference | 17th IEEE/ACM Workshop on Workflows in Support of Large-Scale Science, WORKS 2022 |
---|---|
Land | USA |
By | Dallas |
Periode | 13/11/2022 → 18/11/2022 |
Bibliografisk note
Funding Information:
This project has received funding from the European Union’s Horizon 2020 research and innovation programme under the Marie Skłodowska-Curie grant agreement No 765604.
Publisher Copyright:
© 2022 IEEE.
ID: 344725898