SiNa88 / C3-Match

Matching-based scheduling of asynchronous data processing workflows on the Cloud and Fog

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

C3-Match

A matching theory-based algorithm for scheduling the data processing applications on the compute devices.

Citation

Mehran, N., Samani, Z.N., Kimovski, D. and Prodan, R., 2022, September. Matching-based Scheduling of Asynchronous Data Processing Workflows on the Computing Continuum. In 2022 IEEE International Conference on Cluster Computing (CLUSTER) (pp. 58-70). IEEE. https://doi.org/10.1007/978-3-031-12597-3_15

BibTex:

@INPROCEEDINGS{9912724,  
author={Mehran, Narges and Najafabadi Samani, Zahra  and Kimovski, Dragi and Prodan, Radu},  
booktitle={2022 IEEE International Conference on Cluster Computing (CLUSTER)},   
title={Matching-based Scheduling of Asynchronous Data Processing Workflows on the Computing Continuum},   
year={2022},  
volume={},  
number={},  
pages={58-70},  
abstract={Today's distributed computing infrastructures en-compass complex workflows for real-time data gathering, transferring, storage, and processing, quickly overwhelming centralized cloud centers. Recently, the computing continuum that federates the Cloud services with emerging Fog and Edge devices represents a relevant alternative for supporting the next-generation data processing workflows. However, eminent challenges in automating data processing across the computing continuum still exist, such as scheduling heterogeneous devices across the Cloud, Fog, and Edge layers. We propose a new scheduling algorithm called C3 -MATCH, based on matching theory principles, involving two sets of players negotiating different utility functions: 1) workflow microservices that prefer computing devices with lower data processing and queuing times; 2) computing continuum devices that prefer microservices with corresponding resource requirements and less data transmission time. We evaluate $C^{3}$-MATCH using real-world road sign inspection and sentiment analysis workflows on a federated computing continuum across four Cloud, Fog, and Edge providers. Our combined simulation and real execution results reveal that $C^{3}$-MATCH achieves up to 67% lower completion time than three state-of-the-art methods with 10 ms-1000 ms higher transmission time.},  
keywords={},  
doi={10.1109/CLUSTER51413.2022.00021},  
ISSN={2168-9253},  
month={Sep.},}

About

Matching-based scheduling of asynchronous data processing workflows on the Cloud and Fog


Languages

Language:Python 97.5%Language:Shell 1.5%Language:Jupyter Notebook 0.7%Language:Dockerfile 0.3%