Leveraging Reinforcement Learning for Efficient Task Scheduling in Multi-Cloud Environments

Prasanna Sankaran; Shiva Kiran Lingishetty; Mrinal Kumar

doi:10.55524/ijircst.2025.13.2.6

Abstract

Efficient task scheduling in multi-cloud environments is crucial for optimizing resource utilization, reducing execution time, minimizing costs, and enhancing overall system performance. Traditional scheduling approaches, including heuristic and rule-based methods, often struggle with dynamic workload fluctuations and resource heterogeneity, leading to inefficiencies. This study proposes a reinforcement learning-based scheduling framework that dynamically adapts to real-time cloud conditions to optimize task allocation. The problem is formulated as a Markov Decision Process (MDP), and a deep reinforcement learning model is trained to learn optimal scheduling policies. Experimental results demonstrate that the proposed approach significantly reduces makespan, improves resource utilization, lowers energy consumption, and decreases operational costs compared to traditional scheduling methods. The model successfully adapts to varying workload intensities and different cloud configurations, proving its scalability and robustness. Comparative analysis with heuristic-based and rule-based scheduling techniques further validates the superiority of reinforcement learning in optimizing multi-cloud task scheduling. Despite initial computational overhead during training, the proposed model offers long-term performance benefits, making it a viable solution for real-world cloud computing applications. The study highlights the potential of reinforcement learning to revolutionize cloud resource management and lays the foundation for future advancements in autonomous, intelligent cloud scheduling frameworks.

Keywords

Reinforcement Learning, Task Scheduling, Multi-Cloud Computing, Resource Optimization, Deep Learning.

References

S. Mangalampalli et al., "Efficient deep reinforcement learning-based task scheduler in multi-cloud environment," Scientific Reports, vol. 14, no. 1, p. 19179, 2024. Available from: https://doi.org/10.1038/s41598-024-72774-5.
Y. Cheng, X. Zhang, and Y. Liu, "Multi-objective dynamic task scheduling optimization algorithm based on deep reinforcement learning," The Journal of Supercomputing, 2023. Available from: https://tinyurl.com/mrx6hszr
J. Uma, P. Vivekanandan, and S. Shankar, "Optimized intellectual resource scheduling using deep reinforcement Q-learning in cloud computing," Transactions on Emerging Telecommunications Technologies, vol. 33, no. 1, p. e4463, 2022. Available from: https://doi.org/10.1002/ett.4463.
G. Zhou, W. Tian, R. Buyya, R. Xue, and L. Song, "Deep reinforcement learning-based methods for resource scheduling in cloud computing: A review and future directions," arXiv preprint arXiv:2105.04086, 2021. Available from: https://arxiv.org/abs/2105.04086.
Y. Gu et al., "Deep reinforcement learning for job scheduling and resource management in cloud computing: An algorithm-level review," arXiv preprint arXiv:2501.01007, 2025. Available from: https://arxiv.org/abs/2501.01007.
A. Jayanetti, S. Halgamuge, and R. Buyya, "Reinforcement learning-based workflow scheduling in cloud and edge computing environments: A taxonomy, review, and future directions," arXiv preprint arXiv:2408.02938, 2024. Available from: https://arxiv.org/abs/2408.02938.
Z. Xu, Y. Gong, Y. Zhou, Q. Bao, and W. Qian, "Enhancing Kubernetes automated scheduling with deep learning and reinforcement techniques for large-scale cloud computing optimization," arXiv preprint arXiv:2403.07905, 2024. Available from: https://arxiv.org/abs/2403.07905.
K. Dubey and S. C. Sharma, "A novel multi-objective CR-PSO task scheduling algorithm with deadline constraint in cloud computing," Sustainable Computing: Informatics and Systems, vol. 32, p. 100605, 2021. Available from: https://doi.org/10.1016/j.suscom.2021.100605.
N. Elsakaan and K. Amroun, "A novel multi-level hybrid load balancing and tasks scheduling algorithm for cloud computing environment," The Journal of Supercomputing, vol. 10, p. 71853, 2024. Available from: https://doi.org/10.1007/s11227-024-05990-5.
S. Mangalampalli, K. G. Reddy, S. N. Mohanty, and E. A. A. Ismail, "Fault tolerant trust-based task scheduler using Harris Hawks optimization and deep reinforcement learning in multi-cloud environment," Scientific Reports, vol. 13, no. 1, p. 19179, 2023. Available from: https://tinyurl.com/4te89bzu
Y. Cheng, X. Zhang, and Y. Liu, "Multi-objective dynamic task scheduling optimization algorithm based on deep reinforcement learning," The Journal of Supercomputing, 2023. Available from: https://tinyurl.com/mrx6hszr
J. Uma, P. Vivekanandan, and S. Shankar, "Optimized intellectual resource scheduling using deep reinforcement Q-learning in cloud computing," Transactions on Emerging Telecommunications Technologies, vol. 33, no. 1, p. e4463, 2022. Available from: https://doi.org/10.1002/ett.4463.
G. Zhou, W. Tian, R. Buyya, R. Xue, and L. Song, "Deep reinforcement learning-based methods for resource scheduling in cloud computing: A review and future directions," arXiv preprint arXiv:2105.04086, 2021. Available from: https://arxiv.org/abs/2105.04086.
Y. Gu et al., "Deep reinforcement learning for job scheduling and resource management in cloud computing: An algorithm-level review," arXiv preprint arXiv:2501.01007, 2025. Available from: https://arxiv.org/abs/2501.01007.
A. Jayanetti, S. Halgamuge, and R. Buyya, "Reinforcement learning-based workflow scheduling in cloud and edge computing environments: A taxonomy, review, and future directions," arXiv preprint arXiv:2408.02938, 2024. Available from: https://arxiv.org/abs/2408.02938.

Cites this article as

P. Sankaran, S. K. Lingishetty, M. Kumar, "Leveraging Reinforcement Learning for Efficient Task Scheduling in Multi-Cloud Environments", International Journal of Innovative Research in Computer Science and Technology (IJIRCST), Vol-13, Issue-2, Page No-35-41, 2025. Available from: https://doi.org/10.55524/ijircst.2025.13.2.6

Corresponding Author

Mrinal Kumar

School of Computer Science and Engineering, Guru Jambheshwar University of Science and Technology, Hisar, School of Computer Science and Engineering, Guru Jambheshwar University of Science and Technology, H, School of Computer Science and Engineering, Guru Jambheshwar University of Science and Technology, Hisar, Hisar, India

Download Full Paper

Download PDF

No. of Downloads: 33 | No. of Views: 3099

Leveraging Reinforcement Learning for Efficient Task Scheduling in Multi-Cloud Environments

Citations

Total View 3099

Total Download 33