Enhanced vehicle routing for medical waste management via hybrid deep reinforcement learning and optimization algorithms
Modern technologies, particularly artificial intelligence, play a crucial role in improving medical waste management by developing intelligent systems that optimize the shortest routes for waste transport, from its generation to final disposal. Algorithms such as Q-learning and Deep Q Network enhanc...
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Frontiers Media S.A.
2025-02-01
|
| Series: | Frontiers in Artificial Intelligence |
| Subjects: | |
| Online Access: | https://www.frontiersin.org/articles/10.3389/frai.2025.1496653/full |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1823856484863180800 |
|---|---|
| author | Norhan Khallaf Osama Abd-El Rouf Abeer D. Algarni Mohy Hadhoud Ahmed Kafafy |
| author_facet | Norhan Khallaf Osama Abd-El Rouf Abeer D. Algarni Mohy Hadhoud Ahmed Kafafy |
| author_sort | Norhan Khallaf |
| collection | DOAJ |
| description | Modern technologies, particularly artificial intelligence, play a crucial role in improving medical waste management by developing intelligent systems that optimize the shortest routes for waste transport, from its generation to final disposal. Algorithms such as Q-learning and Deep Q Network enhance the efficiency of transport and disposal while reducing environmental pollution risks. In this study, artificial intelligence algorithms were trained using Homogeneous agent systems with a capacity of 3 tons to optimize routes between hospitals within the Closed Capacitated Vehicle Routing Problem framework. Integrating AI with pathfinding techniques, especially the hybrid A*-Deep Q Network approach, led to advanced results despite initial challenges. K-means clustering was used to divide hospitals into zones, allowing agents to navigate the shortest paths using the Deep Q Network. Analysis revealed that the agents’ capacity was not fully utilized. This led to the application of Fractional Knapsack dynamic programming with Deep Q Network to maximize capacity utilization while achieving optimal routes. Since the criteria used to compare the algorithms’ effectiveness are the number of vehicles and the utilization of the total vehicle capacity, it was found that the Fractional Knapsack with DQN stands out by requiring the fewest number of vehicles (4), achieving 0% loss in this metric as it matches the optimal value. Compared to other algorithms that require 5 or 7 vehicles, it reduces the fleet size by 20 and 42.86%, respectively. Additionally, it maximizes vehicle capacity utilization at 100%, unlike other methods, which utilize only 33 to 66% of vehicle capacity. However, this improvement comes at the cost of a 9% increase in distance, reflecting the longer routes needed to serve more hospitals per trip. Despite this trade-off, the algorithm’s ability to minimize fleet size while fully utilizing vehicle capacity makes it the optimal choice in scenarios where these factors are critical. This approach not only improved performance but also enhanced environmental sustainability, making it the most effective and challenging solution among all the algorithms used in the study. |
| format | Article |
| id | doaj-art-32b015da035d480aa4f07eee8d2dd2fe |
| institution | Kabale University |
| issn | 2624-8212 |
| language | English |
| publishDate | 2025-02-01 |
| publisher | Frontiers Media S.A. |
| record_format | Article |
| series | Frontiers in Artificial Intelligence |
| spelling | doaj-art-32b015da035d480aa4f07eee8d2dd2fe2025-02-12T07:26:35ZengFrontiers Media S.A.Frontiers in Artificial Intelligence2624-82122025-02-01810.3389/frai.2025.14966531496653Enhanced vehicle routing for medical waste management via hybrid deep reinforcement learning and optimization algorithmsNorhan Khallaf0Osama Abd-El Rouf1Abeer D. Algarni2Mohy Hadhoud3Ahmed Kafafy4Machine Learning Department, Faculty of Artificial Intelligence, Menoufia University, Menoufia, EgyptMachine Learning Department, Faculty of Artificial Intelligence, Menoufia University, Menoufia, EgyptCollege of Computer and Information Sciences, Princess Nourah Bint Abdulrahman University, Riyadh, Saudi ArabiaFaculty of Computer and Information, Menoufia University, Menoufia, EgyptData Science Department, Faculty of Artificial Intelligence, Menoufia University, Menoufia, EgyptModern technologies, particularly artificial intelligence, play a crucial role in improving medical waste management by developing intelligent systems that optimize the shortest routes for waste transport, from its generation to final disposal. Algorithms such as Q-learning and Deep Q Network enhance the efficiency of transport and disposal while reducing environmental pollution risks. In this study, artificial intelligence algorithms were trained using Homogeneous agent systems with a capacity of 3 tons to optimize routes between hospitals within the Closed Capacitated Vehicle Routing Problem framework. Integrating AI with pathfinding techniques, especially the hybrid A*-Deep Q Network approach, led to advanced results despite initial challenges. K-means clustering was used to divide hospitals into zones, allowing agents to navigate the shortest paths using the Deep Q Network. Analysis revealed that the agents’ capacity was not fully utilized. This led to the application of Fractional Knapsack dynamic programming with Deep Q Network to maximize capacity utilization while achieving optimal routes. Since the criteria used to compare the algorithms’ effectiveness are the number of vehicles and the utilization of the total vehicle capacity, it was found that the Fractional Knapsack with DQN stands out by requiring the fewest number of vehicles (4), achieving 0% loss in this metric as it matches the optimal value. Compared to other algorithms that require 5 or 7 vehicles, it reduces the fleet size by 20 and 42.86%, respectively. Additionally, it maximizes vehicle capacity utilization at 100%, unlike other methods, which utilize only 33 to 66% of vehicle capacity. However, this improvement comes at the cost of a 9% increase in distance, reflecting the longer routes needed to serve more hospitals per trip. Despite this trade-off, the algorithm’s ability to minimize fleet size while fully utilizing vehicle capacity makes it the optimal choice in scenarios where these factors are critical. This approach not only improved performance but also enhanced environmental sustainability, making it the most effective and challenging solution among all the algorithms used in the study.https://www.frontiersin.org/articles/10.3389/frai.2025.1496653/fullclosed capacity vehicle routing problemQ learningDQNmedical waste routing optimizationunsupervised learning algorithmhybrid optimization algorithms |
| spellingShingle | Norhan Khallaf Osama Abd-El Rouf Abeer D. Algarni Mohy Hadhoud Ahmed Kafafy Enhanced vehicle routing for medical waste management via hybrid deep reinforcement learning and optimization algorithms Frontiers in Artificial Intelligence closed capacity vehicle routing problem Q learning DQN medical waste routing optimization unsupervised learning algorithm hybrid optimization algorithms |
| title | Enhanced vehicle routing for medical waste management via hybrid deep reinforcement learning and optimization algorithms |
| title_full | Enhanced vehicle routing for medical waste management via hybrid deep reinforcement learning and optimization algorithms |
| title_fullStr | Enhanced vehicle routing for medical waste management via hybrid deep reinforcement learning and optimization algorithms |
| title_full_unstemmed | Enhanced vehicle routing for medical waste management via hybrid deep reinforcement learning and optimization algorithms |
| title_short | Enhanced vehicle routing for medical waste management via hybrid deep reinforcement learning and optimization algorithms |
| title_sort | enhanced vehicle routing for medical waste management via hybrid deep reinforcement learning and optimization algorithms |
| topic | closed capacity vehicle routing problem Q learning DQN medical waste routing optimization unsupervised learning algorithm hybrid optimization algorithms |
| url | https://www.frontiersin.org/articles/10.3389/frai.2025.1496653/full |
| work_keys_str_mv | AT norhankhallaf enhancedvehicleroutingformedicalwastemanagementviahybriddeepreinforcementlearningandoptimizationalgorithms AT osamaabdelrouf enhancedvehicleroutingformedicalwastemanagementviahybriddeepreinforcementlearningandoptimizationalgorithms AT abeerdalgarni enhancedvehicleroutingformedicalwastemanagementviahybriddeepreinforcementlearningandoptimizationalgorithms AT mohyhadhoud enhancedvehicleroutingformedicalwastemanagementviahybriddeepreinforcementlearningandoptimizationalgorithms AT ahmedkafafy enhancedvehicleroutingformedicalwastemanagementviahybriddeepreinforcementlearningandoptimizationalgorithms |