Optimizing HVAC&R System Efficiency and Comfort Levels Using Machine Learning-Based Control Methods
The Heating, Ventilation, Air Conditioning, and Refrigeration (HVAC&R) system is a complex, nonlinear behavior with a high uncertainty control system that equips the thermal comfort desired but consumes significant electrical energy and costs in different types of buildings, such as residential...
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Tikrit University
2025-05-01
|
| Series: | Tikrit Journal of Engineering Sciences |
| Subjects: | |
| Online Access: | https://tj-es.com/ojs/index.php/tjes/article/view/1614 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849467963066810368 |
|---|---|
| author | Suroor M. Dawood Raad Z. Homod Alireza Hatami |
| author_facet | Suroor M. Dawood Raad Z. Homod Alireza Hatami |
| author_sort | Suroor M. Dawood |
| collection | DOAJ |
| description |
The Heating, Ventilation, Air Conditioning, and Refrigeration (HVAC&R) system is a complex, nonlinear behavior with a high uncertainty control system that equips the thermal comfort desired but consumes significant electrical energy and costs in different types of buildings, such as residential, commercial, and industrial. This paper introduces a new approach for online controlling of HVAC&R systems using model-based reinforcement learning (MB-RL) style to diminish energy usage and energy cost, maintain the occupants’ comfort levels by controlling the buildings' indoor temperature, and maintain the desired carbon dioxide levels simultaneously. For this purpose, a new model based on energy and mass conservation laws is presented to model the dynamic variations of temperature and CO2 concentration levels. The HVAC&R system control trouble is defined as a specific Markov Decision Processes (MDPs) model. The reward function balances the ability to increase energy conservation while preserving the interior comfort requirements of occupants. Employing the deterministic policy algorithm (DP), the proposed methodology can manage the dimensionality curse problem due to increased state-action space. Then, it overcomes the nonlinearity and the control system uncertainty. The MB-RL algorithm, which uses a unique DP called DP-MB-RL, can select the best decisions instead of stochastic policy to reduce the calculation time. A real case, a building in Basra City, Iraq, is simulated using MATLAB software. Devoting the MB-RL and DP-MB-RL techniques to online control of an HVAC&R system, the simulation results for both methods are provided. For instance, the parameters, like electrical power, internal comfort levels, energy consumed, and energy cost at different pricing schemes, such as fixed pricing (FP), time-of-use (TOU), and real-time pricing (RTP), are assessed. The results indicated that the suggested DP-MB-RL methodology had better indoor thermal and air quality satisfaction levels, energy-saving (more than 15%), and reduced the cost of electricity by more than 15%, 13%, and 10% for FP, TOU, and RTP pricing schemes, respectively, compared to the benchmark MB-RL style controller. The DP-MB-RL controller also performed better than the Takagi-Sugeno Fuzzy (TSF) controller for the same building, saving more than 21% energy.
|
| format | Article |
| id | doaj-art-655c2a486fdb4d1f9bde7b9f041afc57 |
| institution | Kabale University |
| issn | 1813-162X 2312-7589 |
| language | English |
| publishDate | 2025-05-01 |
| publisher | Tikrit University |
| record_format | Article |
| series | Tikrit Journal of Engineering Sciences |
| spelling | doaj-art-655c2a486fdb4d1f9bde7b9f041afc572025-08-20T03:25:59ZengTikrit UniversityTikrit Journal of Engineering Sciences1813-162X2312-75892025-05-0132210.25130/tjes.32.2.25Optimizing HVAC&R System Efficiency and Comfort Levels Using Machine Learning-Based Control MethodsSuroor M. Dawood0https://orcid.org/0000-0003-4946-4503Raad Z. Homod1https://orcid.org/0000-0002-4161-7539Alireza Hatami2https://orcid.org/0000-0002-0370-3903Department of Chemical and Petroleum Refining Engineering, College of Oil and Gas Engineering, Basra University for Oil and Gas, Basrah, Iraq.Department of Oil and Gas, College of Oil and Gas Engineering, Basra University for Oil and Gas, Basrah, Iraq.Department of Electrical Engineering, Faculty of Engineering, Bu-Ali Sina University, Hamedan, Iran. The Heating, Ventilation, Air Conditioning, and Refrigeration (HVAC&R) system is a complex, nonlinear behavior with a high uncertainty control system that equips the thermal comfort desired but consumes significant electrical energy and costs in different types of buildings, such as residential, commercial, and industrial. This paper introduces a new approach for online controlling of HVAC&R systems using model-based reinforcement learning (MB-RL) style to diminish energy usage and energy cost, maintain the occupants’ comfort levels by controlling the buildings' indoor temperature, and maintain the desired carbon dioxide levels simultaneously. For this purpose, a new model based on energy and mass conservation laws is presented to model the dynamic variations of temperature and CO2 concentration levels. The HVAC&R system control trouble is defined as a specific Markov Decision Processes (MDPs) model. The reward function balances the ability to increase energy conservation while preserving the interior comfort requirements of occupants. Employing the deterministic policy algorithm (DP), the proposed methodology can manage the dimensionality curse problem due to increased state-action space. Then, it overcomes the nonlinearity and the control system uncertainty. The MB-RL algorithm, which uses a unique DP called DP-MB-RL, can select the best decisions instead of stochastic policy to reduce the calculation time. A real case, a building in Basra City, Iraq, is simulated using MATLAB software. Devoting the MB-RL and DP-MB-RL techniques to online control of an HVAC&R system, the simulation results for both methods are provided. For instance, the parameters, like electrical power, internal comfort levels, energy consumed, and energy cost at different pricing schemes, such as fixed pricing (FP), time-of-use (TOU), and real-time pricing (RTP), are assessed. The results indicated that the suggested DP-MB-RL methodology had better indoor thermal and air quality satisfaction levels, energy-saving (more than 15%), and reduced the cost of electricity by more than 15%, 13%, and 10% for FP, TOU, and RTP pricing schemes, respectively, compared to the benchmark MB-RL style controller. The DP-MB-RL controller also performed better than the Takagi-Sugeno Fuzzy (TSF) controller for the same building, saving more than 21% energy. https://tj-es.com/ojs/index.php/tjes/article/view/1614Deterministic policyEnergy savingHVAC&R systemMachine learningModel-based reinforcement learning |
| spellingShingle | Suroor M. Dawood Raad Z. Homod Alireza Hatami Optimizing HVAC&R System Efficiency and Comfort Levels Using Machine Learning-Based Control Methods Tikrit Journal of Engineering Sciences Deterministic policy Energy saving HVAC&R system Machine learning Model-based reinforcement learning |
| title | Optimizing HVAC&R System Efficiency and Comfort Levels Using Machine Learning-Based Control Methods |
| title_full | Optimizing HVAC&R System Efficiency and Comfort Levels Using Machine Learning-Based Control Methods |
| title_fullStr | Optimizing HVAC&R System Efficiency and Comfort Levels Using Machine Learning-Based Control Methods |
| title_full_unstemmed | Optimizing HVAC&R System Efficiency and Comfort Levels Using Machine Learning-Based Control Methods |
| title_short | Optimizing HVAC&R System Efficiency and Comfort Levels Using Machine Learning-Based Control Methods |
| title_sort | optimizing hvac r system efficiency and comfort levels using machine learning based control methods |
| topic | Deterministic policy Energy saving HVAC&R system Machine learning Model-based reinforcement learning |
| url | https://tj-es.com/ojs/index.php/tjes/article/view/1614 |
| work_keys_str_mv | AT suroormdawood optimizinghvacrsystemefficiencyandcomfortlevelsusingmachinelearningbasedcontrolmethods AT raadzhomod optimizinghvacrsystemefficiencyandcomfortlevelsusingmachinelearningbasedcontrolmethods AT alirezahatami optimizinghvacrsystemefficiencyandcomfortlevelsusingmachinelearningbasedcontrolmethods |