AdaMoR-DDMOEA: Adaptive Model Selection with a Reliable Individual-Based Model Management Framework for Offline Data-Driven Multi-Objective Optimization
Many real-world expensive industrial and engineering multi-objective optimization problems (MOPs) are driven by historical, experimental, or simulation data. In such scenarios, due to the expensive cost and time required, we are only left with a small amount of labeled data to perform the optimizati...
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2025-01-01
|
| Series: | Mathematics |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2227-7390/13/1/158 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1841549193112453120 |
|---|---|
| author | Subhadip Pramanik Abdalla Alameen Hitesh Mohapatra Debanjan Pathak Adrijit Goswami |
| author_facet | Subhadip Pramanik Abdalla Alameen Hitesh Mohapatra Debanjan Pathak Adrijit Goswami |
| author_sort | Subhadip Pramanik |
| collection | DOAJ |
| description | Many real-world expensive industrial and engineering multi-objective optimization problems (MOPs) are driven by historical, experimental, or simulation data. In such scenarios, due to the expensive cost and time required, we are only left with a small amount of labeled data to perform the optimization. These offline data-driven MOPs are usually solved by multi-objective evolutionary algorithms (MOEAs) with the help of surrogate models constructed from offline historical data. The key challenge in developing these data-driven MOEAs is that they have to replace multiple conflicting fitness functions by approximating these objective functions, which may produce cumulative approximation errors and misguide the search. In order to build a reliable surrogate model from a small amount of multi-output offline data and solve the DDMOPs, we have proposed an adaptive model selection method with a reliable individual-based model management-driven MOEA. The proposed algorithm dynamically selects between DNN and XGBoost by comparing their k-fold cross-validation MAE error, which can capture the true generalization ability of the surrogates on unseen data. Then, the selected surrogate is updated with a reliable individual selection strategy, where the individual who is closest, both in the decision and objective space, to the most preferred solution among labeled offline data is chosen. As a result, these two strategies guide the underlying MOEA to the Pareto optimal solutions. The empirical results of the ZDT and DTLZ benchmark test suite validate the use of the three state-of-the-art offline DDMOEAs, showing that our algorithm is able to achieve highly competitive results in terms of convergence and diversity for 2–3 objectives. Finally, our algorithm is applied to an offline data-driven multi-objective problem—transonic airfoil (RAE 2822) shape optimization—to validate its efficiency on real-world DDMOPs. |
| format | Article |
| id | doaj-art-febb2d968111464c823869037d4d8aca |
| institution | Kabale University |
| issn | 2227-7390 |
| language | English |
| publishDate | 2025-01-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Mathematics |
| spelling | doaj-art-febb2d968111464c823869037d4d8aca2025-01-10T13:18:27ZengMDPI AGMathematics2227-73902025-01-0113115810.3390/math13010158AdaMoR-DDMOEA: Adaptive Model Selection with a Reliable Individual-Based Model Management Framework for Offline Data-Driven Multi-Objective OptimizationSubhadip Pramanik0Abdalla Alameen1Hitesh Mohapatra2Debanjan Pathak3Adrijit Goswami4School of Computer Engineering, Kalinga Institute of Industrial Technology (KIIT) Deemed to Be University, Bhubaneswar 751024, IndiaDepartment of Computer Engineering and Informations, College of Engineering, Prince Sattam Bin Abdulaziz University, Wadi ad-Dawasir 11991, Saudi ArabiaSchool of Computer Engineering, Kalinga Institute of Industrial Technology (KIIT) Deemed to Be University, Bhubaneswar 751024, IndiaSchool of Computer Engineering, Kalinga Institute of Industrial Technology (KIIT) Deemed to Be University, Bhubaneswar 751024, IndiaDepartment of Mathematics, Indian Institute of Technology, Kharagpur 721302, IndiaMany real-world expensive industrial and engineering multi-objective optimization problems (MOPs) are driven by historical, experimental, or simulation data. In such scenarios, due to the expensive cost and time required, we are only left with a small amount of labeled data to perform the optimization. These offline data-driven MOPs are usually solved by multi-objective evolutionary algorithms (MOEAs) with the help of surrogate models constructed from offline historical data. The key challenge in developing these data-driven MOEAs is that they have to replace multiple conflicting fitness functions by approximating these objective functions, which may produce cumulative approximation errors and misguide the search. In order to build a reliable surrogate model from a small amount of multi-output offline data and solve the DDMOPs, we have proposed an adaptive model selection method with a reliable individual-based model management-driven MOEA. The proposed algorithm dynamically selects between DNN and XGBoost by comparing their k-fold cross-validation MAE error, which can capture the true generalization ability of the surrogates on unseen data. Then, the selected surrogate is updated with a reliable individual selection strategy, where the individual who is closest, both in the decision and objective space, to the most preferred solution among labeled offline data is chosen. As a result, these two strategies guide the underlying MOEA to the Pareto optimal solutions. The empirical results of the ZDT and DTLZ benchmark test suite validate the use of the three state-of-the-art offline DDMOEAs, showing that our algorithm is able to achieve highly competitive results in terms of convergence and diversity for 2–3 objectives. Finally, our algorithm is applied to an offline data-driven multi-objective problem—transonic airfoil (RAE 2822) shape optimization—to validate its efficiency on real-world DDMOPs.https://www.mdpi.com/2227-7390/13/1/158data-driven multi-objective optimizationdeep neural networkextreme gradient boostingoffline data-driven multi-objective evolutionary algorithmsurrogate models |
| spellingShingle | Subhadip Pramanik Abdalla Alameen Hitesh Mohapatra Debanjan Pathak Adrijit Goswami AdaMoR-DDMOEA: Adaptive Model Selection with a Reliable Individual-Based Model Management Framework for Offline Data-Driven Multi-Objective Optimization Mathematics data-driven multi-objective optimization deep neural network extreme gradient boosting offline data-driven multi-objective evolutionary algorithm surrogate models |
| title | AdaMoR-DDMOEA: Adaptive Model Selection with a Reliable Individual-Based Model Management Framework for Offline Data-Driven Multi-Objective Optimization |
| title_full | AdaMoR-DDMOEA: Adaptive Model Selection with a Reliable Individual-Based Model Management Framework for Offline Data-Driven Multi-Objective Optimization |
| title_fullStr | AdaMoR-DDMOEA: Adaptive Model Selection with a Reliable Individual-Based Model Management Framework for Offline Data-Driven Multi-Objective Optimization |
| title_full_unstemmed | AdaMoR-DDMOEA: Adaptive Model Selection with a Reliable Individual-Based Model Management Framework for Offline Data-Driven Multi-Objective Optimization |
| title_short | AdaMoR-DDMOEA: Adaptive Model Selection with a Reliable Individual-Based Model Management Framework for Offline Data-Driven Multi-Objective Optimization |
| title_sort | adamor ddmoea adaptive model selection with a reliable individual based model management framework for offline data driven multi objective optimization |
| topic | data-driven multi-objective optimization deep neural network extreme gradient boosting offline data-driven multi-objective evolutionary algorithm surrogate models |
| url | https://www.mdpi.com/2227-7390/13/1/158 |
| work_keys_str_mv | AT subhadippramanik adamorddmoeaadaptivemodelselectionwithareliableindividualbasedmodelmanagementframeworkforofflinedatadrivenmultiobjectiveoptimization AT abdallaalameen adamorddmoeaadaptivemodelselectionwithareliableindividualbasedmodelmanagementframeworkforofflinedatadrivenmultiobjectiveoptimization AT hiteshmohapatra adamorddmoeaadaptivemodelselectionwithareliableindividualbasedmodelmanagementframeworkforofflinedatadrivenmultiobjectiveoptimization AT debanjanpathak adamorddmoeaadaptivemodelselectionwithareliableindividualbasedmodelmanagementframeworkforofflinedatadrivenmultiobjectiveoptimization AT adrijitgoswami adamorddmoeaadaptivemodelselectionwithareliableindividualbasedmodelmanagementframeworkforofflinedatadrivenmultiobjectiveoptimization |