An Active-Set Algorithm for Convex Quadratic Programming Subject to Box Constraints with Applications in Non-Linear Optimization and Machine Learning
A quadratic programming problem with positive definite Hessian subject to box constraints is solved, using an active-set approach. Convex quadratic programming (QP) problems with box constraints appear quite frequently in various real-world applications. The proposed method employs an active-set str...
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2025-04-01
|
| Series: | Mathematics |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2227-7390/13/9/1467 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850032168267415552 |
|---|---|
| author | Konstantinos Vogklis Isaac E. Lagaris |
| author_facet | Konstantinos Vogklis Isaac E. Lagaris |
| author_sort | Konstantinos Vogklis |
| collection | DOAJ |
| description | A quadratic programming problem with positive definite Hessian subject to box constraints is solved, using an active-set approach. Convex quadratic programming (QP) problems with box constraints appear quite frequently in various real-world applications. The proposed method employs an active-set strategy with Lagrange multipliers, demonstrating rapid convergence. The algorithm, at each iteration, modifies both the minimization parameters in the primal space and the Lagrange multipliers in the dual space. The algorithm is particularly well suited for machine learning, scientific computing, and engineering applications that require solving box constraint QP subproblems efficiently. Key use cases include Support Vector Machines (SVMs), reinforcement learning, portfolio optimization, and trust-region methods in non-linear programming. Extensive numerical experiments demonstrate the method’s superior performance in handling large-scale problems, making it an ideal choice for contemporary optimization tasks. To encourage and facilitate its adoption, the implementation is available in multiple programming languages, ensuring easy integration into existing optimization frameworks. |
| format | Article |
| id | doaj-art-248d7f8d8e104dd69520653dfa6006b9 |
| institution | DOAJ |
| issn | 2227-7390 |
| language | English |
| publishDate | 2025-04-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Mathematics |
| spelling | doaj-art-248d7f8d8e104dd69520653dfa6006b92025-08-20T02:58:44ZengMDPI AGMathematics2227-73902025-04-01139146710.3390/math13091467An Active-Set Algorithm for Convex Quadratic Programming Subject to Box Constraints with Applications in Non-Linear Optimization and Machine LearningKonstantinos Vogklis0Isaac E. Lagaris1Department of Tourism, Ionian University, 49100 Kerkira, GreeceDepartment of Computer Science and Engineering, University of Ioannina, 45110 Ioannina, GreeceA quadratic programming problem with positive definite Hessian subject to box constraints is solved, using an active-set approach. Convex quadratic programming (QP) problems with box constraints appear quite frequently in various real-world applications. The proposed method employs an active-set strategy with Lagrange multipliers, demonstrating rapid convergence. The algorithm, at each iteration, modifies both the minimization parameters in the primal space and the Lagrange multipliers in the dual space. The algorithm is particularly well suited for machine learning, scientific computing, and engineering applications that require solving box constraint QP subproblems efficiently. Key use cases include Support Vector Machines (SVMs), reinforcement learning, portfolio optimization, and trust-region methods in non-linear programming. Extensive numerical experiments demonstrate the method’s superior performance in handling large-scale problems, making it an ideal choice for contemporary optimization tasks. To encourage and facilitate its adoption, the implementation is available in multiple programming languages, ensuring easy integration into existing optimization frameworks.https://www.mdpi.com/2227-7390/13/9/1467convex quadratic programmingmachine learningoptimizationactive setLagrange multiplierspractical applications |
| spellingShingle | Konstantinos Vogklis Isaac E. Lagaris An Active-Set Algorithm for Convex Quadratic Programming Subject to Box Constraints with Applications in Non-Linear Optimization and Machine Learning Mathematics convex quadratic programming machine learning optimization active set Lagrange multipliers practical applications |
| title | An Active-Set Algorithm for Convex Quadratic Programming Subject to Box Constraints with Applications in Non-Linear Optimization and Machine Learning |
| title_full | An Active-Set Algorithm for Convex Quadratic Programming Subject to Box Constraints with Applications in Non-Linear Optimization and Machine Learning |
| title_fullStr | An Active-Set Algorithm for Convex Quadratic Programming Subject to Box Constraints with Applications in Non-Linear Optimization and Machine Learning |
| title_full_unstemmed | An Active-Set Algorithm for Convex Quadratic Programming Subject to Box Constraints with Applications in Non-Linear Optimization and Machine Learning |
| title_short | An Active-Set Algorithm for Convex Quadratic Programming Subject to Box Constraints with Applications in Non-Linear Optimization and Machine Learning |
| title_sort | active set algorithm for convex quadratic programming subject to box constraints with applications in non linear optimization and machine learning |
| topic | convex quadratic programming machine learning optimization active set Lagrange multipliers practical applications |
| url | https://www.mdpi.com/2227-7390/13/9/1467 |
| work_keys_str_mv | AT konstantinosvogklis anactivesetalgorithmforconvexquadraticprogrammingsubjecttoboxconstraintswithapplicationsinnonlinearoptimizationandmachinelearning AT isaacelagaris anactivesetalgorithmforconvexquadraticprogrammingsubjecttoboxconstraintswithapplicationsinnonlinearoptimizationandmachinelearning AT konstantinosvogklis activesetalgorithmforconvexquadraticprogrammingsubjecttoboxconstraintswithapplicationsinnonlinearoptimizationandmachinelearning AT isaacelagaris activesetalgorithmforconvexquadraticprogrammingsubjecttoboxconstraintswithapplicationsinnonlinearoptimizationandmachinelearning |