A systematic review of deep learning applications in database query execution

Abstract Modern database management systems (DBMS), primarily designed as general-purpose systems, face the challenging task of efficiently handling data from diverse sources for both analytical services and online transactional processing (OLTP). The volume of data has grown significantly, with dis...

Full description

Saved in:
Bibliographic Details
Main Authors: Bogdan Milicevic, Zoran Babovic
Format: Article
Language:English
Published: SpringerOpen 2024-12-01
Series:Journal of Big Data
Subjects:
Online Access:https://doi.org/10.1186/s40537-024-01025-1
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1850133835092590592
author Bogdan Milicevic
Zoran Babovic
author_facet Bogdan Milicevic
Zoran Babovic
author_sort Bogdan Milicevic
collection DOAJ
description Abstract Modern database management systems (DBMS), primarily designed as general-purpose systems, face the challenging task of efficiently handling data from diverse sources for both analytical services and online transactional processing (OLTP). The volume of data has grown significantly, with distributions ranging from linear to highly skewed, sometimes involving very slow changes or rapid, intensive updates. Recent research in this field has been significantly influenced by advances in machine learning (ML), particularly deep learning (DL), and these developments have led to the application of various ML algorithms to enhance the efficiency of different parts of the query execution engine. While previous research studies were mostly focused on identifying drawbacks to individual components, such as the query optimizer, there is a notable lack of studies examining the applicability and effectiveness of various machine learning approaches across multiple aspects of the query execution engine. This article aims to provide a systematic review of approaches that apply deep learning models at various levels within the query execution engine. We categorize these approaches into three groups based on how such models are applied: improving performance of index structures and consequently data manipulation algorithms, query optimization tasks, and externally controlling query optimizers through parameter tuning. Furthermore, we discuss the key challenges associated with implementing deep learning algorithms in DBMS.
format Article
id doaj-art-8995431d83d4440fad0eab0102122dca
institution OA Journals
issn 2196-1115
language English
publishDate 2024-12-01
publisher SpringerOpen
record_format Article
series Journal of Big Data
spelling doaj-art-8995431d83d4440fad0eab0102122dca2025-08-20T02:31:51ZengSpringerOpenJournal of Big Data2196-11152024-12-0111113810.1186/s40537-024-01025-1A systematic review of deep learning applications in database query executionBogdan Milicevic0Zoran Babovic1Faculty of Engineering, University of KragujevacInnovation Center of the School Of Electrical Engineering in BelgradeAbstract Modern database management systems (DBMS), primarily designed as general-purpose systems, face the challenging task of efficiently handling data from diverse sources for both analytical services and online transactional processing (OLTP). The volume of data has grown significantly, with distributions ranging from linear to highly skewed, sometimes involving very slow changes or rapid, intensive updates. Recent research in this field has been significantly influenced by advances in machine learning (ML), particularly deep learning (DL), and these developments have led to the application of various ML algorithms to enhance the efficiency of different parts of the query execution engine. While previous research studies were mostly focused on identifying drawbacks to individual components, such as the query optimizer, there is a notable lack of studies examining the applicability and effectiveness of various machine learning approaches across multiple aspects of the query execution engine. This article aims to provide a systematic review of approaches that apply deep learning models at various levels within the query execution engine. We categorize these approaches into three groups based on how such models are applied: improving performance of index structures and consequently data manipulation algorithms, query optimization tasks, and externally controlling query optimizers through parameter tuning. Furthermore, we discuss the key challenges associated with implementing deep learning algorithms in DBMS.https://doi.org/10.1186/s40537-024-01025-1Learned index structuresQuery optimizerCardinality estimationDatabase parameters tuningDeep learning
spellingShingle Bogdan Milicevic
Zoran Babovic
A systematic review of deep learning applications in database query execution
Journal of Big Data
Learned index structures
Query optimizer
Cardinality estimation
Database parameters tuning
Deep learning
title A systematic review of deep learning applications in database query execution
title_full A systematic review of deep learning applications in database query execution
title_fullStr A systematic review of deep learning applications in database query execution
title_full_unstemmed A systematic review of deep learning applications in database query execution
title_short A systematic review of deep learning applications in database query execution
title_sort systematic review of deep learning applications in database query execution
topic Learned index structures
Query optimizer
Cardinality estimation
Database parameters tuning
Deep learning
url https://doi.org/10.1186/s40537-024-01025-1
work_keys_str_mv AT bogdanmilicevic asystematicreviewofdeeplearningapplicationsindatabasequeryexecution
AT zoranbabovic asystematicreviewofdeeplearningapplicationsindatabasequeryexecution
AT bogdanmilicevic systematicreviewofdeeplearningapplicationsindatabasequeryexecution
AT zoranbabovic systematicreviewofdeeplearningapplicationsindatabasequeryexecution