Omilayers: a Python package for efficient data management to support multi-omic analysis

Abstract Multi-omic integration involves the management of diverse omic datasets. Conducting an effective analysis of these datasets necessitates a data management system that meets a specific set of requirements, such as rapid storage and retrieval of data with varying numbers of features and mixed...

Full description

Saved in:
Bibliographic Details
Main Author: Dimitrios Kioroglou
Format: Article
Language:English
Published: BMC 2025-02-01
Series:BMC Bioinformatics
Subjects:
Online Access:https://doi.org/10.1186/s12859-025-06067-7
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1823861577380528128
author Dimitrios Kioroglou
author_facet Dimitrios Kioroglou
author_sort Dimitrios Kioroglou
collection DOAJ
description Abstract Multi-omic integration involves the management of diverse omic datasets. Conducting an effective analysis of these datasets necessitates a data management system that meets a specific set of requirements, such as rapid storage and retrieval of data with varying numbers of features and mixed data-types, ensurance of reliable and secure database transactions, extension of stored data row and column-wise and facilitation of data distribution. SQLite and DuckDB are embedded databases that fulfil these requirements. However, they utilize the structured query language (SQL) that hinders their implementation by the uninitiated user, and complicates their use in repetitive tasks due to the necessity of writing SQL queries. This study offers Omilayers, a Python package that encapsulates these two databases and exposes a subset of their functionality that is geared towards frequent and repetitive analytical procedures. Synthetic data were used to demonstrate the use of Omilayers and compare the performance of SQLite and DuckDB.
format Article
id doaj-art-936094483d204f969d8d56e8630257aa
institution Kabale University
issn 1471-2105
language English
publishDate 2025-02-01
publisher BMC
record_format Article
series BMC Bioinformatics
spelling doaj-art-936094483d204f969d8d56e8630257aa2025-02-09T12:57:00ZengBMCBMC Bioinformatics1471-21052025-02-0126111110.1186/s12859-025-06067-7Omilayers: a Python package for efficient data management to support multi-omic analysisDimitrios Kioroglou0Integrative Genomics Lab, Center for Cooperative Research in Biosciences (CIC bioGUNE), Basque Research and Technology Alliance (BRTA)Abstract Multi-omic integration involves the management of diverse omic datasets. Conducting an effective analysis of these datasets necessitates a data management system that meets a specific set of requirements, such as rapid storage and retrieval of data with varying numbers of features and mixed data-types, ensurance of reliable and secure database transactions, extension of stored data row and column-wise and facilitation of data distribution. SQLite and DuckDB are embedded databases that fulfil these requirements. However, they utilize the structured query language (SQL) that hinders their implementation by the uninitiated user, and complicates their use in repetitive tasks due to the necessity of writing SQL queries. This study offers Omilayers, a Python package that encapsulates these two databases and exposes a subset of their functionality that is geared towards frequent and repetitive analytical procedures. Synthetic data were used to demonstrate the use of Omilayers and compare the performance of SQLite and DuckDB.https://doi.org/10.1186/s12859-025-06067-7Multi-omicsData managementDatabasesPython
spellingShingle Dimitrios Kioroglou
Omilayers: a Python package for efficient data management to support multi-omic analysis
BMC Bioinformatics
Multi-omics
Data management
Databases
Python
title Omilayers: a Python package for efficient data management to support multi-omic analysis
title_full Omilayers: a Python package for efficient data management to support multi-omic analysis
title_fullStr Omilayers: a Python package for efficient data management to support multi-omic analysis
title_full_unstemmed Omilayers: a Python package for efficient data management to support multi-omic analysis
title_short Omilayers: a Python package for efficient data management to support multi-omic analysis
title_sort omilayers a python package for efficient data management to support multi omic analysis
topic Multi-omics
Data management
Databases
Python
url https://doi.org/10.1186/s12859-025-06067-7
work_keys_str_mv AT dimitrioskioroglou omilayersapythonpackageforefficientdatamanagementtosupportmultiomicanalysis