ARCHITECTURE OF MODERN SYSTEMS OF MANAGING A SCIENTIFIC EXPERIMENT IN THE FIELD OF BIG DATA PROCESSING
The history of the development of experiment managemant systems has about 25 years – from small prototype desktop applications to scalable distributed systems. EMS systems are becoming more popular and more complex. A new stage in the development of EMS systems was the beginning of the «era of big d...
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Tomsk Polytechnic University
2023-03-01
|
| Series: | Известия Томского политехнического университета: Промышленная кибернетика |
| Subjects: | |
| Online Access: | https://indcyb.ru/journal/article/view/6/4 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849433476651024384 |
|---|---|
| author | Anastasiia Y. Kaida Aleksei O. Savelev |
| author_facet | Anastasiia Y. Kaida Aleksei O. Savelev |
| author_sort | Anastasiia Y. Kaida |
| collection | DOAJ |
| description | The history of the development of experiment managemant systems has about 25 years – from small prototype desktop applications to scalable distributed systems. EMS systems are becoming more popular and more complex. A new stage in the development of EMS systems was the beginning of the «era of big data», which processing, analysis and storage take place in a special ecosystem. The big data ecosystem implies new elements that must be taken into account when designing an EMS system to support the full data lifecycle. One of the key challenges is to generalize those EMS systems that have arisen and changed as related technologies have developed, while, at the moment, there is no single design pattern for such systems due to the features of each specific project for which such a system is created. This paper presents a conceptual high-level architecture of an EMS system as an example of a unified pattern suitable for a big data ecosystem. It is important to note that the proposed pattern does not imply work using grid systems. |
| format | Article |
| id | doaj-art-25e1346a5a7a4153bba03d3dd4f2fc29 |
| institution | Kabale University |
| issn | 2949-5407 |
| language | English |
| publishDate | 2023-03-01 |
| publisher | Tomsk Polytechnic University |
| record_format | Article |
| series | Известия Томского политехнического университета: Промышленная кибернетика |
| spelling | doaj-art-25e1346a5a7a4153bba03d3dd4f2fc292025-08-20T03:27:01ZengTomsk Polytechnic UniversityИзвестия Томского политехнического университета: Промышленная кибернетика2949-54072023-03-0111242710.18799/29495407/2023/1/6ARCHITECTURE OF MODERN SYSTEMS OF MANAGING A SCIENTIFIC EXPERIMENT IN THE FIELD OF BIG DATA PROCESSINGAnastasiia Y. Kaida0Aleksei O. Savelev1National Research Tomsk Polytechnic University, RussiaNational Research Tomsk Polytechnic University, RussiaThe history of the development of experiment managemant systems has about 25 years – from small prototype desktop applications to scalable distributed systems. EMS systems are becoming more popular and more complex. A new stage in the development of EMS systems was the beginning of the «era of big data», which processing, analysis and storage take place in a special ecosystem. The big data ecosystem implies new elements that must be taken into account when designing an EMS system to support the full data lifecycle. One of the key challenges is to generalize those EMS systems that have arisen and changed as related technologies have developed, while, at the moment, there is no single design pattern for such systems due to the features of each specific project for which such a system is created. This paper presents a conceptual high-level architecture of an EMS system as an example of a unified pattern suitable for a big data ecosystem. It is important to note that the proposed pattern does not imply work using grid systems.https://indcyb.ru/journal/article/view/6/4big dataexperiment management systemdata life cycledata processingknowledge bases |
| spellingShingle | Anastasiia Y. Kaida Aleksei O. Savelev ARCHITECTURE OF MODERN SYSTEMS OF MANAGING A SCIENTIFIC EXPERIMENT IN THE FIELD OF BIG DATA PROCESSING Известия Томского политехнического университета: Промышленная кибернетика big data experiment management system data life cycle data processing knowledge bases |
| title | ARCHITECTURE OF MODERN SYSTEMS OF MANAGING A SCIENTIFIC EXPERIMENT IN THE FIELD OF BIG DATA PROCESSING |
| title_full | ARCHITECTURE OF MODERN SYSTEMS OF MANAGING A SCIENTIFIC EXPERIMENT IN THE FIELD OF BIG DATA PROCESSING |
| title_fullStr | ARCHITECTURE OF MODERN SYSTEMS OF MANAGING A SCIENTIFIC EXPERIMENT IN THE FIELD OF BIG DATA PROCESSING |
| title_full_unstemmed | ARCHITECTURE OF MODERN SYSTEMS OF MANAGING A SCIENTIFIC EXPERIMENT IN THE FIELD OF BIG DATA PROCESSING |
| title_short | ARCHITECTURE OF MODERN SYSTEMS OF MANAGING A SCIENTIFIC EXPERIMENT IN THE FIELD OF BIG DATA PROCESSING |
| title_sort | architecture of modern systems of managing a scientific experiment in the field of big data processing |
| topic | big data experiment management system data life cycle data processing knowledge bases |
| url | https://indcyb.ru/journal/article/view/6/4 |
| work_keys_str_mv | AT anastasiiaykaida architectureofmodernsystemsofmanagingascientificexperimentinthefieldofbigdataprocessing AT alekseiosavelev architectureofmodernsystemsofmanagingascientificexperimentinthefieldofbigdataprocessing |