Research and practice on working flow engine of big data platform for gaming service
The big data platform for gaming service is based on Hadoop open source technology. With the demand growth of the service operation staff，there are more and more jobs which depend on each other running on the big data platform. A new working flow engine was developed on Zeus to manage and schedule j...
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | zho |
| Published: |
Beijing Xintong Media Co., Ltd
2016-02-01
|
| Series: | Dianxin kexue |
| Subjects: | |
| Online Access: | http://www.telecomsci.com/zh/article/doi/10.3969/j.issn.1000-0801.2016.02.019/ |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1841529802004103168 |
|---|---|
| author | Jie CHEN Juan WU Yang SU Yong TANG |
| author_facet | Jie CHEN Juan WU Yang SU Yong TANG |
| author_sort | Jie CHEN |
| collection | DOAJ |
| description | The big data platform for gaming service is based on Hadoop open source technology. With the demand growth of the service operation staff，there are more and more jobs which depend on each other running on the big data platform. A new working flow engine was developed on Zeus to manage and schedule jobs efficiently. In order to shorten the start time，Zeus task starting process was optimized and multi-threaded start task was achieved. Zeus was also improved to support the Oracle stored procedure. Pipeline technology was used to seamless and efficient sharing and transmission of heterogeneous data sources. |
| format | Article |
| id | doaj-art-7fa6e2f6c5934a85a2783af5eeb54dd7 |
| institution | Kabale University |
| issn | 1000-0801 |
| language | zho |
| publishDate | 2016-02-01 |
| publisher | Beijing Xintong Media Co., Ltd |
| record_format | Article |
| series | Dianxin kexue |
| spelling | doaj-art-7fa6e2f6c5934a85a2783af5eeb54dd72025-01-15T03:15:23ZzhoBeijing Xintong Media Co., LtdDianxin kexue1000-08012016-02-013213413959610387Research and practice on working flow engine of big data platform for gaming serviceJie CHENJuan WUYang SUYong TANGThe big data platform for gaming service is based on Hadoop open source technology. With the demand growth of the service operation staff，there are more and more jobs which depend on each other running on the big data platform. A new working flow engine was developed on Zeus to manage and schedule jobs efficiently. In order to shorten the start time，Zeus task starting process was optimized and multi-threaded start task was achieved. Zeus was also improved to support the Oracle stored procedure. Pipeline technology was used to seamless and efficient sharing and transmission of heterogeneous data sources.http://www.telecomsci.com/zh/article/doi/10.3969/j.issn.1000-0801.2016.02.019/big data jobwork flowopen source |
| spellingShingle | Jie CHEN Juan WU Yang SU Yong TANG Research and practice on working flow engine of big data platform for gaming service Dianxin kexue big data job work flow open source |
| title | Research and practice on working flow engine of big data platform for gaming service |
| title_full | Research and practice on working flow engine of big data platform for gaming service |
| title_fullStr | Research and practice on working flow engine of big data platform for gaming service |
| title_full_unstemmed | Research and practice on working flow engine of big data platform for gaming service |
| title_short | Research and practice on working flow engine of big data platform for gaming service |
| title_sort | research and practice on working flow engine of big data platform for gaming service |
| topic | big data job work flow open source |
| url | http://www.telecomsci.com/zh/article/doi/10.3969/j.issn.1000-0801.2016.02.019/ |
| work_keys_str_mv | AT jiechen researchandpracticeonworkingflowengineofbigdataplatformforgamingservice AT juanwu researchandpracticeonworkingflowengineofbigdataplatformforgamingservice AT yangsu researchandpracticeonworkingflowengineofbigdataplatformforgamingservice AT yongtang researchandpracticeonworkingflowengineofbigdataplatformforgamingservice |