Research on intelligent computing network technology for large-scale pre-trained models
With the development of artificial intelligence, significant achievements are made in various fields such as natural language processing and computer vision through the utilization of large-scale pre-trained models,which promotes the construction of intelligent computing centers. Key technologies re...
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | zho |
| Published: |
Beijing Xintong Media Co., Ltd
2024-06-01
|
| Series: | Dianxin kexue |
| Subjects: | |
| Online Access: | http://www.telecomsci.com/zh/article/doi/10.11959/j.issn.1000-0801.2024167/ |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1841528864290897920 |
|---|---|
| author | WANG Xuecong JI Siwei LI Cong |
| author_facet | WANG Xuecong JI Siwei LI Cong |
| author_sort | WANG Xuecong |
| collection | DOAJ |
| description | With the development of artificial intelligence, significant achievements are made in various fields such as natural language processing and computer vision through the utilization of large-scale pre-trained models,which promotes the construction of intelligent computing centers. Key technologies related to large-scale pre-trained models in intelligent computing networks were studied. The latest standardization progress of intelligent computing network at home and abroad was systematically reviewed. A target architecture for intelligent computing network was proposed, and the principles of key technologies, including remote direct memory access (RDMA), IB, RoCE, and collective communication, were explored. Moreover, the current issues and future development trends of intelligent computing networks were analyzed. This research holds crucial importance in advancing the development of intelligent computing network technology and providing guidance for the establishment of intelligent computing centers. |
| format | Article |
| id | doaj-art-7e6d804af06e4f5faf54839a94bcf081 |
| institution | Kabale University |
| issn | 1000-0801 |
| language | zho |
| publishDate | 2024-06-01 |
| publisher | Beijing Xintong Media Co., Ltd |
| record_format | Article |
| series | Dianxin kexue |
| spelling | doaj-art-7e6d804af06e4f5faf54839a94bcf0812025-01-15T03:33:36ZzhoBeijing Xintong Media Co., LtdDianxin kexue1000-08012024-06-014016017264852660Research on intelligent computing network technology for large-scale pre-trained modelsWANG XuecongJI SiweiLI CongWith the development of artificial intelligence, significant achievements are made in various fields such as natural language processing and computer vision through the utilization of large-scale pre-trained models,which promotes the construction of intelligent computing centers. Key technologies related to large-scale pre-trained models in intelligent computing networks were studied. The latest standardization progress of intelligent computing network at home and abroad was systematically reviewed. A target architecture for intelligent computing network was proposed, and the principles of key technologies, including remote direct memory access (RDMA), IB, RoCE, and collective communication, were explored. Moreover, the current issues and future development trends of intelligent computing networks were analyzed. This research holds crucial importance in advancing the development of intelligent computing network technology and providing guidance for the establishment of intelligent computing centers.http://www.telecomsci.com/zh/article/doi/10.11959/j.issn.1000-0801.2024167/intelligent computing networkRDMAlarge-scale model |
| spellingShingle | WANG Xuecong JI Siwei LI Cong Research on intelligent computing network technology for large-scale pre-trained models Dianxin kexue intelligent computing network RDMA large-scale model |
| title | Research on intelligent computing network technology for large-scale pre-trained models |
| title_full | Research on intelligent computing network technology for large-scale pre-trained models |
| title_fullStr | Research on intelligent computing network technology for large-scale pre-trained models |
| title_full_unstemmed | Research on intelligent computing network technology for large-scale pre-trained models |
| title_short | Research on intelligent computing network technology for large-scale pre-trained models |
| title_sort | research on intelligent computing network technology for large scale pre trained models |
| topic | intelligent computing network RDMA large-scale model |
| url | http://www.telecomsci.com/zh/article/doi/10.11959/j.issn.1000-0801.2024167/ |
| work_keys_str_mv | AT wangxuecong researchonintelligentcomputingnetworktechnologyforlargescalepretrainedmodels AT jisiwei researchonintelligentcomputingnetworktechnologyforlargescalepretrainedmodels AT licong researchonintelligentcomputingnetworktechnologyforlargescalepretrainedmodels |