Robust reinforcement learning algorithm based on pigeon-inspired optimization by Mingying ZHANG, Bing HUA, Yuguang ZHANG, Haidong LI, Mohong ZHENG

“…Reinforcement learning(RL) is an artificial intelligence algorithm with the advantages of clear calculation logic and easy expansion of the model.Through interacting with the environment and maximizing value functions on the premise of obtaining little or no prior information, RL can optimize the performance of strategies and effectively reduce the complexity caused by physical models .The RL algorithm based on strategy gradient has been successfully applied in many fields such as intelligent image recognition, robot control and path planning for automatic driving.However, the highly sampling-dependent characteristics of RL determine that the training process needs a large number of samples to converge, and the accuracy of decision making is easily affected by slight interference that does not match with the simulation environment.Especially when RL is applied to the control field, it is difficult to prove the stability of the algorithm because the convergence of the algorithm cannot be guaranteed.Considering that swarm intelligence algorithm can solve complex problems through group cooperation and has the characteristics of self-organization and strong stability, it is an effective way to be used for improving the stability of RL model.The pigeon-inspired optimization algorithm in swarm intelligence was combined to improve RL based on strategy gradient.A RL algorithm based on pigeon-inspired optimization was proposed to solve the strategy gradient in order to maximize long-term future rewards.Adaptive function of pigeon-inspired optimization algorithm and RL were combined to estimate the advantages and disadvantages of strategies, avoid solving into an infinite loop, and improve the stability of the algorithm.A nonlinear two-wheel inverted pendulum robot control system was selected for simulation verification.The simulation results show that the RL algorithm based on pigeon-inspired optimization can improve the robustness of the system, reduce the computational cost, and reduce the algorithm’s dependence on the sample database.…”
Get full text

Fleet management algorithm for enhancing environmental friendliness of maritime delivery by Андрій Романов

“…In addition, the results will be validated and the efficiency of the developed algorithm will be compared with a standard genetic algorithm without a speed optimization step. …”
Get full text

Beijing Opera Synthesis Based on Straight Algorithm and Deep Learning by XueTing Wang, Cong Jin, Wei Zhao

“…The experimental results show that the synthesized Beijing Opera has some audibility and can basically complete the composition of Beijing Opera. We also extend our models to human-AI cooperative music generation: given a target voice of human, we can generate a Beijing Opera which is sung by a new target voice.…”
Get full text

Statistical modeling based fast rate estimation algorithm for VVC by Wei QI, Haibing YIN, Hongkui WANG, Xiaofeng HUANG, Weihong NIU

“…To reduce the coding complexity of the rate-distortion optimization process of the latest video coding standard versatile video coding (VVC), a fast rate estimation model based on statistical modeling was proposed.Firstly, the quantization behavior in dependent quantization (DQ) and the context dependency in entropy coding were fully considered.Features that could describe context state transition in the coding process were proposed to estimate rate of some synatax elements in a TU preliminarily.Secondly, coefficient chaos and sparsity features were proposed to distinguish the influence of coefficient distribution difference on the rate cost based on the coefficient distribution characteristics which built a TU level rate model.Finally, large-size transform unit (TU) and small-size TU was modeling respectively according to the rate composition character to achieve more accurate rate estimation.A large number of parameters were trained by regression model through statistical methods, and the final linear rate model was obtained which was applied to the mode decision.Experimental results show that the proposed algorithm can achieve 16.289% complexity reduction with 1.567% BD-BR increase for RA configuration.…”
Get full text

An Adaptive Chaotic Sine Cosine Algorithm for Constrained and Unconstrained Optimization by Yetao Ji, Jiaze Tu, Hanfeng Zhou, Wenyong Gui, Guoxi Liang, Huiling Chen, Mingjing Wang

“…Then, the chaotic local search is added to augment the local searching patterns of the algorithm. The effectiveness of the ASCA is validated on a set of benchmark functions, including unimodal, multimodal, and composition functions by comparing it with several well-known and advanced meta-heuristics. …”
Get full text

Sustainable Mineral Processing Technologies Using Hybrid Intelligent Algorithms by Olga Shiryayeva, Batyrbek Suleimenov, Yelena Kulakova

“…The proposed control algorithm reduces chromium losses in tailings from 7.5% to 5.5%, while improving concentrate quality by 3–6%. …”
Get full text

An algorithm for automatic fitting and formula assignment in atmospheric mass spectra by V. Mickwitz, O. Peräkylä, F. Graeffe, D. Worsnop, D. Worsnop, M. Ehn

“…<p>Mass spectrometry is an established method for studying the chemical composition of gases and particles in the atmosphere. …”
Get full text

Kohonen’s algorithm in problems of classification of defects in printed circuit assemblies by S. U. Uvaysov, V. V. Chernoverskaya, An Kuan Dao, Van Tuan Nguyen

“…The structure of the method is shown, and the composition of the functional blocks is determined. …”
Get full text

A liquid biopsy algorithm exploiting local exosome heterogeneity by Taekmin Kim, Dayeon Choi, Soonjoung Kwon, Se-Eun Park, Jongki Kim, Yoon-Ho Lee, Seung-Cheol Choi, Se-Hwan Paek

Get full text

RETE-ADH: An Improvement to RETE for Composite Context-Aware Service by Milhan Kim, Kiseong Lee, Youngmin Kim, Taejin Kim, Yunseong Lee, Sungrae Cho, Chan-Gun Lee

“…We propose a new pattern matching algorithm for composite context-aware services. The new algorithm, RETE-ADH, extends RETE to enhance systems that are based on the composite context-aware service architecture. …”
Get full text

A Flexible Framework for Decentralized Composite Optimization with Compressed Communication by Zhongyi Chang, Zhen Zhang, Shaofu Yang, Jinde Cao

“…This paper addresses the decentralized composite optimization problem, where a network of agents cooperatively minimize the sum of their local objective functions with non-differentiable terms. …”
Get full text

Joint time and power allocation for uplink cooperative non-orthogonal multiple access based massive machine-type communication Network by Shujun Han, Xiaodong Xu, Litong Zhao, Xiaofeng Tao

“…Then, the group head transmits the received data with its own data to base station in the cooperation phase. Because the massive machine-type communication devices are low-cost dominant with limited battery, based on uplink cooperative non-orthogonal multiple access, we propose a joint time and power allocation algorithm to minimize the system energy consumption. …”
Get full text

Research on Q-Learning-Based Cooperative Optimization Methodology for Dynamic Task Scheduling and Energy Consumption in Underwater Pan-Tilt Systems by Shan Tao, Lei Yang, Xiaobo Zhang, Shengya Zhao, Kun Liu, Xinran Tian, Hengxin Xu

Get full text

Spectrum sensing algorithm based on the eigenvalue of Wishart random matrix by Xuemei YANG, Xi HE, Jiapin XU

“…In order to improve the spectrum sensing performance and overcome the shortcomings of the classical algorithm,a new cooperative spectrum sensing algorithm based on Wishart random matrix theory was proposed.According to the logarithmic distribution characteristics of the sampled covariance matrix eigenvalues and using the ratio of maximum eigenvalue and geometric mean eigenvalue,a simple closed-form threshold expression could be obtained,and the spectrum sensing decision could be performed depend on the threshold.The simulation results show that the proposed algorithm can get better sensing performance even under the conditions of a few number of cooperative users,low signal to noise ratio and a few samples.It is less affected by false-alarm probability and the extreme values,and has better detection performance than similar algorithms.…”
Get full text

Observation optimization for marine target tracking by airborne and maritime unmanned platforms cooperation using adaptive enhanced dung beetle optimization by Qiuyang Dai, Faxing Lu, Haoran Shi, Junfei Xu, Jianjing Qu

“…To address these limitations, this paper proposes a heterogeneous unmanned platform cooperative observation optimization method based on Adaptive Enhanced Dung Beetle Optimization (AEDBO) algorithm. …”
Get full text

Interior design assistant algorithm based on indoor scene analysis by Lu Zhang

“…The FIoU value of the unsupervised image cooperative segmentation algorithm reached 66.20, which is superior to the existing algorithms and can better match the real indoor scene. …”
Get full text

Size Classification of Chopped Carbon Fibers in the Composite Materials Manufacturing by А.S. Dovbysh, А.F. Budnik, N.І. Andriienko

“…To improve the reliability of recognition learning algorithm with the optimization of the precision control is proposed.…”
Get full text

Coordinated beamforming algorithm assisted by receive beamforming vector estimation by Ying HUANG, Gang-ming LV, Shi-hua ZHU

“…By sharing a small amount of information among cooperated base stations(BSs), the proposed algorithm estimates the receive vectors of related users at the BSs based on MVDR criterion, which are then utilized to optimize the design of transmit beamforming vectors. …”
Get full text

Grey Wolf Algorithm in Coordinated Hydro and Wind Power Generation by Xing LI, Xiuyuan YANG, Lijie WANG

“…The wind power and hydropower could cooperate operation to reduce the influence of wind power fluctuation. …”
Get full text

Network selection algorithm based on synergetic for heterogeneous wireless network by Ran LUO, Su ZHAO, Qi ZHU

“…A network selection algorithm based on synergetic for heterogeneous wireless network was proposed. …”
Get full text