A Novel Performance Evaluation Framework for OTFS System

Orthogonal Time Frequency Space (OTFS) systems have been widely investigated to achieve better performances in high-speed mobile scenarios. Bit Error Rate (BER) is always considered as the core indicator to measure communication performance in different conditions. However, the main issues of BER as...

Full description

Saved in:
Bibliographic Details
Main Authors: Zhenduo Wang, Yijin Wang, Yong Yu, Zihang Zhang, Chunpeng Liu
Format: Article
Language:English
Published: IEEE 2025-01-01
Series:IEEE Open Journal of Vehicular Technology
Subjects:
Online Access:https://ieeexplore.ieee.org/document/11010888/
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1850098140973105152
author Zhenduo Wang
Yijin Wang
Yong Yu
Zihang Zhang
Chunpeng Liu
author_facet Zhenduo Wang
Yijin Wang
Yong Yu
Zihang Zhang
Chunpeng Liu
author_sort Zhenduo Wang
collection DOAJ
description Orthogonal Time Frequency Space (OTFS) systems have been widely investigated to achieve better performances in high-speed mobile scenarios. Bit Error Rate (BER) is always considered as the core indicator to measure communication performance in different conditions. However, the main issues of BER assessments are limited evaluation indicators and long computation time. Therefore, in this paper, we propose a novel communication performance evaluation framework for OTFS systems, which complements and extends traditional communication performance evaluation based on BER, and thus faster evaluation as well as parameter selections can be obtained. Specifically, the proposed evaluation framework is constituted by three main components, which includes indicator selection, weight calculation, and performance ranking. Firstly, waveform parameters, channel information and receiving algorithm of OTFS systems are considered as evaluation characteristics, and thus four key indicators are integrated and extracted for subsequent assessments. Secondly, subjective and objective weighting algorithms are respectively employed to determine the weights of different indicators, and then game theory is considered to obtain a joint weight. The Analytic Hierarchy Process (AHP) is enhanced through cloud model and optimal transfer matrix, to address the issue of multi-expert collaboration and the repeated consistency checks. In addition, the correlation coefficient matrix is applied in the coefficient of variation (CV) to solve the problem of indicator independence. Finally, the Technique for Order Preference by Similarity to Ideal Solution (TOPSIS) is selected as the ranking algorithm to judge performances of different schemes, and thus evaluation results can be obtained. In simulation results, eleven different schemes with different configurations are chosen for performance assessments, which demonstrates that the proposed evaluation framework effectively compares communication performances of different schemes. Additionally, the evaluation results can also point out the optimal solution, and thus the optimal parameter selections can be guided.
format Article
id doaj-art-b6cfac3cea874e6197bba2d5c2fedfcc
institution DOAJ
issn 2644-1330
language English
publishDate 2025-01-01
publisher IEEE
record_format Article
series IEEE Open Journal of Vehicular Technology
spelling doaj-art-b6cfac3cea874e6197bba2d5c2fedfcc2025-08-20T02:40:47ZengIEEEIEEE Open Journal of Vehicular Technology2644-13302025-01-0161837184810.1109/OJVT.2025.357260111010888A Novel Performance Evaluation Framework for OTFS SystemZhenduo Wang0https://orcid.org/0000-0002-4318-6963Yijin Wang1https://orcid.org/0009-0006-4910-593XYong Yu2Zihang Zhang3https://orcid.org/0009-0004-4614-2853Chunpeng Liu4https://orcid.org/0000-0002-5008-3671College of Information and Communication Engineering, Harbin Engineering University, Harbin, ChinaCollege of Information and Communication Engineering, Harbin Engineering University, Harbin, ChinaHuaxin Consulting Company Ltd., Hangzhou, ChinaCollege of Information and Communication Engineering, Harbin Engineering University, Harbin, ChinaCollege of Information and Communication Engineering, Harbin Engineering University, Harbin, ChinaOrthogonal Time Frequency Space (OTFS) systems have been widely investigated to achieve better performances in high-speed mobile scenarios. Bit Error Rate (BER) is always considered as the core indicator to measure communication performance in different conditions. However, the main issues of BER assessments are limited evaluation indicators and long computation time. Therefore, in this paper, we propose a novel communication performance evaluation framework for OTFS systems, which complements and extends traditional communication performance evaluation based on BER, and thus faster evaluation as well as parameter selections can be obtained. Specifically, the proposed evaluation framework is constituted by three main components, which includes indicator selection, weight calculation, and performance ranking. Firstly, waveform parameters, channel information and receiving algorithm of OTFS systems are considered as evaluation characteristics, and thus four key indicators are integrated and extracted for subsequent assessments. Secondly, subjective and objective weighting algorithms are respectively employed to determine the weights of different indicators, and then game theory is considered to obtain a joint weight. The Analytic Hierarchy Process (AHP) is enhanced through cloud model and optimal transfer matrix, to address the issue of multi-expert collaboration and the repeated consistency checks. In addition, the correlation coefficient matrix is applied in the coefficient of variation (CV) to solve the problem of indicator independence. Finally, the Technique for Order Preference by Similarity to Ideal Solution (TOPSIS) is selected as the ranking algorithm to judge performances of different schemes, and thus evaluation results can be obtained. In simulation results, eleven different schemes with different configurations are chosen for performance assessments, which demonstrates that the proposed evaluation framework effectively compares communication performances of different schemes. Additionally, the evaluation results can also point out the optimal solution, and thus the optimal parameter selections can be guided.https://ieeexplore.ieee.org/document/11010888/OTFSperformance evaluationcorrelation coefficientTOPSISgame theoryAHP
spellingShingle Zhenduo Wang
Yijin Wang
Yong Yu
Zihang Zhang
Chunpeng Liu
A Novel Performance Evaluation Framework for OTFS System
IEEE Open Journal of Vehicular Technology
OTFS
performance evaluation
correlation coefficient
TOPSIS
game theory
AHP
title A Novel Performance Evaluation Framework for OTFS System
title_full A Novel Performance Evaluation Framework for OTFS System
title_fullStr A Novel Performance Evaluation Framework for OTFS System
title_full_unstemmed A Novel Performance Evaluation Framework for OTFS System
title_short A Novel Performance Evaluation Framework for OTFS System
title_sort novel performance evaluation framework for otfs system
topic OTFS
performance evaluation
correlation coefficient
TOPSIS
game theory
AHP
url https://ieeexplore.ieee.org/document/11010888/
work_keys_str_mv AT zhenduowang anovelperformanceevaluationframeworkforotfssystem
AT yijinwang anovelperformanceevaluationframeworkforotfssystem
AT yongyu anovelperformanceevaluationframeworkforotfssystem
AT zihangzhang anovelperformanceevaluationframeworkforotfssystem
AT chunpengliu anovelperformanceevaluationframeworkforotfssystem
AT zhenduowang novelperformanceevaluationframeworkforotfssystem
AT yijinwang novelperformanceevaluationframeworkforotfssystem
AT yongyu novelperformanceevaluationframeworkforotfssystem
AT zihangzhang novelperformanceevaluationframeworkforotfssystem
AT chunpengliu novelperformanceevaluationframeworkforotfssystem