The Role of VADER and SentiWordNet Labeling in Naïve Bayes Accuracy for Sentiment Analysis of Rice Price Increases

The surge in rice prices in Indonesia in 2024 is a critical issue affecting social welfare and national food security, particularly amid rising rice imports. This study evaluates public sentiment on Twitter using the Naïve Bayes method and compares the effectiveness of two automated labeling methods...

Full description

Saved in:
Bibliographic Details
Main Authors: Ihtiar Nur Furqon, Dewi Soyusiawaty
Format: Article
Language:English
Published: Institut Teknologi Dirgantara Adisutjipto 2025-02-01
Series:Aviation Electronics, Information Technology, Telecommunications, Electricals, Controls
Subjects:
Online Access:https://ejournals.itda.ac.id/index.php/avitec/article/view/2806
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1850249013407776768
author Ihtiar Nur Furqon
Dewi Soyusiawaty
author_facet Ihtiar Nur Furqon
Dewi Soyusiawaty
author_sort Ihtiar Nur Furqon
collection DOAJ
description The surge in rice prices in Indonesia in 2024 is a critical issue affecting social welfare and national food security, particularly amid rising rice imports. This study evaluates public sentiment on Twitter using the Naïve Bayes method and compares the effectiveness of two automated labeling methods, VADER and SentiWordNet, in improving sentiment analysis accuracy. The research is significant due to the limited literature on automated labeling comparisons, especially in food price crises. The methodology includes data collection, preprocessing, translation, sentiment labeling using VADER and SentiWordNet, TF-IDF feature extraction, Naïve Bayes classification, and performance evaluation across different data split ratios: 60% training and 40% testing, 70% training and 30% testing, 80% training and 20% testing, and 90% training and 10% testing. Results show that VADER excels in detecting positive sentiments, achieving 74.42% accuracy at a 90:10 split but struggles with negative sentiment identification, with a highest F1-score of 56.58%. SentiWordNet performs better for positive sentiment detection, reaching 77.86% accuracy and 96.22% recall at an 80:20 split but yields a low F1-score of 32.15% for negative sentiments. In conclusion, VADER is suitable for balanced sentiment detection, while SentiWordNet is more effective for identifying positive sentiments.
format Article
id doaj-art-92f15221ada445dd8dd775727fe0e47f
institution OA Journals
issn 2685-2381
2715-2626
language English
publishDate 2025-02-01
publisher Institut Teknologi Dirgantara Adisutjipto
record_format Article
series Aviation Electronics, Information Technology, Telecommunications, Electricals, Controls
spelling doaj-art-92f15221ada445dd8dd775727fe0e47f2025-08-20T01:58:34ZengInstitut Teknologi Dirgantara AdisutjiptoAviation Electronics, Information Technology, Telecommunications, Electricals, Controls2685-23812715-26262025-02-0171728510.28989/avitec.v7i1.28061033The Role of VADER and SentiWordNet Labeling in Naïve Bayes Accuracy for Sentiment Analysis of Rice Price IncreasesIhtiar Nur Furqon0Dewi Soyusiawaty1Universitas Ahmad DahlanUniversitas Ahmad DahlanThe surge in rice prices in Indonesia in 2024 is a critical issue affecting social welfare and national food security, particularly amid rising rice imports. This study evaluates public sentiment on Twitter using the Naïve Bayes method and compares the effectiveness of two automated labeling methods, VADER and SentiWordNet, in improving sentiment analysis accuracy. The research is significant due to the limited literature on automated labeling comparisons, especially in food price crises. The methodology includes data collection, preprocessing, translation, sentiment labeling using VADER and SentiWordNet, TF-IDF feature extraction, Naïve Bayes classification, and performance evaluation across different data split ratios: 60% training and 40% testing, 70% training and 30% testing, 80% training and 20% testing, and 90% training and 10% testing. Results show that VADER excels in detecting positive sentiments, achieving 74.42% accuracy at a 90:10 split but struggles with negative sentiment identification, with a highest F1-score of 56.58%. SentiWordNet performs better for positive sentiment detection, reaching 77.86% accuracy and 96.22% recall at an 80:20 split but yields a low F1-score of 32.15% for negative sentiments. In conclusion, VADER is suitable for balanced sentiment detection, while SentiWordNet is more effective for identifying positive sentiments.https://ejournals.itda.ac.id/index.php/avitec/article/view/2806sentiment analysisnaïve bayesvadersentiwordnettf-idf.
spellingShingle Ihtiar Nur Furqon
Dewi Soyusiawaty
The Role of VADER and SentiWordNet Labeling in Naïve Bayes Accuracy for Sentiment Analysis of Rice Price Increases
Aviation Electronics, Information Technology, Telecommunications, Electricals, Controls
sentiment analysis
naïve bayes
vader
sentiwordnet
tf-idf.
title The Role of VADER and SentiWordNet Labeling in Naïve Bayes Accuracy for Sentiment Analysis of Rice Price Increases
title_full The Role of VADER and SentiWordNet Labeling in Naïve Bayes Accuracy for Sentiment Analysis of Rice Price Increases
title_fullStr The Role of VADER and SentiWordNet Labeling in Naïve Bayes Accuracy for Sentiment Analysis of Rice Price Increases
title_full_unstemmed The Role of VADER and SentiWordNet Labeling in Naïve Bayes Accuracy for Sentiment Analysis of Rice Price Increases
title_short The Role of VADER and SentiWordNet Labeling in Naïve Bayes Accuracy for Sentiment Analysis of Rice Price Increases
title_sort role of vader and sentiwordnet labeling in naive bayes accuracy for sentiment analysis of rice price increases
topic sentiment analysis
naïve bayes
vader
sentiwordnet
tf-idf.
url https://ejournals.itda.ac.id/index.php/avitec/article/view/2806
work_keys_str_mv AT ihtiarnurfurqon theroleofvaderandsentiwordnetlabelinginnaivebayesaccuracyforsentimentanalysisofricepriceincreases
AT dewisoyusiawaty theroleofvaderandsentiwordnetlabelinginnaivebayesaccuracyforsentimentanalysisofricepriceincreases
AT ihtiarnurfurqon roleofvaderandsentiwordnetlabelinginnaivebayesaccuracyforsentimentanalysisofricepriceincreases
AT dewisoyusiawaty roleofvaderandsentiwordnetlabelinginnaivebayesaccuracyforsentimentanalysisofricepriceincreases