Sentiment Analysis of Public Satisfaction with the 'INFO BMKG' Application using Naive Bayes, SVM, and KNN
This study aims to analyze public sentiment regarding the Info BMKG application on the Google Play Store. With the increasing number of users of information-based applications, understanding how users perceive and evaluate such applications has become essential. This research employs three classific...
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | Indonesian |
| Published: |
Islamic University of Indragiri
2025-05-01
|
| Series: | Sistemasi: Jurnal Sistem Informasi |
| Subjects: | |
| Online Access: | https://sistemasi.ftik.unisi.ac.id/index.php/stmsi/article/view/5223 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849222082128248832 |
|---|---|
| author | Natasya Aditiya Pratomo Setiaji Supriyono Supriyono |
| author_facet | Natasya Aditiya Pratomo Setiaji Supriyono Supriyono |
| author_sort | Natasya Aditiya |
| collection | DOAJ |
| description | This study aims to analyze public sentiment regarding the Info BMKG application on the Google Play Store. With the increasing number of users of information-based applications, understanding how users perceive and evaluate such applications has become essential. This research employs three classification algorithms—Naive Bayes, Support Vector Machine (SVM), and K-Nearest Neighbors (KNN)—to categorize user reviews into positive, neutral, or negative sentiments. The dataset was obtained through web scraping from the Google Play Store, consisting of usernames, dates, star ratings, and user comments. Data preprocessing was conducted to clean and prepare the data for analysis. Additionally, a web-based data mining application was developed to facilitate data processing and result visualization. The study aims to present the distribution of sentiment (positive, neutral, and negative) toward the Info BMKG app and help developers understand the factors that influence user satisfaction. Moreover, it contributes to the field of sentiment analysis and information technology, particularly in disaster-related information applications. Based on model evaluation, the Naive Bayes algorithm demonstrated the best performance with an accuracy of 79.84%, precision of 60%, recall of 58%, and the fastest runtime at 0.19 seconds. KNN achieved an accuracy of 74.35% with the lowest recall at 44%, while SVM had an accuracy of 72.26% but required the longest runtime at 611 seconds. AUC validation further confirmed the superiority of Naive Bayes, with the highest scores across all sentiment categories. Thus, Naive Bayes is shown to be the most optimal for sentiment analysis in this study, whereas KNN and SVM showed certain limitations, particularly in efficiency and classification accuracy. |
| format | Article |
| id | doaj-art-45fdc2c995184d77bf7b82818783cec3 |
| institution | Kabale University |
| issn | 2302-8149 2540-9719 |
| language | Indonesian |
| publishDate | 2025-05-01 |
| publisher | Islamic University of Indragiri |
| record_format | Article |
| series | Sistemasi: Jurnal Sistem Informasi |
| spelling | doaj-art-45fdc2c995184d77bf7b82818783cec32025-08-26T08:05:47ZindIslamic University of IndragiriSistemasi: Jurnal Sistem Informasi2302-81492540-97192025-05-011431418143210.32520/stmsi.v14i3.52231092Sentiment Analysis of Public Satisfaction with the 'INFO BMKG' Application using Naive Bayes, SVM, and KNNNatasya Aditiya0Pratomo Setiaji1Supriyono Supriyono2Universitas Muria KudusUniversitas Muria KudusUniversitas Muria KudusThis study aims to analyze public sentiment regarding the Info BMKG application on the Google Play Store. With the increasing number of users of information-based applications, understanding how users perceive and evaluate such applications has become essential. This research employs three classification algorithms—Naive Bayes, Support Vector Machine (SVM), and K-Nearest Neighbors (KNN)—to categorize user reviews into positive, neutral, or negative sentiments. The dataset was obtained through web scraping from the Google Play Store, consisting of usernames, dates, star ratings, and user comments. Data preprocessing was conducted to clean and prepare the data for analysis. Additionally, a web-based data mining application was developed to facilitate data processing and result visualization. The study aims to present the distribution of sentiment (positive, neutral, and negative) toward the Info BMKG app and help developers understand the factors that influence user satisfaction. Moreover, it contributes to the field of sentiment analysis and information technology, particularly in disaster-related information applications. Based on model evaluation, the Naive Bayes algorithm demonstrated the best performance with an accuracy of 79.84%, precision of 60%, recall of 58%, and the fastest runtime at 0.19 seconds. KNN achieved an accuracy of 74.35% with the lowest recall at 44%, while SVM had an accuracy of 72.26% but required the longest runtime at 611 seconds. AUC validation further confirmed the superiority of Naive Bayes, with the highest scores across all sentiment categories. Thus, Naive Bayes is shown to be the most optimal for sentiment analysis in this study, whereas KNN and SVM showed certain limitations, particularly in efficiency and classification accuracy.https://sistemasi.ftik.unisi.ac.id/index.php/stmsi/article/view/5223sentimeninfo bmkgnaive bayessvmknn |
| spellingShingle | Natasya Aditiya Pratomo Setiaji Supriyono Supriyono Sentiment Analysis of Public Satisfaction with the 'INFO BMKG' Application using Naive Bayes, SVM, and KNN Sistemasi: Jurnal Sistem Informasi sentimen info bmkg naive bayes svm knn |
| title | Sentiment Analysis of Public Satisfaction with the 'INFO BMKG' Application using Naive Bayes, SVM, and KNN |
| title_full | Sentiment Analysis of Public Satisfaction with the 'INFO BMKG' Application using Naive Bayes, SVM, and KNN |
| title_fullStr | Sentiment Analysis of Public Satisfaction with the 'INFO BMKG' Application using Naive Bayes, SVM, and KNN |
| title_full_unstemmed | Sentiment Analysis of Public Satisfaction with the 'INFO BMKG' Application using Naive Bayes, SVM, and KNN |
| title_short | Sentiment Analysis of Public Satisfaction with the 'INFO BMKG' Application using Naive Bayes, SVM, and KNN |
| title_sort | sentiment analysis of public satisfaction with the info bmkg application using naive bayes svm and knn |
| topic | sentimen info bmkg naive bayes svm knn |
| url | https://sistemasi.ftik.unisi.ac.id/index.php/stmsi/article/view/5223 |
| work_keys_str_mv | AT natasyaaditiya sentimentanalysisofpublicsatisfactionwiththeinfobmkgapplicationusingnaivebayessvmandknn AT pratomosetiaji sentimentanalysisofpublicsatisfactionwiththeinfobmkgapplicationusingnaivebayessvmandknn AT supriyonosupriyono sentimentanalysisofpublicsatisfactionwiththeinfobmkgapplicationusingnaivebayessvmandknn |