Chat GPT Impact Analysis on API Testing: A Controlled Experiment
This research examines the impact of ChatGPT as a learning aid for students in API testing. A controlled experiment compared two groups: one utilizing ChatGPT and the other relying on traditional documentation. The findings indicate that participants using ChatGPT scored significantly higher in both...
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Politeknik Negeri Batam
2024-11-01
|
| Series: | Journal of Applied Informatics and Computing |
| Subjects: | |
| Online Access: | https://jurnal.polibatam.ac.id/index.php/JAIC/article/view/8182 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850169077835759616 |
|---|---|
| author | Yehezkiel David Setiawan Laurentius Gusti Ontoseno Panata Yudha Yovie Adhisti Mulyono Veronica Marcella Angela Simalango Oscar Karnalim |
| author_facet | Yehezkiel David Setiawan Laurentius Gusti Ontoseno Panata Yudha Yovie Adhisti Mulyono Veronica Marcella Angela Simalango Oscar Karnalim |
| author_sort | Yehezkiel David Setiawan |
| collection | DOAJ |
| description | This research examines the impact of ChatGPT as a learning aid for students in API testing. A controlled experiment compared two groups: one utilizing ChatGPT and the other relying on traditional documentation. The findings indicate that participants using ChatGPT scored significantly higher in both exam tests compared to the documentation group, despite taking longer to complete tasks. Statistical analysis using t-tests confirmed these differences as significant. Post-test surveys revealed an increase in participants confidence and effectiveness in understanding and using APIs after interacting with ChatGPT. However, potential downsides, such as over-reliance on ChatGPT and insufficient deep conceptual understanding, were also observed. The results suggest that while ChatGPT can greatly enhance the quality of learning and productivity in API-related tasks, users must balance AI assistance with independent problem-solving skills. This study underscores the potential of ChatGPT as a valuable educational tool, provided it is integrated thoughtfully into the learning process. |
| format | Article |
| id | doaj-art-42e3dd7a5db7462ca07c2c3c492b60f6 |
| institution | OA Journals |
| issn | 2548-6861 |
| language | English |
| publishDate | 2024-11-01 |
| publisher | Politeknik Negeri Batam |
| record_format | Article |
| series | Journal of Applied Informatics and Computing |
| spelling | doaj-art-42e3dd7a5db7462ca07c2c3c492b60f62025-08-20T02:20:49ZengPoliteknik Negeri BatamJournal of Applied Informatics and Computing2548-68612024-11-018235035710.30871/jaic.v8i2.81828182Chat GPT Impact Analysis on API Testing: A Controlled ExperimentYehezkiel David SetiawanLaurentius Gusti Ontoseno Panata YudhaYovie Adhisti MulyonoVeronica Marcella Angela SimalangoOscar KarnalimThis research examines the impact of ChatGPT as a learning aid for students in API testing. A controlled experiment compared two groups: one utilizing ChatGPT and the other relying on traditional documentation. The findings indicate that participants using ChatGPT scored significantly higher in both exam tests compared to the documentation group, despite taking longer to complete tasks. Statistical analysis using t-tests confirmed these differences as significant. Post-test surveys revealed an increase in participants confidence and effectiveness in understanding and using APIs after interacting with ChatGPT. However, potential downsides, such as over-reliance on ChatGPT and insufficient deep conceptual understanding, were also observed. The results suggest that while ChatGPT can greatly enhance the quality of learning and productivity in API-related tasks, users must balance AI assistance with independent problem-solving skills. This study underscores the potential of ChatGPT as a valuable educational tool, provided it is integrated thoughtfully into the learning process.https://jurnal.polibatam.ac.id/index.php/JAIC/article/view/8182api developmentapi platformchatgptcontrolled experimentsoftware testing |
| spellingShingle | Yehezkiel David Setiawan Laurentius Gusti Ontoseno Panata Yudha Yovie Adhisti Mulyono Veronica Marcella Angela Simalango Oscar Karnalim Chat GPT Impact Analysis on API Testing: A Controlled Experiment Journal of Applied Informatics and Computing api development api platform chatgpt controlled experiment software testing |
| title | Chat GPT Impact Analysis on API Testing: A Controlled Experiment |
| title_full | Chat GPT Impact Analysis on API Testing: A Controlled Experiment |
| title_fullStr | Chat GPT Impact Analysis on API Testing: A Controlled Experiment |
| title_full_unstemmed | Chat GPT Impact Analysis on API Testing: A Controlled Experiment |
| title_short | Chat GPT Impact Analysis on API Testing: A Controlled Experiment |
| title_sort | chat gpt impact analysis on api testing a controlled experiment |
| topic | api development api platform chatgpt controlled experiment software testing |
| url | https://jurnal.polibatam.ac.id/index.php/JAIC/article/view/8182 |
| work_keys_str_mv | AT yehezkieldavidsetiawan chatgptimpactanalysisonapitestingacontrolledexperiment AT laurentiusgustiontosenopanatayudha chatgptimpactanalysisonapitestingacontrolledexperiment AT yovieadhistimulyono chatgptimpactanalysisonapitestingacontrolledexperiment AT veronicamarcellaangelasimalango chatgptimpactanalysisonapitestingacontrolledexperiment AT oscarkarnalim chatgptimpactanalysisonapitestingacontrolledexperiment |