Crowdsourcing Relative Rankings of Multi-Word Expressions: Experts versus Non-Experts
In this study we investigate to which degree experts and non-experts agree on questions of linguistic complexity in a crowdsourcing experiment. We ask non-experts (second language learners of Swedish) and two groups of experts (teachers of Swedish as a second/foreign language and CEFR experts) to r...
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Linköping University Electronic Press
2022-07-01
|
| Series: | Northern European Journal of Language Technology |
| Online Access: | https://nejlt.ep.liu.se/article/view/3128 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1832591230333091840 |
|---|---|
| author | David Alfter Therese Lindström Tiedemann Elena Volodina |
| author_facet | David Alfter Therese Lindström Tiedemann Elena Volodina |
| author_sort | David Alfter |
| collection | DOAJ |
| description |
In this study we investigate to which degree experts and non-experts agree on questions of linguistic complexity in a crowdsourcing experiment. We ask non-experts (second language learners of Swedish) and two groups of experts (teachers of Swedish as a second/foreign language and CEFR experts) to rank multi-word expressions in a crowdsourcing experiment. We nd that the resulting rankings by all the three tested groups correlate to a very high degree, which suggests that judgments produced in a comparative setting are not inuenced by professional insights into Swedish as a second language.
|
| format | Article |
| id | doaj-art-52e550e858c349fe865b7f0cad8c976d |
| institution | Kabale University |
| issn | 2000-1533 |
| language | English |
| publishDate | 2022-07-01 |
| publisher | Linköping University Electronic Press |
| record_format | Article |
| series | Northern European Journal of Language Technology |
| spelling | doaj-art-52e550e858c349fe865b7f0cad8c976d2025-01-22T15:25:32ZengLinköping University Electronic PressNorthern European Journal of Language Technology2000-15332022-07-017110.3384/nejlt.2000-1533.2021.3128Crowdsourcing Relative Rankings of Multi-Word Expressions: Experts versus Non-ExpertsDavid Alfter0Therese Lindström Tiedemann1Elena Volodina2University of GothenburgUniversity of HelsinkiSpråkbanken, University of Gothenburg In this study we investigate to which degree experts and non-experts agree on questions of linguistic complexity in a crowdsourcing experiment. We ask non-experts (second language learners of Swedish) and two groups of experts (teachers of Swedish as a second/foreign language and CEFR experts) to rank multi-word expressions in a crowdsourcing experiment. We nd that the resulting rankings by all the three tested groups correlate to a very high degree, which suggests that judgments produced in a comparative setting are not inuenced by professional insights into Swedish as a second language. https://nejlt.ep.liu.se/article/view/3128 |
| spellingShingle | David Alfter Therese Lindström Tiedemann Elena Volodina Crowdsourcing Relative Rankings of Multi-Word Expressions: Experts versus Non-Experts Northern European Journal of Language Technology |
| title | Crowdsourcing Relative Rankings of Multi-Word Expressions: Experts versus Non-Experts |
| title_full | Crowdsourcing Relative Rankings of Multi-Word Expressions: Experts versus Non-Experts |
| title_fullStr | Crowdsourcing Relative Rankings of Multi-Word Expressions: Experts versus Non-Experts |
| title_full_unstemmed | Crowdsourcing Relative Rankings of Multi-Word Expressions: Experts versus Non-Experts |
| title_short | Crowdsourcing Relative Rankings of Multi-Word Expressions: Experts versus Non-Experts |
| title_sort | crowdsourcing relative rankings of multi word expressions experts versus non experts |
| url | https://nejlt.ep.liu.se/article/view/3128 |
| work_keys_str_mv | AT davidalfter crowdsourcingrelativerankingsofmultiwordexpressionsexpertsversusnonexperts AT thereselindstromtiedemann crowdsourcingrelativerankingsofmultiwordexpressionsexpertsversusnonexperts AT elenavolodina crowdsourcingrelativerankingsofmultiwordexpressionsexpertsversusnonexperts |