Co-Creation for Sign Language Processing and Translation Technology
Sign language machine translation (SLMT)—the task of automatically translating between sign and spoken languages or between sign languages—is a complex task within the field of NLP. Its multi-modal and non-linear nature require the joint efforts of sign language (SL) linguists, technical experts, an...
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2025-04-01
|
| Series: | Information |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2078-2489/16/4/290 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849713869192167424 |
|---|---|
| author | Lisa Lepp Dimitar Shterionov Mirella De Sisto Grzegorz Chrupała |
| author_facet | Lisa Lepp Dimitar Shterionov Mirella De Sisto Grzegorz Chrupała |
| author_sort | Lisa Lepp |
| collection | DOAJ |
| description | Sign language machine translation (SLMT)—the task of automatically translating between sign and spoken languages or between sign languages—is a complex task within the field of NLP. Its multi-modal and non-linear nature require the joint efforts of sign language (SL) linguists, technical experts, and SL users. Effective user involvement is a challenge that can be addressed through <i>co-creation</i>. Co-creation has been formally defined in many fields, e.g., business, marketing, educational, and others; however, in NLP and in particular in SLMT, there is no formal, widely accepted definition. Starting from the inception and evolution of <i>co-creation</i> across various fields over time, we develop a relationship typology to address the collaboration between deaf, hard of hearing, and hearing researchers and the co-creation with SL users. We compare this new typology to the guiding principles of participatory design for NLP. We then assess 111 articles from the perspective of involvement of SL users and highlight the lack of involvement of the sign language community or users in decision-making processes required for effective co-creation. Finally, we derive formal guidelines for co-creation for SLMT which take the dynamic nature of co-creation throughout the life cycle of a research project into account. |
| format | Article |
| id | doaj-art-3e169e0c75ce4df9bd3f98c4f732392f |
| institution | DOAJ |
| issn | 2078-2489 |
| language | English |
| publishDate | 2025-04-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Information |
| spelling | doaj-art-3e169e0c75ce4df9bd3f98c4f732392f2025-08-20T03:13:51ZengMDPI AGInformation2078-24892025-04-0116429010.3390/info16040290Co-Creation for Sign Language Processing and Translation TechnologyLisa Lepp0Dimitar Shterionov1Mirella De Sisto2Grzegorz Chrupała3Department of Cognitive Science and Artificial Intelligence, Tilburg University, 5037 AB Tilburg, The NetherlandsDepartment of Cognitive Science and Artificial Intelligence, Tilburg University, 5037 AB Tilburg, The NetherlandsDepartment of Cognitive Science and Artificial Intelligence, Tilburg University, 5037 AB Tilburg, The NetherlandsDepartment of Cognitive Science and Artificial Intelligence, Tilburg University, 5037 AB Tilburg, The NetherlandsSign language machine translation (SLMT)—the task of automatically translating between sign and spoken languages or between sign languages—is a complex task within the field of NLP. Its multi-modal and non-linear nature require the joint efforts of sign language (SL) linguists, technical experts, and SL users. Effective user involvement is a challenge that can be addressed through <i>co-creation</i>. Co-creation has been formally defined in many fields, e.g., business, marketing, educational, and others; however, in NLP and in particular in SLMT, there is no formal, widely accepted definition. Starting from the inception and evolution of <i>co-creation</i> across various fields over time, we develop a relationship typology to address the collaboration between deaf, hard of hearing, and hearing researchers and the co-creation with SL users. We compare this new typology to the guiding principles of participatory design for NLP. We then assess 111 articles from the perspective of involvement of SL users and highlight the lack of involvement of the sign language community or users in decision-making processes required for effective co-creation. Finally, we derive formal guidelines for co-creation for SLMT which take the dynamic nature of co-creation throughout the life cycle of a research project into account.https://www.mdpi.com/2078-2489/16/4/290sign language machine translationco-creationsign language communityrelationship typologytechniquessign languages |
| spellingShingle | Lisa Lepp Dimitar Shterionov Mirella De Sisto Grzegorz Chrupała Co-Creation for Sign Language Processing and Translation Technology Information sign language machine translation co-creation sign language community relationship typology techniques sign languages |
| title | Co-Creation for Sign Language Processing and Translation Technology |
| title_full | Co-Creation for Sign Language Processing and Translation Technology |
| title_fullStr | Co-Creation for Sign Language Processing and Translation Technology |
| title_full_unstemmed | Co-Creation for Sign Language Processing and Translation Technology |
| title_short | Co-Creation for Sign Language Processing and Translation Technology |
| title_sort | co creation for sign language processing and translation technology |
| topic | sign language machine translation co-creation sign language community relationship typology techniques sign languages |
| url | https://www.mdpi.com/2078-2489/16/4/290 |
| work_keys_str_mv | AT lisalepp cocreationforsignlanguageprocessingandtranslationtechnology AT dimitarshterionov cocreationforsignlanguageprocessingandtranslationtechnology AT mirelladesisto cocreationforsignlanguageprocessingandtranslationtechnology AT grzegorzchrupała cocreationforsignlanguageprocessingandtranslationtechnology |