For a Semiotic Approach to Generative Image AI
This article analyzes the semiotic functioning of Midjourney and DALL•E, two generative AI models capable of producing images out of natural language prompts. The theoretical assumption of this article is that the images produced by these AIs are the results of a particular intersemiotic translation...
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Department of Anthropology, University of Chicago
2025-04-01
|
| Series: | Semiotic Review |
| Subjects: | |
| Online Access: | https://semioticreview.com/sr/index.php/srindex/article/view/76 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849421110940008448 |
|---|---|
| author | Enzo D'Armenio Maria Giulia Dondero Adrien Deliège Alessandro Sarti |
| author_facet | Enzo D'Armenio Maria Giulia Dondero Adrien Deliège Alessandro Sarti |
| author_sort | Enzo D'Armenio |
| collection | DOAJ |
| description | This article analyzes the semiotic functioning of Midjourney and DALL•E, two generative AI models capable of producing images out of natural language prompts. The theoretical assumption of this article is that the images produced by these AIs are the results of a particular intersemiotic translation, realized through the collaboration of human and computational operators. Our research will show the specificity of the intersemiotic translation realized by AIs vis-à-vis more classical kinds of translation (e.g., from a novel to a movie) and will also analyze the different kinds of “visual reasoning” characterizing Midjourney and DALL•E. Our article has two goals: first, to study how these models perform intersemiotic translations; namely, what choices they make in order to translate the generality of the symbolic (and indexical) signs of verbal languages into the specificity of the visual composition. Second, we intend to verify the degree of control that one can have over the visual composition. Following this, we present the results of the tests carried out on Midjourney and DALL•E pertaining to two semiotic macro-criteria: plastic categories (eidetic, chromatic, and topological) and visual enunciation (gaze relations, visual translation of verbalized actions, temporality, and aspectuality). These criteria were developed by Paris School semiotics in order to analyze artistic images. Here, they will be used as principles of composition and parameters for controlling the results. At the end, we demonstrate that through this experimentation with elementary parameters of visual composition, semiotics can provide an epistemological and analytical framework for understanding and assessing the intersemiotic translations realized through generative AIs. Reciprocally, these tests on AIs aid our understanding of the two semiotic macro-criteria used, notably leading to a multiplication of enunciative instances in image production. Databases, algorithms, prompts, and aleatoric elements act as discursive agents. |
| format | Article |
| id | doaj-art-d21ad23012e3484cbcc7d0ed4bfca4b5 |
| institution | Kabale University |
| issn | 3066-8107 |
| language | English |
| publishDate | 2025-04-01 |
| publisher | Department of Anthropology, University of Chicago |
| record_format | Article |
| series | Semiotic Review |
| spelling | doaj-art-d21ad23012e3484cbcc7d0ed4bfca4b52025-08-20T03:31:33ZengDepartment of Anthropology, University of ChicagoSemiotic Review3066-81072025-04-01910.71743/ee5nrx33For a Semiotic Approach to Generative Image AIEnzo D'ArmenioMaria Giulia DonderoAdrien DeliègeAlessandro SartiThis article analyzes the semiotic functioning of Midjourney and DALL•E, two generative AI models capable of producing images out of natural language prompts. The theoretical assumption of this article is that the images produced by these AIs are the results of a particular intersemiotic translation, realized through the collaboration of human and computational operators. Our research will show the specificity of the intersemiotic translation realized by AIs vis-à-vis more classical kinds of translation (e.g., from a novel to a movie) and will also analyze the different kinds of “visual reasoning” characterizing Midjourney and DALL•E. Our article has two goals: first, to study how these models perform intersemiotic translations; namely, what choices they make in order to translate the generality of the symbolic (and indexical) signs of verbal languages into the specificity of the visual composition. Second, we intend to verify the degree of control that one can have over the visual composition. Following this, we present the results of the tests carried out on Midjourney and DALL•E pertaining to two semiotic macro-criteria: plastic categories (eidetic, chromatic, and topological) and visual enunciation (gaze relations, visual translation of verbalized actions, temporality, and aspectuality). These criteria were developed by Paris School semiotics in order to analyze artistic images. Here, they will be used as principles of composition and parameters for controlling the results. At the end, we demonstrate that through this experimentation with elementary parameters of visual composition, semiotics can provide an epistemological and analytical framework for understanding and assessing the intersemiotic translations realized through generative AIs. Reciprocally, these tests on AIs aid our understanding of the two semiotic macro-criteria used, notably leading to a multiplication of enunciative instances in image production. Databases, algorithms, prompts, and aleatoric elements act as discursive agents.https://semioticreview.com/sr/index.php/srindex/article/view/76semioticsgenerative artificial intelligenceintersemiotic translationvisual studiescompositionenunciation |
| spellingShingle | Enzo D'Armenio Maria Giulia Dondero Adrien Deliège Alessandro Sarti For a Semiotic Approach to Generative Image AI Semiotic Review semiotics generative artificial intelligence intersemiotic translation visual studies composition enunciation |
| title | For a Semiotic Approach to Generative Image AI |
| title_full | For a Semiotic Approach to Generative Image AI |
| title_fullStr | For a Semiotic Approach to Generative Image AI |
| title_full_unstemmed | For a Semiotic Approach to Generative Image AI |
| title_short | For a Semiotic Approach to Generative Image AI |
| title_sort | for a semiotic approach to generative image ai |
| topic | semiotics generative artificial intelligence intersemiotic translation visual studies composition enunciation |
| url | https://semioticreview.com/sr/index.php/srindex/article/view/76 |
| work_keys_str_mv | AT enzodarmenio forasemioticapproachtogenerativeimageai AT mariagiuliadondero forasemioticapproachtogenerativeimageai AT adriendeliege forasemioticapproachtogenerativeimageai AT alessandrosarti forasemioticapproachtogenerativeimageai |