Biodiversity in NLP: modelling lexical meaning with the Fruit Fly Algorithm
The natural world is very diverse in terms of biological organisation, and solves problems in a wide variety of efficient and creative manners. This biodiversity is in stark contrast with the landscape of artificial models in the field of Natural Language Processing (NLP). In the last years, NLP alg...
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Accademia University Press
2020-06-01
|
| Series: | IJCoL |
| Online Access: | https://journals.openedition.org/ijcol/609 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850165953577353216 |
|---|---|
| author | Simon Preissner Aurélie Herbelot |
| author_facet | Simon Preissner Aurélie Herbelot |
| author_sort | Simon Preissner |
| collection | DOAJ |
| description | The natural world is very diverse in terms of biological organisation, and solves problems in a wide variety of efficient and creative manners. This biodiversity is in stark contrast with the landscape of artificial models in the field of Natural Language Processing (NLP). In the last years, NLP algorithms have clustered around a few very expensive architectures, the cost of which has many facets, including training times, storage, replicability, interpretability, equality of access to experimental paradigms, and even environmental impact. Inspired by the biodiversity of the real world, we argue for a methodology which promotes ‘artificial diversity’, and we further propose that cognitively-inspired algorithms are a good starting point to explore new architectures. As a case study, we investigate the fruit fly’s olfactory system as a distributional semantics model. We show that, even in its rawest form, it provides many of the features that we might require from a good model of meaning acquisition, and that the original architecture can serve as a basis for cognitively-inspired extensions. We focus on one such extension by implementing a mechanism of neural adaptation. |
| format | Article |
| id | doaj-art-784415639ca749c39b6a4e3b6fc8a000 |
| institution | OA Journals |
| issn | 2499-4553 |
| language | English |
| publishDate | 2020-06-01 |
| publisher | Accademia University Press |
| record_format | Article |
| series | IJCoL |
| spelling | doaj-art-784415639ca749c39b6a4e3b6fc8a0002025-08-20T02:21:35ZengAccademia University PressIJCoL2499-45532020-06-0161112810.4000/ijcol.609Biodiversity in NLP: modelling lexical meaning with the Fruit Fly AlgorithmSimon PreissnerAurélie HerbelotThe natural world is very diverse in terms of biological organisation, and solves problems in a wide variety of efficient and creative manners. This biodiversity is in stark contrast with the landscape of artificial models in the field of Natural Language Processing (NLP). In the last years, NLP algorithms have clustered around a few very expensive architectures, the cost of which has many facets, including training times, storage, replicability, interpretability, equality of access to experimental paradigms, and even environmental impact. Inspired by the biodiversity of the real world, we argue for a methodology which promotes ‘artificial diversity’, and we further propose that cognitively-inspired algorithms are a good starting point to explore new architectures. As a case study, we investigate the fruit fly’s olfactory system as a distributional semantics model. We show that, even in its rawest form, it provides many of the features that we might require from a good model of meaning acquisition, and that the original architecture can serve as a basis for cognitively-inspired extensions. We focus on one such extension by implementing a mechanism of neural adaptation.https://journals.openedition.org/ijcol/609 |
| spellingShingle | Simon Preissner Aurélie Herbelot Biodiversity in NLP: modelling lexical meaning with the Fruit Fly Algorithm IJCoL |
| title | Biodiversity in NLP: modelling lexical meaning with the Fruit Fly Algorithm |
| title_full | Biodiversity in NLP: modelling lexical meaning with the Fruit Fly Algorithm |
| title_fullStr | Biodiversity in NLP: modelling lexical meaning with the Fruit Fly Algorithm |
| title_full_unstemmed | Biodiversity in NLP: modelling lexical meaning with the Fruit Fly Algorithm |
| title_short | Biodiversity in NLP: modelling lexical meaning with the Fruit Fly Algorithm |
| title_sort | biodiversity in nlp modelling lexical meaning with the fruit fly algorithm |
| url | https://journals.openedition.org/ijcol/609 |
| work_keys_str_mv | AT simonpreissner biodiversityinnlpmodellinglexicalmeaningwiththefruitflyalgorithm AT aurelieherbelot biodiversityinnlpmodellinglexicalmeaningwiththefruitflyalgorithm |