Measuring Perceptual and Linguistic Complexity in Multilingual Grounded Language Data

The success of grounded language acquisition using perceptual data (e.g., in robotics) is affected by the complexity of both the perceptual concepts being learned and the language describing those concepts. We present methods for analyzing this complexity, using both visual features and entropy-base...

Full description

Saved in:
Bibliographic Details
Main Authors: Nisha Pillai, Cynthia Matuszek, Francis Ferraro
Format: Article
Language:English
Published: LibraryPress@UF 2021-04-01
Series:Proceedings of the International Florida Artificial Intelligence Research Society Conference
Subjects:
Online Access:https://journals.flvc.org/FLAIRS/article/view/128450
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:The success of grounded language acquisition using perceptual data (e.g., in robotics) is affected by the complexity of both the perceptual concepts being learned and the language describing those concepts. We present methods for analyzing this complexity, using both visual features and entropy-based evaluation of sentences. Our work illuminates core, quantifiable statistical differences in how language is used to describe different traits of objects, and the visual representation of those objects. The methods we use provide an additional analytical tool for research in perceptual language learning.
ISSN:2334-0754
2334-0762