Real-world visual search goes beyond eye movements: Active searchers select 3D scene viewpoints too.

Visual search is a ubiquitous task; people search for objects on a daily basis. However, the majority of the existing visual search literature focuses on passive search on a 2D computer screen, a far cry from emulating a real-world environment. Search is a real-world task that involves active observ...

Full description

Saved in:
Bibliographic Details
Main Authors: Tiffany C Wu, John K Tsotsos
Format: Article
Language:English
Published: Public Library of Science (PLoS) 2025-01-01
Series:PLoS ONE
Online Access:https://doi.org/10.1371/journal.pone.0319719
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1849430520544362496
author Tiffany C Wu
John K Tsotsos
author_facet Tiffany C Wu
John K Tsotsos
author_sort Tiffany C Wu
collection DOAJ
description Visual search is a ubiquitous task; people search for objects on a daily basis. However, the majority of the existing visual search literature focuses on passive search on a 2D computer screen, a far cry from emulating a real-world environment. Search is a real-world task that involves active observation. Search targets may be occluded, completely out of the observer's line of sight, or oriented in unconventional ways. This is typically mitigated by actively selecting viewpoints, an important aspect of search behaviour with limited scope on a computer screen. Our goal was to explore viewpoint selection in active visual search. Subject eye and head movements were tracked as they moved freely while searching for toy objects in a controlled 3-dimensional environment, yielding the first such record of search-driven viewpoint selection. We found that subjects utilized their full range of eye and head motion to move from viewpoint to viewpoint, apparently employing a variety of objectives including changing viewing height and pose depending on object 3D pose. Subjects were also adept at selecting unobstructed views to search through otherwise occluded areas with objects. Furthermore, subjects completed the search task with high accuracy, even with no training on the environment. Although no learning was found in terms of accuracy over the duration of the experiment, increases in efficiency were found for other metrics such as response time, number of fixations, and distance travelled, particularly in target present trials where the target was not visible from the starting location. These results paint the story of a visual system that selects and moves to useful and informative views to facilitate the successful execution of an active visual search task, and stresses the significance of active vision research in understanding how vision is used in naturalistic environments.
format Article
id doaj-art-c14a4df7cb1042ceaf71fb6a2e74f44c
institution Kabale University
issn 1932-6203
language English
publishDate 2025-01-01
publisher Public Library of Science (PLoS)
record_format Article
series PLoS ONE
spelling doaj-art-c14a4df7cb1042ceaf71fb6a2e74f44c2025-08-20T03:27:57ZengPublic Library of Science (PLoS)PLoS ONE1932-62032025-01-01207e031971910.1371/journal.pone.0319719Real-world visual search goes beyond eye movements: Active searchers select 3D scene viewpoints too.Tiffany C WuJohn K TsotsosVisual search is a ubiquitous task; people search for objects on a daily basis. However, the majority of the existing visual search literature focuses on passive search on a 2D computer screen, a far cry from emulating a real-world environment. Search is a real-world task that involves active observation. Search targets may be occluded, completely out of the observer's line of sight, or oriented in unconventional ways. This is typically mitigated by actively selecting viewpoints, an important aspect of search behaviour with limited scope on a computer screen. Our goal was to explore viewpoint selection in active visual search. Subject eye and head movements were tracked as they moved freely while searching for toy objects in a controlled 3-dimensional environment, yielding the first such record of search-driven viewpoint selection. We found that subjects utilized their full range of eye and head motion to move from viewpoint to viewpoint, apparently employing a variety of objectives including changing viewing height and pose depending on object 3D pose. Subjects were also adept at selecting unobstructed views to search through otherwise occluded areas with objects. Furthermore, subjects completed the search task with high accuracy, even with no training on the environment. Although no learning was found in terms of accuracy over the duration of the experiment, increases in efficiency were found for other metrics such as response time, number of fixations, and distance travelled, particularly in target present trials where the target was not visible from the starting location. These results paint the story of a visual system that selects and moves to useful and informative views to facilitate the successful execution of an active visual search task, and stresses the significance of active vision research in understanding how vision is used in naturalistic environments.https://doi.org/10.1371/journal.pone.0319719
spellingShingle Tiffany C Wu
John K Tsotsos
Real-world visual search goes beyond eye movements: Active searchers select 3D scene viewpoints too.
PLoS ONE
title Real-world visual search goes beyond eye movements: Active searchers select 3D scene viewpoints too.
title_full Real-world visual search goes beyond eye movements: Active searchers select 3D scene viewpoints too.
title_fullStr Real-world visual search goes beyond eye movements: Active searchers select 3D scene viewpoints too.
title_full_unstemmed Real-world visual search goes beyond eye movements: Active searchers select 3D scene viewpoints too.
title_short Real-world visual search goes beyond eye movements: Active searchers select 3D scene viewpoints too.
title_sort real world visual search goes beyond eye movements active searchers select 3d scene viewpoints too
url https://doi.org/10.1371/journal.pone.0319719
work_keys_str_mv AT tiffanycwu realworldvisualsearchgoesbeyondeyemovementsactivesearchersselect3dsceneviewpointstoo
AT johnktsotsos realworldvisualsearchgoesbeyondeyemovementsactivesearchersselect3dsceneviewpointstoo