A framework for performance analysis of OpenStreetMap data in navigation applications: the case of a well-developed road network in Australia

Although much effort has been put into assessing and improving OpenStreetMap (OSM) data quality, further research is required to determine its reliability and robustness for real-world applications. This study introduces a framework, built on open-source geospatial tools, for analysing the performan...

Full description

Saved in:
Bibliographic Details
Main Authors: Reza Hosseini, Daoqin Tong, Samsung Lim, Gunho Sohn, Győző Gidófalvi
Format: Article
Language:English
Published: Taylor & Francis Group 2025-04-01
Series:Annals of GIS
Subjects:
Online Access:https://www.tandfonline.com/doi/10.1080/19475683.2025.2468184
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1850139965713809408
author Reza Hosseini
Daoqin Tong
Samsung Lim
Gunho Sohn
Győző Gidófalvi
author_facet Reza Hosseini
Daoqin Tong
Samsung Lim
Gunho Sohn
Győző Gidófalvi
author_sort Reza Hosseini
collection DOAJ
description Although much effort has been put into assessing and improving OpenStreetMap (OSM) data quality, further research is required to determine its reliability and robustness for real-world applications. This study introduces a framework, built on open-source geospatial tools, for analysing the performance of OSM road data across different navigation applications. We tested this framework on an extensive 41,000 km road network in Australia. While our findings generally supported the quality of the OSM dataset, analyses of census data revealed two key relationships: first, a significant link between a city’s population and the quality of its OSM data, and second, a strong influence of Information and Communications Technology (ICT) infrastructure on OSM data development. Furthermore, while navigation tests showed that OSM road networks performed reasonably well, scenario analyses highlighted several issues: a strong correlation between data quality and navigation accuracy; a negative impact of distance on OSM-based route accuracy for long inner- and inter-city routes due to accumulated errors; and the tendency of OSM to suggest sub-optimal paths for routes to isolated locations. This framework offers valuable benefits to a wide range of users. The OSM community can use it to assess data quality before application; individuals and businesses can easily evaluate its utility for navigation and route-planning; and local governments can benefit from improved quality control, particularly for projects involving Connected and Automated Vehicles (CAVs). Finally, the framework’s capacity to design and analyse various routing scenarios provides new insights into overall road network quality.
format Article
id doaj-art-a0e5caae2e284d42ae20f625aac52d51
institution OA Journals
issn 1947-5683
1947-5691
language English
publishDate 2025-04-01
publisher Taylor & Francis Group
record_format Article
series Annals of GIS
spelling doaj-art-a0e5caae2e284d42ae20f625aac52d512025-08-20T02:30:00ZengTaylor & Francis GroupAnnals of GIS1947-56831947-56912025-04-0131223325010.1080/19475683.2025.2468184A framework for performance analysis of OpenStreetMap data in navigation applications: the case of a well-developed road network in AustraliaReza Hosseini0Daoqin Tong1Samsung Lim2Gunho Sohn3Győző Gidófalvi4Department of Remote Sensing and GIS, Tarbiat Modares University, Tehran, IranSchool of Geographical Sciences and Urban Planning, Arizona State University, Tempe, USASchool of Civil and Environmental Engineering, University of New South Wales, Sydney, AustraliaDepartment of Earth and Space Science & Engineering, Lassonde School of Engineering, York University, Toronto, CanadaDivision of Geoinformatics, Department of Urban Planning and Environment, KTH Royal Institute of Technology, Stockholm, SwedenAlthough much effort has been put into assessing and improving OpenStreetMap (OSM) data quality, further research is required to determine its reliability and robustness for real-world applications. This study introduces a framework, built on open-source geospatial tools, for analysing the performance of OSM road data across different navigation applications. We tested this framework on an extensive 41,000 km road network in Australia. While our findings generally supported the quality of the OSM dataset, analyses of census data revealed two key relationships: first, a significant link between a city’s population and the quality of its OSM data, and second, a strong influence of Information and Communications Technology (ICT) infrastructure on OSM data development. Furthermore, while navigation tests showed that OSM road networks performed reasonably well, scenario analyses highlighted several issues: a strong correlation between data quality and navigation accuracy; a negative impact of distance on OSM-based route accuracy for long inner- and inter-city routes due to accumulated errors; and the tendency of OSM to suggest sub-optimal paths for routes to isolated locations. This framework offers valuable benefits to a wide range of users. The OSM community can use it to assess data quality before application; individuals and businesses can easily evaluate its utility for navigation and route-planning; and local governments can benefit from improved quality control, particularly for projects involving Connected and Automated Vehicles (CAVs). Finally, the framework’s capacity to design and analyse various routing scenarios provides new insights into overall road network quality.https://www.tandfonline.com/doi/10.1080/19475683.2025.2468184OSM data qualitynavigation accuracyframeworkperformance analysisgeospatial tools
spellingShingle Reza Hosseini
Daoqin Tong
Samsung Lim
Gunho Sohn
Győző Gidófalvi
A framework for performance analysis of OpenStreetMap data in navigation applications: the case of a well-developed road network in Australia
Annals of GIS
OSM data quality
navigation accuracy
framework
performance analysis
geospatial tools
title A framework for performance analysis of OpenStreetMap data in navigation applications: the case of a well-developed road network in Australia
title_full A framework for performance analysis of OpenStreetMap data in navigation applications: the case of a well-developed road network in Australia
title_fullStr A framework for performance analysis of OpenStreetMap data in navigation applications: the case of a well-developed road network in Australia
title_full_unstemmed A framework for performance analysis of OpenStreetMap data in navigation applications: the case of a well-developed road network in Australia
title_short A framework for performance analysis of OpenStreetMap data in navigation applications: the case of a well-developed road network in Australia
title_sort framework for performance analysis of openstreetmap data in navigation applications the case of a well developed road network in australia
topic OSM data quality
navigation accuracy
framework
performance analysis
geospatial tools
url https://www.tandfonline.com/doi/10.1080/19475683.2025.2468184
work_keys_str_mv AT rezahosseini aframeworkforperformanceanalysisofopenstreetmapdatainnavigationapplicationsthecaseofawelldevelopedroadnetworkinaustralia
AT daoqintong aframeworkforperformanceanalysisofopenstreetmapdatainnavigationapplicationsthecaseofawelldevelopedroadnetworkinaustralia
AT samsunglim aframeworkforperformanceanalysisofopenstreetmapdatainnavigationapplicationsthecaseofawelldevelopedroadnetworkinaustralia
AT gunhosohn aframeworkforperformanceanalysisofopenstreetmapdatainnavigationapplicationsthecaseofawelldevelopedroadnetworkinaustralia
AT gyozogidofalvi aframeworkforperformanceanalysisofopenstreetmapdatainnavigationapplicationsthecaseofawelldevelopedroadnetworkinaustralia
AT rezahosseini frameworkforperformanceanalysisofopenstreetmapdatainnavigationapplicationsthecaseofawelldevelopedroadnetworkinaustralia
AT daoqintong frameworkforperformanceanalysisofopenstreetmapdatainnavigationapplicationsthecaseofawelldevelopedroadnetworkinaustralia
AT samsunglim frameworkforperformanceanalysisofopenstreetmapdatainnavigationapplicationsthecaseofawelldevelopedroadnetworkinaustralia
AT gunhosohn frameworkforperformanceanalysisofopenstreetmapdatainnavigationapplicationsthecaseofawelldevelopedroadnetworkinaustralia
AT gyozogidofalvi frameworkforperformanceanalysisofopenstreetmapdatainnavigationapplicationsthecaseofawelldevelopedroadnetworkinaustralia