A Novel Framework for Natural Language Interaction with 4D BIM

Natural language interfaces can transform the construction industry by enhancing accessibility and reducing administrative workload in the day-to-day operations of project teams. This paper introduces the Voice-Integrated Scheduling Assistant for 4D BIM (VISA4D) tool that integrates speech recogniti...

Full description

Saved in:
Bibliographic Details
Main Authors: Larin Jaff, Sahej Garg, Gursans Guven
Format: Article
Language:English
Published: MDPI AG 2025-05-01
Series:Buildings
Subjects:
Online Access:https://www.mdpi.com/2075-5309/15/11/1840
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1850128851453083648
author Larin Jaff
Sahej Garg
Gursans Guven
author_facet Larin Jaff
Sahej Garg
Gursans Guven
author_sort Larin Jaff
collection DOAJ
description Natural language interfaces can transform the construction industry by enhancing accessibility and reducing administrative workload in the day-to-day operations of project teams. This paper introduces the Voice-Integrated Scheduling Assistant for 4D BIM (VISA4D) tool that integrates speech recognition and Natural Language Processing (NLP) capabilities with Building Information Modeling (BIM) to streamline construction schedule updating and maintenance processes. It accepts voice and text inputs for schedule updates, facilitating real-time integration with Autodesk Navisworks, and eliminates the need for direct access to or advanced knowledge of BIM tools. It also provides visual progress tracking abilities through colour-coded elements within the 4D BIM model for communicating task status updates within the project teams. To demonstrate its capability to enhance schedule updating and maintenance efficiency, the VISA4D tool is implemented in an office building project in Canada and user testing is performed. An overall accuracy of 89% was observed in successfully classifying 71 out of 80 tested construction-specific commands, while the user surveys indicated high usability, with 92% of participants finding VISA4D easy to use and reporting consistent command recognition accuracy. This study advances the existing work on AI-enhanced construction management tools by tackling the challenges associated with their practical implementation in field operations.
format Article
id doaj-art-2a2c2ef089d24156ab45f3d46647ca86
institution OA Journals
issn 2075-5309
language English
publishDate 2025-05-01
publisher MDPI AG
record_format Article
series Buildings
spelling doaj-art-2a2c2ef089d24156ab45f3d46647ca862025-08-20T02:33:09ZengMDPI AGBuildings2075-53092025-05-011511184010.3390/buildings15111840A Novel Framework for Natural Language Interaction with 4D BIMLarin Jaff0Sahej Garg1Gursans Guven2Department of Civil Engineering, Price Faculty of Engineering, University of Manitoba, Winnipeg, MB R3T 5V6, CanadaDepartment of Electrical and Computer Engineering, Price Faculty of Engineering, University of Manitoba, Winnipeg, MB R3T 5V6, CanadaDepartment of Civil Engineering, Price Faculty of Engineering, University of Manitoba, Winnipeg, MB R3T 5V6, CanadaNatural language interfaces can transform the construction industry by enhancing accessibility and reducing administrative workload in the day-to-day operations of project teams. This paper introduces the Voice-Integrated Scheduling Assistant for 4D BIM (VISA4D) tool that integrates speech recognition and Natural Language Processing (NLP) capabilities with Building Information Modeling (BIM) to streamline construction schedule updating and maintenance processes. It accepts voice and text inputs for schedule updates, facilitating real-time integration with Autodesk Navisworks, and eliminates the need for direct access to or advanced knowledge of BIM tools. It also provides visual progress tracking abilities through colour-coded elements within the 4D BIM model for communicating task status updates within the project teams. To demonstrate its capability to enhance schedule updating and maintenance efficiency, the VISA4D tool is implemented in an office building project in Canada and user testing is performed. An overall accuracy of 89% was observed in successfully classifying 71 out of 80 tested construction-specific commands, while the user surveys indicated high usability, with 92% of participants finding VISA4D easy to use and reporting consistent command recognition accuracy. This study advances the existing work on AI-enhanced construction management tools by tackling the challenges associated with their practical implementation in field operations.https://www.mdpi.com/2075-5309/15/11/1840building information modelingBIMartificial intelligenceconversational AInatural language processing4D BIM
spellingShingle Larin Jaff
Sahej Garg
Gursans Guven
A Novel Framework for Natural Language Interaction with 4D BIM
Buildings
building information modeling
BIM
artificial intelligence
conversational AI
natural language processing
4D BIM
title A Novel Framework for Natural Language Interaction with 4D BIM
title_full A Novel Framework for Natural Language Interaction with 4D BIM
title_fullStr A Novel Framework for Natural Language Interaction with 4D BIM
title_full_unstemmed A Novel Framework for Natural Language Interaction with 4D BIM
title_short A Novel Framework for Natural Language Interaction with 4D BIM
title_sort novel framework for natural language interaction with 4d bim
topic building information modeling
BIM
artificial intelligence
conversational AI
natural language processing
4D BIM
url https://www.mdpi.com/2075-5309/15/11/1840
work_keys_str_mv AT larinjaff anovelframeworkfornaturallanguageinteractionwith4dbim
AT sahejgarg anovelframeworkfornaturallanguageinteractionwith4dbim
AT gursansguven anovelframeworkfornaturallanguageinteractionwith4dbim
AT larinjaff novelframeworkfornaturallanguageinteractionwith4dbim
AT sahejgarg novelframeworkfornaturallanguageinteractionwith4dbim
AT gursansguven novelframeworkfornaturallanguageinteractionwith4dbim