Generative AI + Virtual Reality: A training tool


Sometime in late 2023, when the generative-ai community suddenly shifted their focus to picture and video generation, I started developing a framework to first generate textures of materials based on the description that the inspection guidelines provide. This concept quickly evolves into a a framework to generate auditory and visual cues for 3D objects.

Proposed framework.

In a conference paper titled “Generative Artificial Intelligence and Virtual Reality: Emerging Future of the Building Component Inspection Training”, presented in CIB WBC CIB 2025, I described this framework in details. The framework integrates generative artificial intelligence (Gen AI) with virtual reality (VR) to create a more immersive and effective training environment for building maintenance and operations. Traditional training methods often rely on static visuals and text, limiting inspectors’ exposure to the diverse and complex conditions found in real-world scenarios. In contrast, the proposed approach leverages Gen AI to generate realistic textures of deteriorating building components, which are then embedded into an interactive VR environment. This enables trainees to engage in hands-on, immersive practice, improving their ability to identify and assess conditions accurately. The framework aims to reduce subjectivity in inspections and enhance knowledge transfer. A hypothetical case study demonstrates the framework’s potential, highlighting its broader applicability not only in building maintenance but also in other domains that require precise, objective evaluations.

An example of the proposed concept

You can find more information about this framework at the following links:

Recommended Citation:

@inproceedings{Movahedi2025, 
   author = {Mohammad Movahedi and Carlos Bravo and Juyeong Choi},
   doi = {10.7771/3067-4883.1429},
   booktitle = {23rd CIB World Building Congress},
   keywords = {generative artificial intelligence,virtual reality,visual inspection},
   pages = {1-10},
   title = {Generative Artificial Intelligence and Virtual Reality : Emerging Future of the Building Component Inspection Training},
   year = {2025}
}

Leave a comment