Automatic detection, 3D localization, and semantic enrichment of commercial signboards using 360° mobile mapping imagery: A case study in temara, Morocco

The regulation of urban advertising signage is critical for preserving visual harmony and ensuring regulatory compliance in moderncities. This study presents a novel pipeline for the automatic detection, tracking, geolocation, and textual identification of storefrontsignboards from 360° Panoramic imagery acquired via Mobile Mapping Systems (MMS). We first fine-tune a YOLOv11 object de-tection model on a custom-labeled dataset of urban scenes, enabling robust identification of signboards across varied viewing angles.To associate detections across consecutive frames, we leverage the integrated YOLOv11 tracking mode, which assigns consistentobject IDs based on motion and appearance features. Each tracked instance is then localized in 3D space using a photogrammetricLine of Bearing (LoB) method, relying on known camera poses and pixel coordinates. In parallel, we extract the textual content fromeach detected sign using advanced GPT-4o Vision, which has demonstrated improved performance in complex visual environment.The proposed pipeline offers a scalable alternative to manual inspection, providing precise spatial and semantic information abouturban signage. The pixel-wise projection precision, quantified by an average RMSE of 7.75 pixels (median 7.17px, std dev 2.80px) derived from LoB intersection consistency, confirms the pipeline’s reliability for automated urban inventory systems and smart city applications.