Abstract:For facility management, photography is an efficient and accurate method of recording the physical state of infrastructure. However, without an effective organizational scheme, the difficulty of retrieving relevant photos from historical databases can become overly burdensome for highly complex or long-lived assets. To make strategic decisions, it is crucial to retrieve the right information from a plurality of sources in a timely manner. The main objective of this paper is to present a method for organizing and retrieving photos from massive facility management photo databases using photo-metadata: photographed location, camera perspective, and image semantic content information. Indoor localization experiments were performed using Bluetooth technology to infer the location information. Perspective is inferred from the device's on-board inertial measurement unit (IMU). Image semantic content is inferred using a Convolutional Neural Network (CNN)-based deep learning algorithm. Fusing these three features, seven query options were provided for the user when retrieving images. Leveraging Building Information Modeling (BIM) as a process and Geographic Information Systems (GIS) as a framework, this paper also envisions a federated information management by connecting 2D and 3D facility assets with our real-world map which can be smoothly bridged with our image retrieval system. The realization of the integrated application with BIM and GIS is significantly beneficial for the facility management domain by advancing the understanding of projects in a broader view with a federated data platform. In this research, the framework is illustrated with 21 institutional buildings within the University of Texas at Austin's main campus, and the authors conclude that the proposed metadata-based image retrieval system can ultimately enhance the better-informed decision-making process through rapid information retrieval.

Region Based Cameraphone Image Retrieval Incorporated with Metadata

Region Based Image Retrieval Incorporated With Camera Metadata

Enhanced Micro-structure Descriptor based Image Retrieval.

Multistage and Multi-features Medical Image Retrieval System

Photo-to-Search: Using Camera Phones to Inquire of the Surrounding World

Magazine Image Retrieval with Camera-Phone

Color Image Retrieval System Based on Shape and Texture Watermarks

Spatial Verification for Scalable Mobile Image Retrieval

Photo-to-search: using multimodal queries to search the web from mobile devices.

Scalable Mobile Image Retrieval by Exploring Contextual Saliency

A CONTENT-BASED IMAGE RETRIEVAL SCHEME IN JPEG COMPRESSED DOMAIN

Inquiring of the Sights from the Web Via Camera Mobiles

Advanced Techniques for Object-Based Image Retrieval

An Efficient and Effective Region-Based Image Retrieval Framework

An application of metadata-based image retrieval system for facility management

An image semantic retrieval system design and realization

Learning Salient Visual Word for Scalable Mobile Image Retrieval.

A prototype system of content-based retrieval of remote sensing images

Visual and textual fusion for semantically supervised region-based retrieval

Web-Based Image Retrieval: A Hybrid Approach

Towards Privacy-Preserving Content-Based Image Retrieval in Cloud Computing