Abstract:Proactively searching for objects like humans may be a basic requirement for intelligent service robots. The path planning during the searching process can be modeled as a Partially Observable Markov Decision Process (POMDP). In this work, we propose a Probabilistic Voronoi Diagram (PVD) for object search strategy planning on the basis of POMDP. Firstly, an environmental knowledge base is constructed to record the information of objects, and a Bidirectional Encoder Representations from Transformers (BERT) model [1] is trained to encode and decompose the semantic knowledge in the environment. In order to reveal the interrelationships between objects, a Gaussian Mixture Model (GMM) is adopted using the information within the environmental knowledge base. In order to accelerate the searching efficiency, the Generalized Voronoi Diagram (GVD) is introduced to discretize the map and generate the environmental topological map. In order to further establish the spatial correlation between objects, we propose combining the GVD topological map with the GMM to generate the PVD, which can respond to the probability distribution of objects. On the basis of PVD, we further model the object search problem as a POMDP problem by considering the region search cost and the distance traveled cost of the robot in performing solutions. When making observations and updates, the object-to-object relationships in the knowledge base are extracted by the robot to optimize decisions when observing objects related to the target object. Both real-world experimental studies and simulations reveal that our algorithm is very close to human search strategies and outperforms other state-of-the-art algorithms in terms of trajectory length and running time.

Towards Optimal Correlational Object Search

Efficient Planning for Object Search Task Based on Hierarchical POMDP

An Active Robot Object Search Strategy Based on Probabilistic Voronoi Diagram and POMDP

Probabilistically Informed Robot Object Search with Multiple Regions

Language-Conditioned Observation Models for Visual Object Search

Object search using object co-occurrence relations derived from web content mining

Spatial Language Understanding for Object Search in Partially Observed City-scale Environments

A System for Generalized 3D Multi-Object Search

Efficient Nonlinear Correlation Detection for Decomposed Search in Evolutionary Multi-Objective Optimization

Active Object Search

RoCo:Robust Collaborative Perception By Iterative Object Matching and Pose Adjustment

Co-salient Object Detection with Iterative Purification and Predictive Optimization

Correlation of Object Detection Performance with Visual Saliency and Depth Estimation

SEEK: Semantic Reasoning for Object Goal Navigation in Real World Inspection Tasks

Preferential Multi-Target Search in Indoor Environments using Semantic SLAM

Object-centric Representations for Interactive Online Learning with Non-Parametric Methods

iCORPP: Interleaved commonsense reasoning and probabilistic planning on robots

Dialogue Object Search

Learning hierarchical relationships for object-goal navigation

A Search Space Utility Optimization Based Online POMDP Planning Algorithm

Object Retrieval Using Visual Query Context