Abstract:Feature selection is the preprocessing step in machine learning which tries to select the most relevant features for the subsequent prediction task. Effective feature selection could help reduce dimensionality, improve prediction accuracy and increase result comprehensibility. It is very challenging to find the optimal feature subset from the subset space as the space could be very large. While much effort has been made by existing studies, reinforcement learning can provide a new perspective for the searching strategy in a more global way. In this paper, we propose a multi-agent reinforcement learning framework for the feature selection problem. Specifically, we first reformulate feature selection with a reinforcement learning framework by regarding each feature as an agent. Then, we obtain the state of environment in three ways, i.e., statistic description, autoencoder and graph convolutional network (GCN), in order to make the algorithm better understand the learning progress. We show how to learn the state representation in a graph-based way, which could tackle the case when not only the edges, but also the nodes are changing step by step. In addition, we study how the coordination between different features would be improved by more reasonable reward scheme. The proposed method could search the feature subset space globally and could be easily adapted to the real-time case (real-time feature selection) due to the nature of reinforcement learning. Also, we provide an efficient strategy to accelerate the convergence of multi-agent reinforcement learning. Finally, extensive experimental results show the significant improvement of the proposed method over conventional approaches.

Local and soft feature selection for value function approximation in batch reinforcement learning for robot navigation

A LiDAR Based End to End Controller for Robot Navigation Using Deep Neural Network

Scalable Networked Feature Selection with Randomized Algorithm for Robot Navigation

Deep Reinforcement Learning for Localizability-Enhanced Navigation in Dynamic Human Environments

Estimation with Fast Landmark Selection in Robot Visual Navigation

Learning to Navigate in a VUCA Environment: Hierarchical Multi-expert Approach

Efficient Reinforcement Learning for 3D LiDAR Navigation of Mobile Robot

A Soft Actor-Critic Deep Reinforcement-Learning-Based Robot Navigation Method Using LiDAR

Inverse reinforcement learning-based time-dependent A* planner for human-aware robot navigation with local vision

A Mapless Local Path Planning Approach Using Deep Reinforcement Learning Framework

Improving Reliable Navigation under Uncertainty via Predictions Informed by Non-Local Information

Automating Feature Subspace Exploration via Multi-Agent Reinforcement Learning

An Efficient Planning Method for Autonomous Navigation of a Wheeled-Robot based on Deep Reinforcement Learning

Robot in a China Shop: Using Reinforcement Learning for Location-Specific Navigation Behaviour

An Efficient Learning Based Autonomous Exploration Algorithm for Mobile Robots.

When to Localize? A Risk-Constrained Reinforcement Learning Approach

Deep Reinforcement Learning to Acquire Navigation Skills for Wheel-Legged Robots in Complex Environments

Robot Crowd Navigation in Dynamic Environment with Offline Reinforcement Learning

Efficient Autonomous Exploration and Mapping in Unknown Environments

Dynamic Adaptive Dynamic Window Approach

Robust Feature Matching for Robot Visual Learning