Abstract:In Location-Based Services (LBS), such as food delivery, a fundamental task is segmenting Areas of Interest (AOIs), aiming at partitioning the urban geographical spaces into non-overlapping regions. Traditional AOI segmentation algorithms primarily rely on road networks to partition urban areas. While promising in modeling the geo-semantics, road network-based models overlooked the service-semantic goals (e.g., workload equality) in LBS service. In this paper, we point out that the AOI segmentation problem can be naturally formulated as a Markov Decision Process (MDP), which gradually chooses a nearby AOI for each grid in the current AOI's border. Based on the MDP, we present the first attempt to generalize Deep Reinforcement Learning (DRL) for AOI segmentation, leading to a novel DRL-based framework called DRL4AOI. The DRL4AOI framework introduces different service-semantic goals in a flexible way by treating them as rewards that guide the AOI generation. To evaluate the effectiveness of DRL4AOI, we develop and release an AOI segmentation system. We also present a representative implementation of DRL4AOI - TrajRL4AOI - for AOI segmentation in the logistics service. It introduces a Double Deep Q-learning Network (DDQN) to gradually optimize the AOI generation for two specific semantic goals: i) trajectory modularity, i.e., maximize tightness of the trajectory connections within an AOI and the sparsity of connections between AOIs, ii) matchness with the road network, i.e., maximizing the matchness between AOIs and the road network. Quantitative and qualitative experiments conducted on synthetic and real-world data demonstrate the effectiveness and superiority of our method. The code and system is publicly available at <a class="link-external link-https" href="https://github.com/Kogler7/AoiOpt" rel="external noopener nofollow">this https URL</a>.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is: in location - based services (LBS), how to effectively divide urban geographical space into multiple non - overlapping areas of interest (AOI) to meet the service semantic goals. Traditional AOI segmentation algorithms mainly rely on road networks to divide urban areas. Although they can model geographical semantics well, they ignore the service semantic goals in LBS (such as workload balance). For this reason, this paper proposes a new deep reinforcement learning (DRL) framework - DRL4AOI for semantic - aware AOI segmentation. Specifically, the paper addresses the following issues: 1. **Limitations of traditional methods**: Fixed - shape and road - network - based methods cannot fully capture service semantic information. Although optimization methods introduce service semantic goals, they face challenges in modeling rich spatio - temporal features. 2. **Introduction of deep reinforcement learning**: The AOI segmentation problem is naturally formulated as a Markov decision process (MDP), and deep reinforcement learning (DRL) is used to solve this problem for the first time. By using the service semantic goal as a reward, the generation of AOI is guided. 3. **Specific application scenarios**: A model named TrajRL4AOI is proposed, which is specifically used for AOI segmentation in logistics services, aiming to achieve two service semantic goals: trajectory modularization and the degree of matching with the road network. ### Formula summary - **Trajectory modularization goal**: \[ o_1=\min_A\sum_{\tau}N_{\text{switch}}(A,\tau) \] where \(N_{\text{switch}}(A,\tau)\) represents the number of AOI switches in trajectory \(\tau\). - **Goal of matching with the road network**: \[ o_2 = \max_A\text{Similarity}(A,A_G) \] where \(\text{Similarity}\) is a function for calculating the similarity between two segmentation results, \(A\) is the segmentation result generated by the model, and \(A_G\) is the initial segmentation result based on the road network. Through these formulas and methods, the paper provides a flexible and effective framework that can achieve high - quality AOI segmentation in different LBS applications.

DRL4AOI: A DRL Framework for Semantic-aware AOI Segmentation in Location-Based Services

Multimodal Urban Areas of Interest Generation via Remote Sensing Imagery and Geographical Prior

DRL4Route: A Deep Reinforcement Learning Framework for Pick-up and Delivery Route Prediction

Lyapunov-guided Deep Reinforcement Learning for Semantic-aware AoI Minimization in UAV-assisted Wireless Networks

C-AOI: Contour-based Instance Segmentation for High-Quality Areas-of-Interest in Online Food Delivery Platform

Efficient Spatial-Temporal Information Fusion for LiDAR-Based 3D Moving Object Segmentation

Simultaneous Detection of Multiple Areas-of-interest Using Geospatial Data from an Online Food Delivery Platform (industrial Paper)

A Spatiotemporal Correspondence Approach to Unsupervised LiDAR Segmentation with Traffic Applications

iNAV-drlSLAM: An Improved Indoor Self-Driving Framework for Mobile Robots using Deep Reinforcement Learning integrated with SLAM

RS-SLAM: Real time semantic slam with driverless car using LiDAR-Camera-IMU sensing

Real-Time Segmentation of Unstructured Environments by Combining Domain Generalization and Attention Mechanisms

Fine-Grained Off-Road Semantic Segmentation and Mapping via Contrastive Learning

Autonomous Driving Control Based on the Technique of Semantic Segmentation

Deep reinforcement learning architectures for automatic organ segmentation

3D Instance Segmentation and Object Detection Framework Based on the Fusion of Lidar Remote Sensing and Optical Image Sensing

LiDAR-based 4D Panoptic Segmentation via Dynamic Shifting Network

MODRL-TA:A Multi-Objective Deep Reinforcement Learning Framework for Traffic Allocation in E-Commerce Search

A deep learning based framework for remote sensing image ground object segmentation

Improved LiDAR Odometry and Mapping using Deep Semantic Segmentation and Novel Outliers Detection

LiSD: An Efficient Multi-Task Learning Framework for LiDAR Segmentation and Detection