Abstract:The past flourishing years of sequential point-ofinterest (POI) recommendation began with the introduction of Self-Attention Network (SAN), which quickly superseded CNN or RNN as the state-of-the-art backbone. To realize the fine-grained users' behavior patterns modeling, recent works utilize modified attention mechanisms or neural network layers to process spatialtemporal factors. However, due to the significant increase on either model's parameter scale or computational burden, we argue that these methods can be further improved. In this paper, we exploit two lightweight approaches, Time Aware Position Encoder (TAPE) and Interval Aware Attention Block (IAAB), to impel SAN by considering the spatial-temporal intervals among POIs separately, where requiring neither extra parameters nor high computational cost. On the one hand, TAPE, adjusting the positions in sequences based on the timestamps dynamically and generating positional representations with sinusoidal transformation, can enhance sequence representations to reflect both the absolute order and relative temporal proximity among all POIs. On the other hand, IAAB, point-wise adding the scaled spatial-temporal intervals to the attention map, can promote the attention mechanism attaching importance to the spatial relation among all POIs under the constraints of time conditions and providing more explainable recommendation. We integrate these two modules into SAN and propose a Spatial-Temporal Interval-Aware sequential POI recommender, namely STiSAN, as an end-to-end deployment. Experimental results based on three public LBSN datasets and one real-world city transportation dataset demonstrate STiSAN's superior performance (average 13.01% improvement against the strongest baseline). Moreover, we validate the extensibility and interpretability of TAPE and IAAB through metric evaluation and visualization separately.

A Self-Attentive Interest Retrieval Recommender

Long- and short-term self-attention network for sequential recommendation

Self-Attention Mechanism Enhanced User Interests Modeling for Personalized Recommendation Services in Cyber-Physical-Social Systems.

Sparse-Interest Network for Sequential Recommendation

Session-based Recommendation with Self-Attention Networks

CSAN: Contextual Self-Attention Network for User Sequential Recommendation.

Lighter and Better: Low-Rank Decomposed Self-Attention Networks for Next-Item Recommendation

Graph Contextualized Self-Attention Network for Session-based Recommendation

Collaborative Self-Attention Network for Session-based Recommendation.

LSIAN: Exploiting Interval Interests for Session-Based Recommendation Via Sparse Attention Network

SAN: Attention‐based Social Aggregation Neural Networks for Recommendation System

NILSIC-BERT4Rec: Sequential Recommendation with Non-Invasive and Interest Capturing Self-Attention Mechanism

SANST: A Self-Attentive Network for Next Point-of-Interest Recommendation

Spatial and Temporal User Interest Representations for Sequential Recommendation

Dual-Scale Interest Extraction Framework with Self-Supervision for Sequential Recommendation

AIR: Attentional Intention-Aware Recommender Systems

SEMINAR: Search Enhanced Multi-modal Interest Network and Approximate Retrieval for Lifelong Sequential Recommendation

Spatial-Temporal Interval Aware Sequential POI Recommendation

Long- and Short- Term Sequential Recommendation with Temporal Interval.

Collaborative Self-Attention for Recommender Systems.

Co-refining User and Item Representations with Feature-level Self-attention for Enhanced Recommendation