Abstract:The field of algorithmic trading, driven by deep learning methodologies, has garnered substantial attention in recent times. Within this domain, transformers, convolutional neural networks, and patch embedding-based techniques have emerged as popular choices within the computer vision community. Here, inspired by the latest cutting-edge computer vision methodologies and the existing work showing the capability of image-like conversion for time-series datasets, we apply more advanced transformer-based and patch-based approaches for predicting asset prices and directional price movements. The employed transformer models include Vision Transformer (ViT), Data Efficient Image Transformers (DeiT), and Swin. We use ConvMixer for a patch embedding-based convolutional neural network architecture without a transformer. Our tested transformer-based and patch-based methodologies aim to predict asset prices and directional movements using historical price data by leveraging the inherent image-like properties within the historical time-series dataset. Before the implementation of attention-based architectures, the historical time series price dataset is transformed into two-dimensional images. This transformation is facilitated through the incorporation of various common technical financial indicators, each contributing to the data for a fixed number of consecutive days. Consequently, a diverse set of two-dimensional images is constructed, reflecting various dimensions of the dataset. Subsequently, the original images depicting market valleys and peaks are annotated with labels such as Hold, Buy, or Sell. According to the experiments, trained attention-based models consistently outperform the baseline convolutional architectures, particularly when applied to a subset of frequently traded Exchange-Traded Funds (ETFs). This better performance of attention-based architectures, especially ViT, is evident in terms of both accuracy and other financial evaluation metrics, particularly during extended testing and holding periods. These findings underscore the potential of transformer-based approaches to enhance predictive capabilities in asset price and directional forecasting. Our code and processed datasets are available at https://github.com/seferlab/price_transformer.

Attention is all you need: An interpretable transformer-based asset allocation approach

Portfolio Transformer for Attention-Based Asset Allocation

Deep Portfolio Optimization Modeling Based on Conv-Transformers with Graph Attention Mechanism

Adaptive Long-Short Pattern Transformer for Stock Investment Selection

T2V_TF: An adaptive timing encoding mechanism based Transformer with multi-source heterogeneous information fusion for portfolio management: A case of the Chinese A50 stocks

From attention to profit: quantitative trading strategy based on transformer

Deep Transformer-Based Asset Price and Direction Prediction

AlphaStock: A Buying-Winners-and-Selling-Losers Investment Strategy using Interpretable Deep Reinforcement Attention Networks

Incorporating Transformers and Attention Networks for Stock Movement Prediction

Stock Selection Via Expand-excite Conv Attention Autoencoder and Layer Sparse Attention Transformer: A Classification Approach Inspire Time Series Sequence Recognition

A Risk-sensitive Automatic Stock Trading Strategy Based on Deep Reinforcement Learning and Transformer

An End-to-End Structure with Novel Position Mechanism and Improved EMD for Stock Forecasting

Transformer-based Attention Network for Stock Movement Prediction

Deep Convolutional Transformer Network for Stock Movement Prediction

Revolutionising Financial Portfolio Management: the Non-Stationary Transformer’s Fusion of Macroeconomic Indicators and Sentiment Analysis in a Deep Reinforcement Learning Framework

Relation-Aware Transformer for Portfolio Policy Learning

Application of Machine Learning Models in Asset Allocation

Portfolio Optimization with 2D Relative-Attentional Gated Transformer

Stock market index prediction using deep Transformer model

Optimizing Portfolio Management and Risk Assessment in Digital Assets Using Deep Learning for Predictive Analysis

Stock market index prediction using transformer neural network models and frequency decomposition