Abstract:Network traffic classification aims to associate the network traffic with a class of traffic characterization (e.g., Streaming) or applications (e.g., Facebook). This ability plays an important role in advanced network management. The tasks of traffic characterization and application identification are usually implemented by individual models. However, when multiple models are deployed in the online environment, this causes a dramatic increase in the complexity, resource demand and maintenance costs. In this paper, an efficient multi-task learning method named multi-task transformer (MTT) is proposed. It simultaneously classifies the traffic characterization and application identification tasks. The proposed model considers the input packet as a sequence of bytes and applies a multi-head attention mechanism to extract features. Experiments are conducted on the ISCX VPN-nonVPN dataset to demonstrate the effectiveness of MTT. F1\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$F_1$$\end{document} scores of 98.75% and 99.35% have been achieved for application identification and traffic characterization, respectively. To the best of our knowledge, the results are better than the state-of-the-art results. The MTT model outputs the two results simultaneously in ∼\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$\sim$$\end{document} 0.1 milliseconds (per packet), which satisfies the requirement of online traffic classification. Compared with the 1D-CNN and 2D-CNN models, the proposed MTT model is more stable, presents higher classification performance and requires less storage space. Finally, the selection strategies of input length for different neural networks are suggested and the related principles are investigated.

All Birds with One Stone: Multi-task Text Classification for Efficient Inference with One Forward Pass

Hierarchical and Bidirectional Joint Multi-Task Classifiers for Natural Language Understanding

MTFormer: Multi-task Learning via Transformer and Cross-Task Reasoning.

MulT: An End-to-End Multitask Learning Transformer

Multi-Task Learning for Front-End Text Processing in TTS

Exceeding the Limits of Visual-Linguistic Multi-Task Learning

12-in-1: Multi-Task Vision and Language Representation Learning

Conditionally Adaptive Multi-Task Learning: Improving Transfer Learning in NLP Using Fewer Parameters & Less Data

How does Multi-Task Training Affect Transformer In-Context Capabilities? Investigations with Function Classes

Optimizing Dense Visual Predictions Through Multi-Task Coherence and Prioritization

DMTG: One-Shot Differentiable Multi-Task Grouping

MmAP : Multi-modal Alignment Prompt for Cross-domain Multi-task Learning

Efficient Controllable Multi-Task Architectures

Multi-Task Learning Architectures and Applications

A Multi-task Approach to Neural Multi-label Hierarchical Patent Classification Using Transformers

MTT: an efficient model for encrypted network traffic classification using multi-task transformer

Fast Multi-Resolution Transformer Fine-tuning for Extreme Multi-label Text Classification

Multi-task Classification with Sequential Instances and Tasks

An End-to-End Scalable Iterative Sequence Tagging with Multi-Task Learning.

Multi-Task Learning in Natural Language Processing: An Overview

Cross-Task Affinity Learning for Multitask Dense Scene Predictions