Abstract:Abstract Purpose Patent classification is one of the areas in Intellectual Property Analytics (IPA), and a growing use case since the number of patent applications has been increasing worldwide. We propose using machine learning algorithms to classify Portuguese patents and evaluate the performance of transfer learning methodologies to solve this task. Design/methodology/approach We applied three different approaches in this paper. First, we used a dataset available by INPI to explore traditional machine learning algorithms and ensemble methods. After preprocessing data by applying TF-IDF, FastText and Doc2Vec, the models were evaluated by cross-validation in 5 folds. In a second approach, we used two different Neural Networks architectures, a Convolutional Neural Network (CNN) and a bi-directional Long Short-Term Memory (BiLSTM). Finally, we used pre-trained BERT, DistilBERT, and ULMFiT models in the third approach. Findings BERTTimbau, a BERT architecture model pre-trained on a large Portuguese corpus, presented the best results for the task, even though with a performance of only 4% superior to a LinearSVC model using TF-IDF feature engineering. Research limitations The dataset was highly imbalanced, as usual in patent applications, so the classes with the lowest samples were expected to present the worst performance. That result happened in some cases, especially in classes with less than 60 training samples. Practical implications Patent classification is challenging because of the hierarchical classification system, the context overlap, and the underrepresentation of the classes. However, the final model presented an acceptable performance given the size of the dataset and the task complexity. This model can support the decision and improve the time by proposing a category in the second level of ICP, which is one of the critical phases of the grant patent process. Originality/value To our knowledge, the proposed models were never implemented for Portuguese patent classification.

Adaptive Ensemble Learning Strategy Using An Assistant Classifier For Large-Scale Imbalanced Patent Categorization

An ensemble framework for patent classification

Class-Level Adaptation Network with Self Training for Unsupervised Domain Adaptation

Adaptive Taxonomy Learning and Historical Patterns Modelling for Patent Classification

Automated Single-Label Patent Classification using Ensemble Classifiers

Adaptive Ensemble Learning with Category-Aware Attention and Local Contrastive Loss

Multi label classification of Artificial Intelligence related patents using Modified D2SBERT and Sentence Attention mechanism

Improving imbalance classification via ensemble learning based on two-stage learning

Self-paced Ensemble for Highly Imbalanced Massive Data Classification

Patent Automatic Classification Based on Symmetric Hierarchical Convolution Neural Network

Adaptive ensemble of classifiers with regularization for imbalanced data classification

A Use Case of Patent Classification Using Deep Learning with Transfer Learning

Hierarchical multi-instance multi-label learning for Chinese patent text classification

DeepPatent: patent classification with convolutional neural networks and word embedding

Ensemble Learning Method for Classification: Integrating Data Envelopment Analysis with Machine Learning

Adaptive Fusion Based Method for Imbalanced Data Classification

Adversarial Domain Adaptation With Dual Auxiliary Classifiers for Cross-Domain Open-Set Intelligent Fault Diagnosis

Patent Classification Using Parallel Min-Max Modular Support Vector Machine

Adaptive Ensemble Method Based on Spatial Characteristics for Classifying Imbalanced Data

Knowledge Powered Cooperative Semantic Fusion for Patent Classification