Abstract:This study provides an efficient approach for using text data to calculate patent-to-patent (p2p) technological similarity, and presents a hybrid framework for leveraging the resulting p2p similarity for applications such as semantic search and automated patent classification. We create embeddings using Sentence-BERT (SBERT) based on patent claims. We leverage SBERTs efficiency in creating embedding distance measures to map p2p similarity in large sets of patent data. We deploy our framework for classification with a simple Nearest Neighbors (KNN) model that predicts Cooperative Patent Classification (CPC) of a patent based on the class assignment of the K patents with the highest p2p similarity. We thereby validate that the p2p similarity captures their technological features in terms of CPC overlap, and at the same demonstrate the usefulness of this approach for automatic patent classification based on text data. Furthermore, the presented classification framework is simple and the results easy to interpret and evaluate by end-users. In the out-of-sample model validation, we are able to perform a multi-label prediction of all assigned CPC classes on the subclass (663) level on 1,492,294 patents with an accuracy of 54% and F1 score > 66%, which suggests that our model outperforms the current state-of-the-art in text-based multi-label and multi-class patent classification. We furthermore discuss the applicability of the presented framework for semantic IP search, patent landscaping, and technology intelligence. We finally point towards a future research agenda for leveraging multi-source patent embeddings, their appropriateness across applications, as well as to improve and validate patent embeddings by creating domain-expert curated Semantic Textual Similarity (STS) benchmark datasets.

Exploiting Word Embedding for Heterogeneous Topic Model Towards Patent Recommendation.

Mining Coherent Topics in Documents Using Word Embeddings and Large-Scale Text Data

Exploiting Semantic Knowledge Base for Patent Retrieval

Incorporating Knowledge Graph Embeddings into Topic Modeling

Modeling technological topic changes in patent claims

Identifying Technological Topic Changes In Patent Claims Using Topic Modeling

Topic Modeling over Short Texts by Incorporating Word Embeddings

PatentMiner: topic-driven patent analysis and mining.

Representing Mixtures of Word Embeddings with Mixtures of Topic Embeddings

Patent collaborative filtering recommendation approach based on patent similarity

The patent mining analysis method based on Chinese word segmentation

An Exploration Of Semantic Relations In Neural Word Embeddings Using Extrinsic Knowledge

Enhancing patent retrieval using text and knowledge graph embeddings: a technical note

PatentSBERTa: A Deep NLP based Hybrid Model for Patent Distance and Classification using Augmented SBERT

Heterogeneous Latent Topic Discovery for Semantic Text Mining

A comparative analysis of embedding models for patent similarity

Patent Keyword Extraction Algorithm Based on Distributed Representation for Patent Classification

Finding nuggets in IP portfolios: core patent mining through textual temporal analysis.

A Probabilistic Model for Learning Multi-Prototype Word Embeddings.

An integrated latent Dirichlet allocation and Word2vec method for generating the topic evolution of mental models from global to local

A Survey on Sentence Embedding Models Performance for Patent Analysis