Unveiling Black-boxes: Explainable Deep Learning Models for Patent Classification

Md Shajalal,Sebastian Denef,Md. Rezaul Karim,Alexander Boden,Gunnar Stevens

DOI: https://doi.org/10.1007/978-3-031-44067-0_24

2023-10-31

Abstract:Recent technological advancements have led to a large number of patents in a diverse range of domains, making it challenging for human experts to analyze and manage. State-of-the-art methods for multi-label patent classification rely on deep neural networks (DNNs), which are complex and often considered black-boxes due to their opaque decision-making processes. In this paper, we propose a novel deep explainable patent classification framework by introducing layer-wise relevance propagation (LRP) to provide human-understandable explanations for predictions. We train several DNN models, including Bi-LSTM, CNN, and CNN-BiLSTM, and propagate the predictions backward from the output layer up to the input layer of the model to identify the relevance of words for individual predictions. Considering the relevance score, we then generate explanations by visualizing relevant words for the predicted patent class. Experimental results on two datasets comprising two-million patent texts demonstrate high performance in terms of various evaluation measures. The explanations generated for each prediction highlight important relevant words that align with the predicted class, making the prediction more understandable. Explainable systems have the potential to facilitate the adoption of complex AI-enabled methods for patent classification in real-world applications.

Artificial Intelligence

What problem does this paper attempt to address?

### Problems the Paper Aims to Solve This paper aims to address the black-box problem in patent classification tasks and proposes an interpretable patent classification framework based on Layer-wise Relevance Propagation (LRP). #### Specific Goals: 1. **Improve the transparency of patent classification**: By introducing LRP technology, provide human-understandable explanations for prediction results, making the model's decision process more transparent. 2. **Enhance model interpretability**: By highlighting keywords related to the predicted category, help users understand why the model made a specific classification. 3. **Improve classification performance**: Various deep neural network models (such as Bi-LSTM, CNN, and CNN-BiLSTM) were trained on two benchmark datasets, and experiments verified the effectiveness and consistency of these models. #### Main Contributions: 1. Proposed an LRP-based patent classification explanation method that can generate explanations for each predicted category. 2. The developed DNN models performed excellently on multiple evaluation metrics and showed better performance compared to existing works. ### Summary This paper addresses the black-box problem in patent classification by introducing LRP technology to improve the transparency and interpretability of the model, thereby enhancing user trust in the model. Additionally, experimental results show that this method outperforms existing patent classification methods on two benchmark datasets.

Unveiling Black-boxes: Explainable Deep Learning Models for Patent Classification

Which Neural Network Makes More Explainable Decisions? an Approach Towards Measuring Explainability

A Pixel-Level Explainable Approach of Convolutional Neural Networks and Its Application

Explaining Deep Learning Models for Structured Data using Layer-Wise Relevance Propagation

Towards LLM-guided Causal Explainability for Black-box Text Classifiers

Understanding the black-box: towards interpretable and reliable deep learning models

Model Explainability in Deep Learning Based Natural Language Processing

Explainable Artificial Intelligence: Understanding, Visualizing and Interpreting Deep Learning Models

Deep Learning for Case-Based Reasoning Through Prototypes: A Neural Network That Explains Its Predictions

DeepPatent: patent classification with convolutional neural networks and word embedding

Foiling Explanations in Deep Neural Networks

Disentangled Explanations of Neural Network Predictions by Finding Relevant Subspaces

Bort: Towards Explainable Neural Networks with Bounded Orthogonal Constraint

Analysis of Explainers of Black Box Deep Neural Networks for Computer Vision: A Survey

Explaining Deep Convolutional Neural Networks for Image Classification by Evolving Local Interpretable Model-agnostic Explanations

Explainable AI for domain experts: a post Hoc analysis of deep learning for defect classification of TFT–LCD panels

Explainable AI approaches in deep learning: Advancements, applications and challenges

Constraint-Driven Explanations for Black-Box ML Models

Aligning Characteristic Descriptors with Images for Human-Expert-like Explainability

Explaining Deep Neural Networks by Leveraging Intrinsic Methods