Abstract:Abstract In drilling engineering, Key Performance Indexes (KPIs) are import aids for management optimization and technical improvement, such as drilling time, monthly footage, rate of penetration and non-productive time, etc. Almost all oil companies have deployed database systems to manage drilling information, where maybe millions of daily reports are incorporated. While in international oil companies, some shortcomings of conventional data management system are gradually shown: reliability decreasing of data analysis reports during transferring in different levels due to manual intervention, huge amount of unstructured data in losing risk, low automation of KPIs analysis, low tolerance of data processing procedure to poor quality data, various data standards of different fields, poor performance in KPIs visualization. To solve the above problems, an integrated and intelligent drilling KPIs analysis system based on modern data science techniques were developed and deployed in an international oil company. The system architecture was designed in 4 sections: unstructured data processing unit, database and management system, KPIs extraction engine and data visualization dashboard. Unstructured data processing unit was designed to convert reports form heterogeneous data sources to the main database, including Excel, pdf and isometric databases. A 5-layers data quality control procedure was designed to ensure the reliability of data for KPIs analysis. Specified extraction algorithms was designed considering several realities, such as reports or data missing, and data error. A distance-based model to evaluate the similarity of two wells by well properties was developed, providing an intelligent way for benchmark and knowledge sharing between wells. A drilling anomaly detection model was developed by deep learning and natural language processing to solve the problem of ununified coding system in different fields. A data visualization dashboard with high efficiency, reliability and flexibility was designed to provide information for different users. By deploying the system, tens of thousands of daily reports from heterogeneous data sources were automatically incorporated to the main database, and millions of dollars of manually processing cost were saved. The data analysis standard was unified by the system, making it possible for benchmarking and knowledge sharing in different oilfields. Thousands of wells’ information was activated by the system, and the outputs provide support for management optimization, technical improvement, drilling performance benchmarking and feasibility evaluation of new investment. The time for users to analysis the KPIs of a field was shorten form several weeks to almost zero and the data quality was validated and improved in real time by the feedback of KPIs analysis. A 7-layer convolutional neural network was trained based on 1700 wells’ data to detect anomaly in daily reports with accuracy of 85%. A new distance-based model was developed to evaluate the similarity of two wells.

RootMiner: A Rapid Root Cause Location Method for KPIs with Multi-Dimensional Attributes

Robust and Unsupervised KPI Anomaly Detection Based on Highly Sensitive Conditional Variational Auto-Encoders.

HotSpot: Anomaly Localization for Additive KPIs with Multi-Dimensional Attributes.

Multi-stage Location for Root-Cause Metrics in Online Service Systems.

RAPMiner: A Generic Anomaly Localization Mechanism for CDN System with Multi-dimensional KPIs

CMMD: Cross-Metric Multi-Dimensional Root Cause Analysis

Robust and Rapid Clustering of KPIs for Large-Scale Anomaly Detection

Generic and Robust Localization of Multi-dimensional Root Causes.

Distributed Data Mining For Root Causes Of Kpi Faults In Wireless Networks

Generic and Robust Root Cause Localization for Multi-Dimensional Data in Online Service Systems

Automated Root Cause Analysis with Observability Data - A Comprehensive Review

MTAD: Tools and Benchmarks for Multivariate Time Series Anomaly Detection

CloudRCA: A Root Cause Analysis Framework for Cloud Computing Platforms

Hierarchical Monitoring and Root-Cause Diagnosis Framework for Key Performance Indicator-Related Multiple Faults in Process Industries

A Causality Mining and Knowledge Graph Based Method of Root Cause Diagnosis for Performance Anomaly in Cloud Applications

RCInvestigator: Towards Better Investigation of Anomaly Root Causes in Cloud Computing Systems

A Real-Time Trace-Level Root-Cause Diagnosis System in Alibaba Datacenters

Root-KGD: A Novel Framework for Root Cause Diagnosis Based on Knowledge Graph and Industrial Data

Root-Cause Metric Location for Microservice Systems Via Log Anomaly Detection

Intelligent Detection for Key Performance Indicators in Industrial-Based Cyber-Physical Systems

A Global Drilling KPIs Analysis System Based on Modern Data Science Techniques