Abstract:This paper deals with an intelligent data analytics platform - Jaison-Paul Data Analytics Platform (JP-DAP) - for metro rail transport systems. JP-DAP is intended to ensure smooth functioning, improved customer experience, ridership forecasting, and efficient administration of metro rail transportation systems by integrating and analysing its many data sources. It consists of a middleware which is built on the top of a Hadoop Distributed File System (HDFS) and Spark framework, along with a set of open-source software tools like Apache Hive, Pandas, Google TensorFlow and Spark ML-lib for real-time and legacy data processing. The benchmarking of JP-DAP was conducted using TestDFSIO and have found that it performs well according to industry standards. The specific use case for this project is Kochi Metro Rail Limited (KMRL). The analysis of Automated Fare Collection data from KMRL on JP-DAP framework have produced descriptive statistics visualisation of inflow and outflow analysis, travel patterns during weekdays and weekends, origin-destination matrix, etc.. Moreover JP-DAP framework is capable of producing short term passenger flow predictions using SVR machine learning algorithm with linear, radial basis function and polynomial kernels. Our experiments have shown that SVR linear kernel gives the most accurate results with the least errors in predicting the next day's passenger count using the previous five weekdays data. The station usage (one-to-all) prediction using Long Short-Term Memory (LSTM) is also integrated to this framework. The visualisation as well as analytical outcomes of JP-DAP framework have also been made available to the external world using a rich set of REST APIs and are projected on to a web-dashboard.

RT-DAP: A Real-Time Data Analytics Platform for Large-Scale Industrial Process Monitoring and Control

Rapid Sensor Fault Detection in Process Industry

Real-Time Big Data Processing Framework: Challenges and Solutions

Large-Scale Real-Time Semantic Processing Framework for Internet of Things

Plant-Wide Industrial Process Monitoring: A Distributed Modeling Framework

Remote production dashboard: A real-time and online control technology for discrete manufacturing process based on knowledge service

Distributed Parallel PCA for Modeling and Monitoring of Large-Scale Plant-Wide Processes with Big Data.

RIoTBench: A Real-time IoT Benchmark for Distributed Stream Processing Platforms

Real-time Intelligent Big Data Processing:Technology, Platform, and Applications

Real-time intelligent big data processing: technology, platform, and applications

Industrial Big Data Analytics: Challenges, Methodologies, and Applications

Large-scale Real-time Data-driven Scientific Applications

Real-Time-Data Analytics in Raw Materials Handling

Large Multistream Data Analytics for Monitoring and Diagnostics in Manufacturing Systems

Data-mining Massive Real-Time Data in a Power Plant: Challenges, Problems and Solutions

Industrial Big Data Modeling and Monitoring Framework for Plant-Wide Processes

AI-Based Real-Time Site-Wide Optimization for Process Manufacturing

JP-DAP: An Intelligent Data Analytics Platform for Metro Rail Transport Systems

A quality‐related distributed process monitoring framework for large‐scale manufacturing processes with multirate sampling measurements

Big Data Analytics in Real Time - Technical Challenges and its Solutions