Abstract:It is challenging for complex urban transportation networks to recommend taxi waiting spots for mobile passengers because the traditional centralized mining platform cannot address the storage and calculation problems of GPS trajectory big data, and especially the boundary identification of DBSCAN is difficult on the Spark parallel processing framework. To this end, we propose a parallel DBSCAN optimization algorithm with the silhouette coefficient and the pickup rate on Spark in this paper, named SP-DBSCAN, where users merely input one parameter to complete the distributed recommendation of the best waiting spot. Specifically, under the Hadoop distributed computing platform, a general framework of distributed modeling for waiting spot recommendation on Spark is developed to solve the distributed storage and parallel computing issues of the serial algorithm in handling data partition and clustering of large-scale traffic data on a single machine. Moreover, we put forward a parallel SP-DBSCAN algorithm on Spark to recommend the best waiting spot for passengers, where the traditional DBSCAN algorithm is optimized via the silhouette coefficient and the boarding ratio to address the parameter sensitive problem and the issue of the center of the non-convex clustering graph is solved by giving one cluster with two centroids in the clustering hotspot areas. Finally, experimental results on four groups of real-world taxi GPS trajectory data sets demonstrate that compared with C-DBSCAN and P-DBSCAN, the recognition rate of SP-DBSCAN is increased by 1.6%, 6.2%, 3.47%, and 5.8%, respectively. The empirical study indicates that the clustering region generated by our SP-DBSCAN algorithm can satisfy the requirements that passengers can ride in the hotspot area when they have not successfully hitchhiked at a specific location and turned to the next spot randomly.

A Parallel Grid-Search-based SVM Optimization Algorithm on Spark for Passenger Hotspot Prediction

The parallel algorithms for LIBSVM parameter optimization based on Spark

A Distributed EEMDN-SABiGRU Model on Spark for Passenger Hotspot Prediction

A Parallel SP-DBSCAN Algorithm on Spark for Waiting Spot Recommendation.

The Prediction of Spark-Ignition Engine Performance and Emissions Based on the SVR Algorithm

Improved Particle Swarm Optimized SVM for Short-term Traffic Flow Predication

Parallelization of Classification Algorithms Based on SparkR

Short-term Traffic Flow Prediction Based on Optimised Support Vector Regression.

Prediction Of Blasting Vibration Intensity By Improved Pso-Svr On Apache Spark Cluster

Geospatial data for peer-to-peer communication among autonomous vehicles using optimized machine learning algorithm

Grid Resource Prediction Based on Support Vector Regression and Genetic Algorithms.

Network Traffic Prediction Based On Lssvm Optimized By Pso

A Predictive and Optimization Approach for Enhanced Urban Mobility Using Spatiotemporal Data

A Novel Hybrid Network Traffic Prediction Approach Based on Support Vector Machines

Short-Term Demand Prediction Method for Online Car-Hailing Services Based on a Least Squares Support Vector Machine.

Research on optimized GA-SVM vehicle speed prediction model based on driver-vehicle-road-traffic system

The use of LS-SVM for short-term passenger flow prediction

Microblog Sentiment Classification Using Parallel SVM in Apache Spark

Parallel SMO for Traffic Flow Forecasting

Load forecasting based on multi-core learning Support Vector Machine (SVM)

Short-Term Traffic Flow Prediction Based on Least Square Support Vector Machine with Hybrid Optimization Algorithm