Abstract:One of the major problems that cause continual trouble in deep learning networks is that training a large network requires massive labelled datasets. The preparation of a massive labelled dataset is a cumbersome task and requires lot of human interventions. This paper proposes a novel generator network 'Sim2Real' transfer is a recent and fast-developing field in machine learning used to bridge the gap between simulated and real data. Training with simulated datasets often converges due to its size but fails to generalize real-world applications. Simulated datasets can be used to train and test deep learning models, enables the development and evaluation of new algorithms and architectures. By simulating road dataset, researchers can generate large amounts of realistic road-traffic dataset that can be used to study and understand several problems such as vehicular object tracking and classification, traffic situation analysis etc. The main advantage of such a transfer algorithm is to use the abundance of a simulated dataset to generate huge realistic-looking datasets to solve data-intense tasks. This work presents a novel, robust sim2real algorithm that converts the labels of a semantic segmentation map to a realistic-looking street view using the Cityscapes dataset and aims to achieve robust urban mobility for smart cities. Further, the generalizability of the Cycle Generative Adversarial Network (CycleGAN) architecture was tested by using an origami robot dataset for sim2real transfer. We show that the results were found to be qualitatively satisfactory for different traffic analysis applications. In addition, road perception was done using a lightweight SVM pipeline and evaluated on the KITTI dataset. We have incorporated Cycle Consistency Loss and Identity Loss as the metrics to evaluate the performance of the proposed Cycle GAN model. We inferred that the proposed Cycle GAN model provides an Identity loss of less than 0.2 in both the Cityscapes dataset and KITTI datasets. Also, we understand that the super-pixel resolution has a good impact on the quantitative results of the proposed Cycle GAN models.

CRTGAN: Controllable Road Network Graphs Generation Via Transformer Based GAN

Image-Conditioned Graph Generation for Road Network Extraction

Graph Transformer GANs for Graph-Constrained House Generation

A novel transformer‐based graph generation model for vectorized road design

ProgRPGAN: Progressive GAN for Route Planning

Autonomous Driving Road Network Generation and Evaluation Based on Generative Artificial Intelligence

Translating Images to Road Network: A Sequence-to-Sequence Perspective

DDCTNet: A Deformable and Dynamic Cross-Transformer Network for Road Extraction From High-Resolution Remote Sensing Images

A topography-aware approach to the automatic generation of urban road networks

Deep Graph Translation

Graph Transformer GANs with Graph Masked Modeling for Architectural Layout Generation

GCN-GAN: Integrating Graph Convolutional Network and Generative Adversarial Network for Traffic Flow Prediction

Synthesizing Traffic Datasets using Graph Neural Networks

GATR: A Road Network Traffic Violation Prediction Method Based on Graph Attention Network

Translating Images to Road Network: A Non-Autoregressive Sequence-to-Sequence Approach.

TrafficPro: A Road Speed Prediction Framework for Urban Signal-Controlled Road Networks

Style Transfer of Urban Road Images Using Generative Adversarial Networks with Structural Details

Road Graph Extraction via Transformer and Topological Representation

A dual-level graph attention network and transformer for enhanced trajectory prediction under road network constraints

A hybrid Cycle GAN-based lightweight road perception pipeline for road dataset generation for Urban mobility