Abstract:Recently, new advances in deep learning algorithms have yielded some fascinating results in the field of computer vision technology. As a result, it can now perform activities that formerly required the use of human vision and the brain. Classification, object identification, and semantic segmentation have all seen substantial advancements in deep learning architecture in the last few years. For still images and movies, there has been a major advancement in the field of semantic segmentation. In practical uses like autonomous vehicles, segmenting semantic video continues to be difficult due to high-performance standards, the high cost of convolutional neural networks (CNNs), and the significant need for low latency. An effective machine-learning environment will be developed to meet the performance and latency challenges outlined above. The use of deep learning architectures like SegNet and FlowNet2.0 on the CamVid dataset enables this environment to conduct pixel-wise semantic segmentation of video properties while maintaining low latency. As a result, it is ideally suited for real-world applications since it takes advantage of both SegNet and FlowNet topologies. The decision network determines whether an image frame should be processed by a segmentation network or an optical flow network based on the expected confidence score. In conjunction with adaptive scheduling of the key frame approach, this technique for decision-making can help to speed up the procedure. Using the ResNet50 SegNet model, a mean Intersection on Union (IoU) of "54.27 percent" and an average frame per second of "19.57" were observed. Aside from decision network and adaptive key frame sequencing, it was discovered that FlowNet2.0 increased the frames processed per second9(fps) to "30.19" on GPU with a mean IoU of "47.65%". Because the GPU was utilized "47.65%" of the time, this resulted. There has been an increase in the speed of the Video semantic segmentation network without sacrificing quality, as demonstrated by this improvement in performance.

S3-Net: A Fast and Lightweight Video Scene Understanding Network by Single-shot Segmentation.

S3-Net: A Fast Scene Understanding Network by Single-Shot Segmentation for Autonomous Driving

Up-to-Down Network: Fusing Multi-Scale Context for 3D Semantic Scene Completion

S3Net: 3D LiDAR Sparse Semantic Segmentation Network

A Two-Pipeline Instance Segmentation Network via Boundary Enhancement for Scene Understanding

Video Semantic Segmentation Network with Low Latency Based on Deep Learning

A Unified Framework for 3D Scene Understanding

Real-Time Semantic Segmentation via Spatial-Detail Guided Context Propagation

Real-time Semantic Segmentation with Context Aggregation Network

ContextNet: Exploring Context and Detail for Semantic Segmentation in Real-time

Spatial-Assistant Encoder-Decoder Network for Real Time Semantic Segmentation

FBSNet: A Fast Bilateral Symmetrical Network for Real-Time Semantic Segmentation

Fast Semantic Segmentation for Scene Perception

BiSeNet: Bilateral Segmentation Network for Real-time Semantic Segmentation

Video Object Segmentation with 3D Convolution Network

OVSNet : Towards One-Pass Real-Time Video Object Segmentation.

LinkNet: 2D-3D Linked Multi-Modal Network for Online Semantic Segmentation of RGB-D Videos

SRNet: A 3D Scene Recognition Network Using Static Graph and Dense Semantic Fusion.

Fast-SegNet: fast semantic segmentation network for small objects

SG-Net: Spatial Granularity Network for One-Stage Video Instance Segmentation.

LEDNet: A Lightweight Encoder-Decoder Network for Real-Time Semantic Segmentation