Abstract:Generative adversarial networks and variational autoencoders (VAEs) provide impressive image generation from Gaussian white noise, but both are difficult to train, since they need a generator (or encoder) and a discriminator (or decoder) to be trained simultaneously, which can easily lead to unstable training. To solve or alleviate these synchronous training problems of generative adversarial networks (GANs) and VAEs, researchers recently proposed generative scattering networks (GSNs), which use wavelet scattering networks (ScatNets) as the encoder to obtain features (or ScatNet embeddings) and convolutional neural networks (CNNs) as the decoder to generate an image. The advantage of GSNs is that the parameters of ScatNets do not need to be learned, while the disadvantage of GSNs is that their ability to obtain representations of ScatNets is slightly weaker than that of CNNs. In addition, the dimensionality reduction method of principal component analysis (PCA) can easily lead to overfitting in the training of GSNs and, therefore, affect the quality of generated images in the testing process. To further improve the quality of generated images while keeping the advantages of GSNs, this study proposes generative fractional scattering networks (GFRSNs), which use more expressive fractional wavelet scattering networks (FrScatNets), instead of ScatNets as the encoder to obtain features (or FrScatNet embeddings) and use similar CNNs of GSNs as the decoder to generate an image. Additionally, this study develops a new dimensionality reduction method named feature-map fusion (FMF) instead of performing PCA to better retain the information of FrScatNets,; it also discusses the effect of image fusion on the quality of the generated image. The experimental results obtained on the CIFAR-10 and CelebA datasets show that the proposed GFRSNs can lead to better generated images than the original GSNs on testing datasets. The experimental results of the proposed GFRSNs with deep convolutional GAN (DCGAN), progressive GAN (PGAN), and CycleGAN are also given.

Scattering Networks for Hybrid Representation Learning

Deep Hybrid Scattering Image Learning

Fractional Wavelet-Based Generative Scattering Networks

Scattering GCN: Overcoming Oversmoothness in Graph Convolutional Networks

Deep Network Classification by Scattering and Homotopy Dictionary Learning

Reconstructing Images of Two Adjacent Objects through Scattering Medium Using Generative Adversarial Network

Generative networks as inverse problems with fractional wavelet scattering networks

Structured Receptive Fields in CNNs

Invariant Scattering Convolution Networks

Boosting Generalized Few-Shot Learning by Scattering Intra-class Distribution

Multiscale Curvelet Scattering Network

Simulation-based inference with scattering representations: scattering is all you need

Deep Scattering Network with Max-pooling

Adaptive 3D Descattering with a Dynamic Synthesis Network

Multiscale Dynamic Curvelet Scattering Network.

Understanding Graph Neural Networks with Generalized Geometric Scattering Transforms

Riesz Feature Representation: Scale Equivariant Scattering Network for Classification Tasks

Non-Invasive Imaging Through Scattering Media Based on Deep Learning

Face Recognition Using Scattering Convolutional Network

Time-Domain Signal Extraction and Image Reconstruction Through Scattering Medium Based on Fully Convolutional Neural Network

Learnable wavelet neural networks for cosmological inference