Abstract:Complex-valued neural networks have emerged boasting superior modeling performance for many tasks across the signal processing, sensing, and communications arenas. However, developing complex-valued models currently demands development of basic deep learning operations, such as linear or convolution layers, as modern deep learning frameworks like PyTorch and Tensor flow do not adequately support complex-valued neural networks. This paper overviews a package built on PyTorch with the intention of implementing light-weight interfaces for common complex-valued neural network operations and architectures. Similar to natural language understanding (NLU), which as recently made tremendous leaps towards text-based intelligence, RF Signal Understanding (RFSU) is a promising field extending conventional signal processing algorithms using a hybrid approach of signal mechanics-based insight with data-driven modeling power. Notably, we include efficient implementations for linear, convolution, and attention modules in addition to activation functions and normalization layers such as batchnorm and layernorm. Additionally, we include efficient implementations of manifold-based complex-valued neural network layers that have shown tremendous promise but remain relatively unexplored in many research contexts. Although there is an emphasis on 1-D data tensors, due to a focus on signal processing, communications, and radar data, many of the routines are implemented for 2-D and 3-D data as well. Specifically, the proposed approach offers a useful set of tools and documentation for data-driven signal processing research and practical implementation.

Complex Functional Networks

Functional Network Method for the Identification of Nonlinear Systems

Complex-Valued Wavelet Network

Functional Network: A Novel Framework for Interpretability of Deep Neural Networks

Deep Complex Networks

Towards Understanding Theoretical Advantages of Complex-Reaction Networks

Rearrangement of cluster structure during fission processes

Complex-valued Neural Networks -- Theory and Analysis

Characterizing Learning Dynamics of Deep Neural Networks via Complex Networks

Neural Networks as Functional Classifiers

ADVANCES IN THE COMPLEX BRAIN NETWORK

Simplicial Complex Neural Networks

Functional-Edged Network Modeling

Finite Expression Method for Learning Dynamics on Complex Networks

Deep Neural Network Classifier for Multi-dimensional Functional Data

Functional Multi-Layer Perceptron: a Nonlinear Tool for Functional Data Analysis

Functional brain networks: great expectations, hard times, and the big leap forward

Conceptual Design Optimization by Functional Neural Networks

A Functional Extension of Semi-Structured Networks

Fusing functional connectivity with network nodal information for sparse network pattern learning of functional brain networks

Complex-Valued Neural Networks for Data-Driven Signal Processing and Signal Understanding