Abstract:Complex-valued neural networks have emerged boasting superior modeling performance for many tasks across the signal processing, sensing, and communications arenas. However, developing complex-valued models currently demands development of basic deep learning operations, such as linear or convolution layers, as modern deep learning frameworks like PyTorch and Tensor flow do not adequately support complex-valued neural networks. This paper overviews a package built on PyTorch with the intention of implementing light-weight interfaces for common complex-valued neural network operations and architectures. Similar to natural language understanding (NLU), which as recently made tremendous leaps towards text-based intelligence, RF Signal Understanding (RFSU) is a promising field extending conventional signal processing algorithms using a hybrid approach of signal mechanics-based insight with data-driven modeling power. Notably, we include efficient implementations for linear, convolution, and attention modules in addition to activation functions and normalization layers such as batchnorm and layernorm. Additionally, we include efficient implementations of manifold-based complex-valued neural network layers that have shown tremendous promise but remain relatively unexplored in many research contexts. Although there is an emphasis on 1-D data tensors, due to a focus on signal processing, communications, and radar data, many of the routines are implemented for 2-D and 3-D data as well. Specifically, the proposed approach offers a useful set of tools and documentation for data-driven signal processing research and practical implementation.

KHNNs: hypercomplex neural networks computations via Keras using TensorFlow and PyTorch

Hyperbolic Binary Neural Network

HCFNN: High-order Coverage Function Neural Network for Image Classification

Tensorized Hypergraph Neural Networks

Scalable Neural Network Kernels

T-HyperGNNs: Hypergraph Neural Networks via Tensor Representations

Fully Hyperbolic Convolutional Neural Networks for Computer Vision

Towards Explaining Hypercomplex Neural Networks

Parameterized Hypercomplex Graph Neural Networks for Graph Classification

Deep Complex Networks

Kriging Convolutional Networks

HyperKAN: Kolmogorov-Arnold Networks make Hyperspectral Image Classificators Smarter

RosenPy: An open source Python framework for complex-valued neural networks

HyperNets and their application to learning spatial transformations

Complex-Valued Neural Networks for Data-Driven Signal Processing and Signal Understanding

HyperKAN: Kolmogorov–Arnold Networks Make Hyperspectral Image Classifiers Smarter

TensorKrowch: Smooth integration of tensor networks in machine learning

Demystifying the Hypercomplex: Inductive Biases in Hypercomplex Deep Learning

Deep Kronecker neural networks: A general framework for neural networks with adaptive activation functions

Dynamic Hypergraph Neural Networks based on Key Hyperedges

Algebraic Multi-Layer Network: Key Concepts