2014 IEEE Communications Society and Information Theory Society Joint Paper Award

Parikshit Gopalan,Cheng Huang,M Degrees,Shanghai Jiao

DOI: https://doi.org/10.1109/tit.2014.2379772

IF: 2.5

2015-01-01

IEEE Transactions on Information Theory

Abstract:focusing on computational complexity, coding theory, Boolean function analysis, and pseudorandomness.More recently, he has been working on erasure coding for massive data storage.

What problem does this paper attempt to address?

Guest editorial: Selected papers from IEEE/CIC ICCC2014

Liu, Jing,Chen, Jiming,Yao, Mingwu

DOI: https://doi.org/10.1109/CC.2015.7084378

2015-01-01

Abstract:Since its successful inauguration in Beijing, August, 2012, the IEEE international Conference on Communications (ICCC) has been globally recognized as one of the important annual international conferences held by the IEEE Communication Society (ComSoc) and China Institute of Communications (CIC). IEEE/CIC ICCC'14, the third ICCC held in Shanghai, China, 13–15 October, 2014, continued to expand its influence and had attracted distinguished scholars, key researchers, young investigators and ambitious students from dozens of countries and regions. The technical program of ICCC 2014 features 4 world-class plenary keynote speeches, 8 technical symposia, 5 tutorials, 4 industrial and academic panels and 1 workshop, covering from decades-long hot topics such as MIMO, interference coordination, heterogeneous networks and etc., to recent eye-catchers such as big data and social networks. The conference not only provided a forum and seminar for active researchers from every directions of this academia, but also attracted delegates from the main players in the industry.
2015 Scott Helt Memorial Award for the Best Paper Published in the IEEE Transactions on Broadcasting

Jian Song,Wenbo Ding,Fang Yang,Chang-Yong Pan,Linglong Dai

DOI: https://doi.org/10.1109/tbc.2015.2501680

IF: 4.5

2015-01-01

IEEE Transactions on Broadcasting

Abstract:The 2015 Scott Helt Memorial Award was awarded to Wenbo Ding, Fang Yang, Changyong Pan, Lingling Dai and Jian Song for their paper, “Compressive Sensing Based Channel Estimation for OFDM Systems Under Long Delay Channels.” This paper appeared in the IEEE TRANSACTIONS ON BROADCASTING, vol. 60, no. 2, pp. 313–321, Jun. 2014. The purpose of the IEEE Scott Helt Memorial Award is to recognize exceptional publications in the field and to stimulate interest in and encourage contributions to the fields of interest of the society.
An Algebraic and Probabilistic Framework for Network Information Theory

S. Sandeep Pradhan,Arun Padakandla,Farhad Shirani

DOI: https://doi.org/10.1561/0100000083

2020-01-01

Foundations and Trends® in Communications and Information Theory

Abstract:In this monograph, we develop a mathematical framework based on asymptotically good random structured codes, i.e., codes possessing algebraic properties, for network information theory. We use these codes to propose new strategies for communication in multi-terminal settings. The proposed coding strategies are applicable to arbitrary instances of the multi-terminal communication problems under consideration. In particular, we consider four fundamental problems which can be considered as building blocks of networks: distributed source coding, interference channels, multiple-access channels with distributed states and multiple description source coding. We then develop a systematic framework for characterizing the performance limits of these strategies for these problems from an information-theoretic viewpoint. Lastly, we identify several examples of the multiterminal communication problems studied herein, for which structured codes attain optimality, and provide strictly better performance as compared to classical techniques based on unstructured codes. In summary, we develop an algebraic and probabilistic framework to demonstrate the fundamental role played by structured codes in multiterminal communication problems. This monograph deals exclusively with discrete source and channel coding problems.<h3>Suggested Citation</h3>S. Sandeep Pradhan, Arun Padakandla and Farhad Shirani (2020), "An Algebraic and Probabilistic Framework for Network Information Theory", Foundations and Trends® in Communications and Information Theory: Vol. 18: No. 2, pp 173-379. http://dx.doi.org/10.1561/0100000083
How Hard is Computing Parity with Noisy Communications?

Chinmoy Dutta,Yashodhan Kanoria,D. Manjunath,Jaikumar Radhakrishnan

DOI: https://doi.org/10.48550/arXiv.1502.02290

2015-02-09

Abstract:We show a tight lower bound of $\Omega(N \log\log N)$ on the number of transmissions required to compute the parity of $N$ input bits with constant error in a noisy communication network of $N$ randomly placed sensors, each having one input bit and communicating with others using local transmissions with power near the connectivity threshold. This result settles the lower bound question left open by Ying, Srikant and Dullerud (WiOpt 06), who showed how the sum of all the $N$ bits can be computed using $O(N \log\log N)$ transmissions. The same lower bound has been shown to hold for a host of other functions including majority by Dutta and Radhakrishnan (FOCS 2008). Most works on lower bounds for communication networks considered mostly the full broadcast model without using the fact that the communication in real networks is local, determined by the power of the transmitters. In fact, in full broadcast networks computing parity needs $\theta(N)$ transmissions. To obtain our lower bound we employ techniques developed by Goyal, Kindler and Saks (FOCS 05), who showed lower bounds in the full broadcast model by reducing the problem to a model of noisy decision trees. However, in order to capture the limited range of transmissions in real sensor networks, we adapt their definition of noisy decision trees and allow each node of the tree access to only a limited part of the input. Our lower bound is obtained by exploiting special properties of parity computations in such noisy decision trees.

Distributed, Parallel, and Cluster Computing,Computational Complexity
Semantic Communications: Theories, Technologies and Applications

Ping Zhang,Guangming Shi,Shuguang Cui,Zhaoyang Zhang,Kai Niu,Yong Xiao,Zhijin Qin,Jincheng Dai,Shuo Shao,Deniz Gunduz,Eleonora Grassucci

DOI: https://doi.org/10.23919/jcc.2024.10606406

2024-01-01

China Communications

Abstract:The last seventy years have witnessed the transition of communication from Shannon's theoretical concept to current high-efficiency practical systems. With respect to Shannon information theory, to fulfill the high-bandwidth utilization, any further increase in the data rate requires a significant augmentation in the received signal power unless the bandwidth is extended in proportion to the incremental data rate. Although many such technologies have achieved tremendous success in today's communication systems, they also lead to severe high-frequency coverage costs, complicated signal processing, high energy consumption, etc. Together with extraordinary promises, naively increasing channel capacity cannot address all communication problems, especially in future intelligent eras. It is the very time for radical rethinking of classical communication mechanisms.
Weight Distributions of Regular Low-Density Parity-Check Codes over Finite Fields

Shengtian Yang,Thomas Honold,Yan Chen,Zhaoyang Zhang,Peiliang Qiu

DOI: https://doi.org/10.1109/tit.2011.2162642

IF: 2.5

2011-01-01

IEEE Transactions on Information Theory

Abstract:The average weight distribution of a regular low-density parity-check (LDPC) code ensemble over a finite field is thoroughly analyzed. In particular, a precise asymptotic approximation of the average weight distribution is derived for the small-weight case, and a series of fundamental qualitative properties of the asymptotic growth rate of the average weight distribution are proved. Based on this analysis, a general result, including all previous results as special cases, is established for the minimum distance of individual codes in a regular LDPC code ensemble.
Coding and Cryptology: Proceedings of the International Workshop, Wuyi Mountain, Fujian, China, 11-15 June 2007

Yongqing Li,San Ling,Harald Niederreiter,Huaxiong Wang,Chaoping Xing

2008-01-01

Abstract:Over the past years, the rapid growth of the Internet and World Wide Web has provided great opportunities for online commercial activities, business transactions and government services over open computer and communication networks. However, such developments are only possible if communications can be conducted in a secure and reliable manner. The mathematical theory and practice of coding theory and cryptology underpin the provision of effective security and reliability for data communication, processing and storage. Theoretical and practical advances in these fields are therefore a key factor in facilitating the growth of data communications and data networks.The aim of the International Workshop on Coding and Cryptology 2007 was to bring together experts from coding theory, cryptology and their related areas for a fruitful exchange of ideas in order to stimulate further research and collaboration among mathematicians, computer scientists, practical cryptographers and engineers. This post-proceedings of the workshop consists of 20 selected papers on a wide range of topics in coding theory and cryptology, including theory, techniques, applications, and practical experiences. They cover significant advances in these areas and contain very useful surveys.
On the Sub-optimality of Single-Letter Coding over Networks

Farhad Shirani,S. Sandeep Pradhan

DOI: https://doi.org/10.48550/arXiv.1705.00410

2017-05-01

Abstract:In this paper, we establish a new bound tying together the effective length and the maximum correlation between the outputs of an arbitrary pair of Boolean functions which operate on two sequences of correlated random variables. We derive a new upper bound on the correlation between the outputs of these functions. The upper bound may find applications in problems in many areas which deal with common information. We build upon Witsenhausen's result on maximum correlation. The present upper bound takes into account the effective length of the Boolean functions in characterizing the correlation. We use the new bound to characterize the communication-cooperation tradeoff in multi-terminal communications. We investigate binary block-codes (BBC). A BBC is defined as a vector of Boolean functions. We consider an ensemble of BBCs which is randomly generated using single-letter distributions. We characterize the vector of dependency spectrums of these BBCs. We use this vector to bound the correlation between the outputs of two distributed BBCs. Finally, the upper bound is used to show that the large blocklength single-letter coding schemes studied in the literature are sub-optimal in various multi-terminal communication settings.

Information Theory
Optimal Coding for Randomized Kolmogorov Complexity and Its Applications

Shuichi Hirahara,Zhenjian Lu,Mikito Nanashima

2024-09-19

Abstract:The coding theorem for Kolmogorov complexity states that any string sampled from a computable distribution has a description length close to its information content. A coding theorem for resource-bounded Kolmogorov complexity is the key to obtaining fundamental results in average-case complexity, yet whether any samplable distribution admits a coding theorem for randomized time-bounded Kolmogorov complexity ($\mathsf{rK}^\mathsf{poly}$) is open and a common bottleneck in the recent literature of meta-complexity. Previous works bypassed this issue by considering probabilistic Kolmogorov complexity ($\mathsf{pK}^\mathsf{poly}$), in which public random bits are assumed to be available. In this paper, we present an efficient coding theorem for randomized Kolmogorov complexity under the non-existence of one-way functions, thereby removing the common bottleneck. This enables us to prove $\mathsf{rK}^\mathsf{poly}$ counterparts of virtually all the average-case results that were proved only for $\mathsf{pK}^\mathsf{poly}$, and enables the resolution of the open problems of Hirahara, Ilango, Lu, Nanashima, and Oliveira (STOC'23) and Hirahara, Kabanets, Lu, and Oliveira (CCC'24). The key technical lemma is that any distribution whose next bits are efficiently predictable admits an efficient encoding and decoding scheme, which could be of independent interest to data compression.

Computational Complexity
Points-Polynomials Incidence Theorem with Applications to Coding Theory

Itzhak Tamo

2023-12-20

Abstract:This paper focuses on incidences over finite fields, extending to higher degrees a result by Vinh \cite{VINH20111177} on the number of point-line incidences in the plane $\mathbb{F}^2$, where $\mathbb{F}$ is a finite field. Specifically, we present a bound on the number of incidences between points and polynomials of bounded degree in $\mathbb{F}^2$. Our approach employs a singular value decomposition of the incidence matrix between points and polynomials, coupled with an analysis of the related group algebras. This bound is then applied to coding theory, specifically to the problem of average-radius list decoding of Reed-Solomon (RS) codes. We demonstrate that RS codes of certain lengths are average-radius list-decodable with a constant list size, which is dependent on the code rate and the distance from the Johnson radius. While a constant list size for list-decoding of RS codes in this regime was previously established, its existence for the stronger notion of average-radius list-decoding was not known to exist.

Information Theory,Combinatorics
Some Perspectives on Computational and Communication Complexity

andrew yao

DOI: https://doi.org/10.1109/ISIT.2006.261581

2006-01-01

Abstract:Summary form only given,as follows. In past decades, the theory of computational complexity has fl ourished in terms of both the revelation of its internal structures and the unfolding of its numerous applications. In this talk we discuss several persistent and interwoven themes underlying many of these accomplishments. In particular we shall focus on the interplay between communication and computation which has a key role in these developments. We also speculate on promising future directions in the study of computational and communication complexity.
Dimensions of Channel Coding: From Theory to Algorithms to Applications

Tuvi Etzion,Paul H. Siegel,Han Mao Kiah,Hessam Mahdavifar,Farzad Parvaresh,Moshe Schwartz,Ido Tal,Eitan Yaakobi,Xinmiao Zhang

DOI: https://doi.org/10.1109/jsait.2023.3338326

2023-01-01

IEEE Journal on Selected Areas in Information Theory

Abstract:This special issue of the IEEE Journal on Selected Areas in Information Theory is dedicated to the memory of Alexander Vardy, a pioneer in the theory and practice of channel coding. His ground-breaking contributions ranged from unexpected solutions of long-standing theoretical conjectures to ingenious decoding algorithms that broke seemingly insurmountable barriers to code performance. Inspired not just by the mathematical beauty of coding theory but also by its engineering utility, Alex developed novel coding techniques that have had a profound impact on modern information technology. At the same time, his innovations have left their imprint on other scientific disciplines, such as information theory, computer science, and discrete mathematics.
Semantic Information Theory: Recent Advances and Future Challenges

Gangtao Xin,Pingyi Fan,Khaled B. Letaief

DOI: https://doi.org/10.20944/preprints202310.1208.v1

2023-01-01

Abstract:In recent years, semantic communication has received significant attention from both academia and industry, driven by the growing demands for ultra-low latency and high-throughput capabilities in emerging intelligent services. Nonetheless, a comprehensive and effective theoretical framework for semantic communication has yet to be established. In particular, finding the fundamental limits of semantic communication, exploring the capabilities of semantic-aware networks, or utilizing theoretical guidance for deep learning in semantic communication are very important but yet still unresolved issues. In this paper, we delve into the pertinent advancements in semantic information theory. Grounded in the foundational work of Claude Shannon, we present the latest developments in semantic entropy, semantic rate distortion, and semantic channel capacity. Additionally, we will analyze some open problems in semantic information measurement and semantic coding, providing a theoretical basis for the design of a semantic communication system. Furthermore, we carefully review several mathematical theories and tools and evaluate their applicability in the context of semantic communication. Finally, we shed light on the challenges encountered in both semantic communication and semantic information theory.
Supporting Information for the Paper: Optimal Ternary Constant-Composition Codes of Weight Four and Distance Five, IEEE Trans. Inform. Theory, To Appear

Fei Gao,Gennian Ge

DOI: https://doi.org/10.48550/arXiv.1012.0392

2010-12-02

Information Theory

Abstract:Supporting Information for the Paper: Optimal Ternary Constant-Composition Codes of Weight Four and Distance Five, IEEE Trans. Inform. Theory, To Appear.
SIGACT News Complexity Theory Column 116

Lane A. Hemaspaandra

DOI: https://doi.org/10.1145/3586165.3586174

2023-02-28

ACM SIGACT News

Abstract:The penultimate complexity column during my time as complexity column editor is Parting Thoughts and Parting Shots (Read On for Details on How to Win Valuable Prizes!), by Eric Allender. Warmest thanks to Eric for sharing with the field this wide range of (potentially lucrative!) challenges.
Theory and Applications of Complex Networks 2014

Tingwen Huang,Qinggang Meng,Zifeng Yang,Chuandong Li,He Huang,Jianguo Du,Wei Zhang

DOI: https://doi.org/10.1155/2015/924967

IF: 1.43

2015-01-01

Mathematical Problems in Engineering

Abstract:The purpose of this special issue is to track the latest process of mathematical and computational analysis, engineering and applications, and others.It is well known that mathematical and computational analysis as a hot topic will promote the development of society in different fields, such as complex networks, neural networks, evolution computation, and researches of optimization and algorithm.Therefore, it is meaningful to investigate the new theory, mythology, and method for the engineering and applications.We receive many high-quality submissions that have been included in this special issue.These articles cover theoretical contributions and applications in project delivery method and energy-efficient scheduling.
Information Theory in Emerging Wireless Communication Systems and Networks

Erdem Koyuncu

DOI: https://doi.org/10.3390/e26070543

IF: 2.738

2024-06-26

Entropy

Abstract:Wireless communication systems and networks are rapidly evolving to meet the increasing demands for higher data rates, better reliability, and connectivity anywhere, anytime [...]

physics, multidisciplinary
On the Arithmetic Complexities of Hamming Codes and Hadamard Codes.

Zhengrui Li,Sian-Jheng Lin,Honggang Hu

2018-01-01

Abstract:In this paper, we study the arithmetic complexities of Hamming codes and Hadamard codes. To begin with, we present the minimum number of required exclusive-ORs~(XORs) in the encoding of (punctured)~Hadamard codes and (extended)~Hamming codes. Then the encoding algorithms for these codes are presented to achieve the lower bound.
Practical Coding Schemes for Cognitive Overlay Radios

Ernest Kurniawan,Andrea Goldsmith,Stefano Rini

DOI: https://doi.org/10.48550/arXiv.1203.4844

2012-06-09

Abstract:We develop practical coding schemes for the cognitive overlay radios as modeled by the cognitive interference channel, a variation of the classical two user interference channel where one of the transmitters has knowledge of both messages. Inspired by information theoretical results, we develop a coding strategy for each of the three parameter regimes where capacity is known. A key feature of the capacity achieving schemes in these regimes is the joint decoding of both users' codewords, which we accomplish by performing a posteriori probability calculation over a combined trellis. The schemes are shown to perform close to the capacity limit with low error rate.

Information Theory
Several Mathematical Problems in Quantum Information Theory

FENG KeQin,JIN LingFei

DOI: https://doi.org/10.1360/n012016-00159

2017-01-01

Abstract:The theory of quantum communication and technology have been one of hot research topics in information science and technology since 1980's.In this paper,we survey some research development of several mathematical problems in quantum information theory.Particularly,we focus on the important role of combinatorics (including graph theory),number theory,algebra and algebraic geometry (the arithmetic theory of algebraic curves over finite field) in investigating quantum measurement and quantum error-correction.

2014 IEEE Communications Society and Information Theory Society Joint Paper Award

Guest editorial: Selected papers from IEEE/CIC ICCC2014

2015 Scott Helt Memorial Award for the Best Paper Published in the IEEE Transactions on Broadcasting

An Algebraic and Probabilistic Framework for Network Information Theory

How Hard is Computing Parity with Noisy Communications?

Semantic Communications: Theories, Technologies and Applications

Weight Distributions of Regular Low-Density Parity-Check Codes over Finite Fields

Coding and Cryptology: Proceedings of the International Workshop, Wuyi Mountain, Fujian, China, 11-15 June 2007

On the Sub-optimality of Single-Letter Coding over Networks

Optimal Coding for Randomized Kolmogorov Complexity and Its Applications

Points-Polynomials Incidence Theorem with Applications to Coding Theory

Some Perspectives on Computational and Communication Complexity

Dimensions of Channel Coding: From Theory to Algorithms to Applications

Semantic Information Theory: Recent Advances and Future Challenges

Supporting Information for the Paper: Optimal Ternary Constant-Composition Codes of Weight Four and Distance Five, IEEE Trans. Inform. Theory, To Appear

SIGACT News Complexity Theory Column 116

Theory and Applications of Complex Networks 2014

Information Theory in Emerging Wireless Communication Systems and Networks

On the Arithmetic Complexities of Hamming Codes and Hadamard Codes.

Practical Coding Schemes for Cognitive Overlay Radios

Several Mathematical Problems in Quantum Information Theory