Abstract:In this paper, we introduce a new class of codes, called weighted parity-check codes, where each parity-check bit has a weight that indicates its likelihood to be one (instead of fixing each parity-check bit to be zero). It is applicable to a wide range of settings, e.g. asymmetric channels, channels with state and/or cost constraints, and the Wyner-Ziv problem, and can provably achieve the capacity. For the channels with state (Gelfand-Pinsker) setting, the proposed coding scheme has two advantages compared to the nested linear code. First, it achieves the capacity of any channel with state (e.g. asymmetric channels). Second, simulation results show that the proposed code achieves a smaller error rate compared to the nested linear code. We also discuss a sparse construction where the belief propagation algorithm can be applied to improve the coding efficiency.
What problem does this paper attempt to address?
The problem that this paper attempts to solve is to design a new coding scheme in channels with states (such as channels in the Gelfand - Pinsker setting) and asymmetric channels in order to achieve channel capacity and reduce the error rate. Specifically, the paper introduces a new class of codes - Weighted Parity - Check Codes (WPC), where each parity - check bit has a weight representing the probability of this bit being 1, rather than being fixed at 0 as in traditional linear codes.
### Main Contributions
1. **Achievable Capacity**: The paper proves that WPC codes can achieve the capacity of any channel with states.
2. **Low Error Rate**: Through simulation results, the paper shows that the WPC code has a lower error rate than Nested Linear Codes in some cases.
3. **Sparse Structure**: The paper also discusses a sparse construction, which enables the Belief Propagation Algorithm to be applied to improve coding efficiency.
### Application Scenarios
- **Channels with States**: For example, the channel in the Gelfand - Pinsker problem, whose statistical characteristics depend on a state variable, and this state variable is unknown and changing during the transmission process.
- **Asymmetric Channels**: For example, the Z - channel, which is common in storage technologies such as flash memory.
### Technical Details
- **Definition of Weighted Parity - Check Codes**: WPC codes represent the probability of each parity - check bit being 1 by assigning a weight to it. The encoder and decoder use the message - biasing function and the parity - biasing function respectively to generate and recover codewords.
- **Encoding and Decoding Functions**: The encoder selects the most likely codeword according to the message and the state, and the decoder recovers the original message according to the received signal.
- **Performance Analysis**: The paper verifies the performance of WPC codes through theoretical analysis and experimental verification, especially in channels with states and asymmetric channels.
### Experimental Results
The paper compares the performance of WPC codes and Nested Linear Codes under different conditions through experiments. The results show that the WPC code can significantly reduce the error rate in some cases, especially in channels with states.
### Conclusion
WPC codes provide a new method to achieve capacity in channels with states and asymmetric channels, and show good performance in practical applications. This method is not only of great significance in theory, but also provides new ideas for the design of actual communication systems.