Award Abstract # 1911166
CIF: Small: Optimal Coded Modulation When Asymmetric Signaling Achieves Capacity

NSF Org: CCF
Division of Computing and Communication Foundations
Recipient: UNIVERSITY OF CALIFORNIA, LOS ANGELES
Initial Amendment Date: August 5, 2019
Latest Amendment Date: August 17, 2022
Award Number: 1911166
Award Instrument: Standard Grant
Program Manager: Phillip Regalia
pregalia@nsf.gov
 (703)292-2981
CCF
 Division of Computing and Communication Foundations
CSE
 Directorate for Computer and Information Science and Engineering
Start Date: October 1, 2019
End Date: January 31, 2023 (Estimated)
Total Intended Award Amount: $230,000.00
Total Awarded Amount to Date: $264,776.00
Funds Obligated to Date: FY 2019 = $230,000.00
FY 2020 = $8,000.00

FY 2021 = $13,776.00

FY 2022 = $13,000.00
History of Investigator:
  • Richard Wesel (Principal Investigator)
    wesel@ee.ucla.edu
  • Dariush Divsalar (Co-Principal Investigator)
Recipient Sponsored Research Office: University of California-Los Angeles
10889 WILSHIRE BLVD STE 700
LOS ANGELES
CA  US  90024-4200
(310)794-0102
Sponsor Congressional District: 36
Primary Place of Performance: University of California-Los Angeles
6426 Boelter Hall
Los Angeles
CA  US  90095-1601
Primary Place of Performance
Congressional District:
36
Unique Entity Identifier (UEI): RN64EPNH8JC6
Parent UEI:
NSF Program(s): Special Projects - CCF,
Comm & Information Foundations
Primary Program Source: 01002223DB NSF RESEARCH & RELATED ACTIVIT
01001920DB NSF RESEARCH & RELATED ACTIVIT

01002021DB NSF RESEARCH & RELATED ACTIVIT

01002122DB NSF RESEARCH & RELATED ACTIVIT
Program Reference Code(s): 7923, 7935, 9178, 9251
Program Element Code(s): 287800, 779700
Award Agency Code: 4900
Fund Agency Code: 4900
Assistance Listing Number(s): 47.070

ABSTRACT

This project develops the theoretical framework necessary to achieve, on certain data communication channels, the highest possible reliable data rate while still using low-complexity practical decoders. Applications include satellites communicating using either free-space optical communication or radio-frequency communication. Practically all data is communicated by sending a sequence of symbols transmitted as a waveform over a physical channel. These symbols often determine the amplitudes and/or phases of the waveform and are typically drawn from a discrete alphabet of possible values. Traditionally, symbol alphabets are symmetric. For example, if there is a symbol with an amplitude of +5 volts there will also be a symbol with an amplitude of -5 volts. For symmetric alphabets, there are a variety of existing coded modulation techniques that achieve high data rates using practical decoders. However, for important channels including common satellite channels, the best alphabets turn out not to be symmetric. This significantly complicates the design both of the coded modulation to achieve the highest rates and of the associated decoding algorithms. This project develops techniques that identify the optimal placement of alphabet symbols without requiring symmetry and introduces a new form of coded modulation, known as probabilistic permutation shaping, that achieves the highest possible data rates while still allowing practical decoders to use the optimal asymmetric alphabets. The practical impact from a successful outcome of this research will lead to high-speed satellite links for both earth-space and vice-versa.

This project utilizes probabilistic permutation shaping, which approaches channel capacity using a practical low-density parity check (LDPC) decoder even when the optimal input distribution is asymmetric. This approach avoids the complexity and error propagation of multi-layer coding with multi-stage decoding. It also avoids the latency and performance loss associated with joint de-mapping and decoding. The project also develops a family of new optimization techniques utilizing a modification of the Blahut-Arimoto algorithm that dynamically re-assigns the positions of mass points. Dynamic-assignment Blahut-Arimoto characterizes not only point solutions at a specific signal-to-noise ratio, but the entire evolution of the minimal cardinality optimal finite-support distributions as the channel capacity increases over the entire range of interest. In the context of these families of finite-support distributions, which are inherently asymmetric, probabilistic permutation shaping builds on the existing framework of probabilistic amplitude shaping to provide flexible and practical coded modulation solutions that support entire families of non-uniform distributions that would have previously been considered exotic.

This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

PUBLICATIONS PRODUCED AS A RESULT OF THIS RESEARCH

Note:  When clicking on a Digital Object Identifier (DOI) number, you will be taken to an external site maintained by the publisher. Some full text articles may not yet be available without a charge during the embargo (administrative interval).

Some links on this page may take you to non-federal websites. Their policies may differ from this site.

(Showing: 1 - 10 of 18)
Song, Dan and Areces, Felipe and Wang, Linfang and Wesel, Richard "Shaped TCM with List Decoding that Exceeds the RCU Bound by Optimizing a Union Bound on FER" GLOBECOM 2022 - 2022 IEEE Global Communications Conference , 2022 https://doi.org/10.1109/GLOBECOM48099.2022.10000695 Citation Details
Farsad, Nariman and Chuang, Will and Goldsmith, Andrea and Komninakis, Christos and Medard, Muriel and Rose, Christopher and Vandenberghe, Lieven and Wesel, Emily E. and Wesel, Richard D. "Capacities and Optimal Input Distributions for Particle-Intensity Channels" IEEE Transactions on Molecular, Biological and Multi-Scale Communications , v.6 , 2020 https://doi.org/10.1109/TMBMC.2020.3035371 Citation Details
Galijasevic, S. and Wesel, R. D. "Optimizing Write Voltages to Achieve Equal Reliability for All Pages in Flash Memory" , 2023 Citation Details
Galijasevic, Semira and Wesel, Richard "Optimizing Write Voltages for Independent, Equal-Rate Pages in Flash Memory" , 2022 https://doi.org/10.1109/IEEECONF56349.2022.10051932 Citation Details
Linfang Wang, Sean Chen "Neural-Network-Optimized Degree-Specific Weights for LDPC MinSum Decoding" 2021 International Symposium on Topics in Coding (ISTC), Montréal, Canada, Aug. 30-Sept. 3, 2021. , 2021 Citation Details
Nguyen, Jonathan and Wang, Linfang and Hulse, Chester and Dani, Sahil and Antonini, Amaael and Chauvin, Todd and Divsalar, Dariush and Wesel, Richard "Neural Normalized Min-Sum Message-Passing vs. Viterbi Decoding for the CCSDS Line Product Code" ICC 2022 - IEEE International Conference on Communications , 2022 https://doi.org/10.1109/ICC45855.2022.9838412 Citation Details
Stark, Maximilian and Bauch, Gerhard and Wang, Linfang and Wesel, Richard D. "Information Bottleneck Decoding of Rate-Compatible 5G-LDPC Codes" ICC 2020 - 2020 IEEE International Conference on Communications (ICC) , 2020 10.1109/ICC40277.2020.9149304 Citation Details
Stark, Maximilian and Wang, Linfang and Bauch, Gerhard and Wesel, Richard D. "Decoding Rate-Compatible 5G-LDPC Codes With Coarse Quantization Using the Information Bottleneck Method" IEEE Open Journal of the Communications Society , v.1 , 2020 https://doi.org/10.1109/OJCOMS.2020.2994048 Citation Details
Terrill, Caleb and Wang, Linfang and Chen, Sean and Hulse, Chester and Kuo, Calvin and Wesel, Richard and Divsalar, Dariush "FPGA Implementations of Layered MinSum LDPC Decoders Using RCQ Message Passing" , 2021 https://doi.org/10.1109/GLOBECOM46510.2021.9685732 Citation Details
Wang, L. and Song, D. and Areces, F. and Wesel, R.D. "Achieving Short-Blocklength RCU bound via CRC List Decoding of TCM with Probabilistic Shaping" 2022 International Conference on Communications , 2022 https://doi.org/10.1109/ICC45855.2022.9838498 Citation Details
Wang, Linfang and Chen, Sean and Nguyen, Jonathan and Dariush, Divsalar and Wesel, Richard "Neural-Network-Optimized Degree-Specific Weights for LDPC MinSum Decoding" 2021 11th International Symposium on Topics in Coding (ISTC) , 2021 https://doi.org/10.1109/ISTC49272.2021.9594227 Citation Details
(Showing: 1 - 10 of 18)

PROJECT OUTCOMES REPORT

Disclaimer

This Project Outcomes Report for the General Public is displayed verbatim as submitted by the Principal Investigator (PI) for this award. Any opinions, findings, and conclusions or recommendations expressed in this Report are those of the PI and do not necessarily reflect the views of the National Science Foundation; NSF has not approved or endorsed its content.

Project outcomes include the following:

An improved and extended Dynamic-Assignment Blahut-Arimoto algorithm that designs signal constellations that provide both geometric and probabilistic shaping.

 A coded modulation technique that uses a multi-composition distribution matcher for probabilistic and geometric shaping of trellis-coded modulation used with list decoding. This technique combines an outer error detection code, trellis coded modulation, and probabilistic amplitude shaping accomplished by the distribution matcher.  List decoding guided by the outer error detection code and the distribution matcher allows maximum likelihood decoding with a sufficiently large list size.  List decoding naturally continues down the list of likely codewords until a valid distribution-matcher output is identified, which is not easily accomplished with polar or low-density parity-check solutions.  The new technique achieves performance between 0.2 and 0.5 dB better than the random coding union bound at a codeword error rate of one error in one hundred thousand codewords. 

A new shaping technique that adapts constellation point locations and probabilities to allow separate channels associated with each bit of the constellation label to be independent (or nearly so) and to each achieve the same mutual information. This work was motivated by the need for each bit channel to have the same rate in Flash memory, where each bit channel supports a different page.   This technique also has applications for bit-interleaved coded modulation and low-density parity-check codes that use large constellations but rely on bit-metric decoding.

A new paradigm for low-bit-width low-density parity-check decoding that features the three steps of reconstruction, computation, and quantization to dynamically adapt nonlinear quantization of the messages passed within a low-density parity-check decoder.  This approach provides excellent decoder performance while significantly reducing resource requirements in field-programmable gate array implementations.

Modifications to practical low-density parity-check decoders that improve decoder performance and reduce decoder overhead.  In one example, a traditional low-density parity-check decoder used on a line code in a standard for space communications suffered a gap from maximum likelihood decoding performance and the machine learning modifications significantly closed that gap.

 A technique for applying probabilistic amplitude shaping that allows low-density parity-check codes to employ shaping with asymmetric constellations. A key aspect of this technique is to reserve some message bits of the LDPC codes to be "shaping" bits that tune the asymmetric distribution.


Last Modified: 11/17/2023
Modified by: Richard D Wesel

Please report errors in award information by writing to: awardsearch@nsf.gov.

Print this page

Back to Top of page