Academia.eduAcademia.edu

Sum Product Algorithm

description280 papers
group10 followers
lightbulbAbout this topic
The Sum Product Algorithm is a message-passing algorithm used in graphical models, particularly in probabilistic inference. It computes marginal distributions by propagating messages along the edges of a factor graph, facilitating efficient computation of the sum of products of factors associated with the graph's nodes.
lightbulbAbout this topic
The Sum Product Algorithm is a message-passing algorithm used in graphical models, particularly in probabilistic inference. It computes marginal distributions by propagating messages along the edges of a factor graph, facilitating efficient computation of the sum of products of factors associated with the graph's nodes.

Key research themes

1. How can the Sum Product Algorithm be efficiently implemented for decoding LDPC codes under practical hardware and quantization constraints?

This research area focuses on developing efficient implementations of the Sum Product Algorithm (SPA) for decoding Low-Density Parity-Check (LDPC) codes, particularly using Log-Likelihood Ratios (LLRs). SPA-based decoders approach channel capacity but are computationally intensive. The studies investigate reduced-complexity algorithmic variants, hardware architectures, quantization effects, and parallelization schemes to enable high-speed and low-complexity decoding suitable for real-world communication systems. Such work is critical as LDPC codes are widely adopted in modern digital communication standards.

Key finding: This paper presents multiple reduced-complexity versions of the SPA operating entirely in the log-likelihood ratio domain, which replace multiplications by additions and enable use of simple hardware components like adders... Read more
Key finding: The work elaborates on both hard-decision (Bit Flipping) and soft-decision (Sum Product) decoding algorithms for LDPC codes using generated parity check matrices. It highlights that the Sum Product Algorithm (also termed... Read more

2. What algorithmic and architectural strategies can accelerate large integer and polynomial multiplication leveraging data decomposition and parallelism?

This theme investigates improving computational efficiency for large integer and polynomial multiplication, crucial in cryptography and signal processing. Innovations include divide-and-conquer algorithms, Toom-Cook variants, parallel prefix computations, delayed carry accumulation, and approximate computing. Research accounts for hardware constraints, such as minimizing register usage, workload balance on multicore or hardware accelerators, and reducing computational steps. The goal is to reduce multiplication complexity and execution time while preserving correctness — a fundamental challenge for high-performance encryption, error correction, and DSP applications.

Key finding: This paper proposes a new parallel algorithm for multiplying n large numbers on multicore systems that achieves up to 80% runtime improvement over the best known parallel algorithms. It leverages prefix-scan techniques... Read more
Key finding: The paper develops an iterative method applying Toom-Cook unbalanced multiplication (especially Toom-2.5) optimized for operands with large length disparity. The approach evaluates the smaller operand once and reuses... Read more
Key finding: This research introduces parallelization strategies for integer multiplication algorithms targeting 32-bit and 64-bit platforms. Using a delayed carry mechanism, it removes dependencies across addition loop iterations,... Read more
Key finding: The paper proposes an optimized M-term Karatsuba-like polynomial multiplication algorithm for finite fields that reduces multiplication and addition counts compared to classic Karatsuba. The divide-and-conquer method lowers... Read more

3. How can message passing algorithms be applied to adversarial multi-sensor fusion and Bayesian smoothing for improved decision reliability?

This area focuses on advanced applications of message passing (sum-product) algorithms for enhancing fusion and estimation in adversarial environments and complex state-space models. It addresses scenarios where data are disrupted by malicious agents, or smoothing requires bridging forward and backward probabilistic inferences. Methods involve graphical models and factor graphs to perform iterative message passing that captures uncertainty and enables joint filtering or smoothing. These approaches improve robustness against Byzantine attacks, exploit statistical dependencies, and provide computationally efficient solutions for Bayesian smoothing in conditionally linear Gaussian systems.

Key finding: This survey paper frames a wide variety of algorithms from machine learning, game theory, optimization, and computational geometry as instances of a multiplicative weights update meta-algorithm. The core insight is that... Read more
Key finding: The paper introduces double Bayesian smoothing (DBS), combining a double Bayesian filter in the forward pass with an interconnection of two backward information filters (BIFs) in the backward pass, all formulated as... Read more
Key finding: This work proposes a near-optimal message passing algorithm to perform decision fusion in adversarial sensor networks with Byzantine nodes aiming to corrupt local decisions. The approach reduces complexity compared to... Read more
Key finding: The paper extends message passing based fusion to scenarios where Byzantine adversaries coordinate attacks by generating correlated, synchronized false reports mimicking the Markovian behavior of system states. It derives a... Read more

All papers in Sum Product Algorithm

This study presents a novel algorithm for transforming binary linear codes with parameters (n,k,d) into a bipartite graph representation. The proposed method explicitly represents each codeword as a node, enabling a complete structural... more
The performance of several existing and partly new algorithms for positioning of sensor node based on distance estimate is compared when the distance estimates are obtained from a measurement campaign. The distance estimates are based on... more
Approximate inference in large and densely connected graphical models is a challenging but highly relevant problem. Belief propagation, as a method for performing approximate inference in loopy graphs, has shown empirical success in many... more
We study iterative receivers for joint decoding and channel-state estimation for transmission on block-fading channels of root-LDPC-coded signals. Root-LDPC codes are known to be most performant codes for block-fading channels, as their... more
This paper investigates hardware cyber-security risks associated with channel decoders, which are commonly acquired as a black box in semiconductor industry. It is shown that channel decoders are potentially attractive targets for... more
In satellites, nonlinear amplifiers used near saturation severely distort the transmitted signal and cause difficulties in its reception. Nevertheless, the nonlinearities introduced by memoryless bandpass amplifiers preserve the... more
This paper introduces a class of structured lowdensity parity-check (LDPC) codes whose parity check matrices are arrays of permutation matrices. The permutation matrices are obtained from Latin squares and form a finite field under some... more
In this paper, we investigate the sequence estimation problem of faster-than-Nyquist (FTN) signaling as a promising approach for increasing spectral efficiency (SE) in future communication systems. In doing so, we exploit the concept of... more
We investigate faster-than-Nyquist modulation based on short finite pulses over the AWGN channel. We consider several pulse shapes and compare their in- formation rates for several system setups. We com- pare the effect of increasing the... more
This paper explores the intersection of complex analysis and number theory by examining the geometric loci generated by a specific complex rational function and its connection to recursive prodsum sets.
All analog circuits are affected by device mismatch, slight errors in the physical characteristics of analog devices. In many applications, mismatch reduces precision, making power and complexity advantages irrelevant. In this paper, we... more
Iterative decoders, including Turbo decoders, provide near-optimal error protection for various communication channels and storage media. CMOS analog implementations of these decoders offer dramatic savings in complexity and power... more
Efficient implementations of the sum-product algorithm (SPA) for decoding low-density parity-check (LDPC) codes using loglikelihood ratios (LLR) as messages between symbol and parity-check nodes are presented. Various reduced-complexity... more
Rapid variation of channel coefficients is one of the most challenging problems in wireless communication. To provide and keep communication in desired quality, channel coefficients should be estimated continuously. This can be made by... more
In this paper, by applying the concept of linear prediction, which is widely used for fading channels, to phaseuncertain communications, we generalize existing linear predictive detection algorithms for transmission over channels with... more
Global Navigation Satellite Systems (GNSS) are a widely used technology for positioning and navigation. GNSS positioning relies on pseudorange measurements from satellites to receivers. A pseudorange is the apparent distance between two... more
In this paper, we examine code-aided synchronization in the presence of carrier frequency uncertainties and phase noise. As code-aided synchronization can only achieve high estimation accuracy if the initial parameter offset is... more
In this paper, we examine code-aided synchronization in the presence of carrier frequency uncertainties and phase noise. As code-aided synchronization can only achieve high estimation accuracy if the initial parameter offset is... more
This work investigates reliable wireless broadcast with asynchronous data access. A wireless broadcast system based on LT-codes, a realization of the recently introduced Fountain codes, is introduced. We review the traditional problem... more
Resumo-Um esquema de codificação de faixa eficiente para receptores iterativos foi investigado. Canais não-coerentes M-APSK (do inglês, M-ary Amplitude Phase Shift Keying) foram considerados. O esquema propõe uma nova abordagem para um... more
The error floor phenomenon, associated with iterative decoders, is one of the most significant limitations to the applications of low-density parity-check (LDPC) codes. A variety of techniques from code design to decoder implementation... more
Recently, a novel method for developing filtering algorithms, based on the interconnection of two Bayesian filters and called double Bayesian filtering, has been proposed. In this manuscript we show that the same conceptual approach can... more
In this manuscript, a general method for deriving filtering algorithms that involve a network of interconnected Bayesian filters is proposed. This method is based on the idea that the processing accomplished inside each of the Bayesian... more
In this manuscript, a general method for deriving filtering algorithms that involve a network of interconnected Bayesian filters is proposed. This method is based on the idea that the processing accomplished inside each of the Bayesian... more
In this manuscript the fixed-lag smoothing problem for conditionally linear Gaussian state-space models is investigated from a factor graph perspective. More specifically, after formulating Bayesian smoothing for an arbitrary state-space... more
Using a finite field approach, a novel algebraic construction of low-density parity-check (LDPC) convolutional codes with fast encoding property is proposed. According to the matrices of quasi-cyclic (QC) codes constructed based on the... more
Stopping criteria for the iterative decoding of lowdensity parity-check codes are considered. For a successful decoding task an inherent stopping criterion is used: the fulfillment of all parity-check constraints. For an unsuccessful task... more
In modern communication systems, high-order modulation schemes have been widely employed to improve the spectral efficiency. In this context, soft decision methods are usually preferred, due to their superior performance over hard... more
We compare the performance of short-length linear binary codes on the binary erasure channel and the binaryinput Gaussian channel. We use a universal decoder that can decode any linear binary block code: Gaussian-elimination based... more
This paper proposes a decoding algorithm for nonbinary low-density parity-check (NB-LDPC) codes, aiming to improve the error rate performance for NAND flash memory. Several NB-LDPC decoding methods for NAND flash memory have been studied.... more
We develop a robust multiuser detector for a Frequency Division Multiplexing (FDM) system where each user employs a binary continuous phase modulation (CPM) generated through a low-cost transmitter, thus characterized by a significant... more
The paper proposes a numerically stable recursive algorithm for the exact computation of the linear-chain conditional random field gradient. It operates as a forward algorithm over the log-domain expectation semiring and has the purpose... more
We consider the decoding of LDPC codes in presence of non-Gaussian noise, especially a set of ǫ-mixture models. For each of these models, the optimal LLRs are presented. We study the performance degradation due to the use of incorrect LLR... more
This paper considers two recently-proposed receivers, Tikh and DCT. Both receivers are computationallyefficient, iterative and designed to be robust against phase noise on the local oscillators of digital bandpass communication systems.... more
The sum-product algorithm (belief/probability propagation) can be naturally mapped into analog transistor circuits. These circuits enable the construction of analog-VLSI decoders for turbo codes, low-density parity-check codes, and... more
In this manuscript the fixed-lag smoothing problem for conditionally linear Gaussian state-space models is investigated from a factor graph perspective. More specifically, after formulating Bayesian smoothing for an arbitrary state-space... more
This paper presents a Relaxed Half-Stochastic (RHS) low-density parity-check (LDPC) decoding algorithm that uses some elements of the sum-product algorithm (SPA) in its variable nodes, but maintains the low-complexity interleaver and... more
This article surveys recent development on Euclidean interpoint distances (IPDs). IPDs find applications in many scientific fields and are the building blocks of several multivariate techniques such as comparison of distributions,... more
Message-passing algorithms have emerged as powerful techniques for approximate inference in graphical models. When these algorithms converge, they can be shown to find local (or sometimes even global) optima of variational formulations to... more
This paper presents an efficient algorithm for finding the dominant trapping sets of a low-density parity-check (LDPC) code. The algorithm can be used to estimate the error floor of LDPC codes or to be used as a tool to design LDPC codes... more
This paper presents five methods for constructing nonbinary LDPC codes based on finite geometries. These methods result in five classes of nonbinary LDPC codes, one class of cyclic LDPC codes, three classes of quasi-cyclic LDPC codes and... more
The increasing number of internet users in recent years has put a significant strain on communication systems. In response, new mobile network generations are released every decade. Currently, research efforts are focused on developing... more
Download research papers for free!