On Orthogonal Polynomials and Finite Moment Problem
Fawaz Hjouj1, *, Mohamed Soufiane Jouini1
Identifiers and Pagination:Year: 2022
E-location ID: e187412312209260
Publisher ID: e187412312209260
Article History:Received Date: 10/6/2022
Revision Received Date: 27/7/2022
Acceptance Date: 26/8/2022
Electronic publication date: 01/11/2022
Collection year: 2022
open-access license: This is an open access article distributed under the terms of the Creative Commons Attribution 4.0 International Public License (CC-BY 4.0), a copy of which is available at: https://creativecommons.org/licenses/by/4.0/legalcode. This license permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
This paper is an improvement of a previous work on the problem recovering a function or probability density function from a finite number of its geometric moments, . The previous worked solved the problem with the help of the B-Spline theory which is a great approach as long as the resulting linear system is not very large. In this work, two solution algorithms based on the approximate representation of the target probability distribution function via an orthogonal expansion are provided. One primary application of this theory is the reconstruction of the Particle Size Distribution (PSD), occurring in chemical engineering applications. Another application of this theory is the reconstruction of the Radon transform of an image at an unknown angle using the moments of the transform at known angles which leads to the reconstruction of the image form limited data.
The aim is to recover a probability density function from a finite number of its geometric moments.
The tool is the orthogonal expansion approach. The Shifted-Legendre Polynomials and the Chebyshev Polynomials as bases for the orthogonal expansion are used in this study.
A high degree of accuracy has been obtained in recovering a function without facing a possible ill-conditioned linear system, which is the case with many typical approaches of solving the problem. In fact, for a normalized template function f on the interval [0, 1], and a reconstructed function ; the reconstruction accuracy is measured in two domains. One is the moment domain, in which the error (difference between the moments of f and the moments of ) is zero. The other measure is the standard difference in the norm -space ||f- || which can be ≈ 10-6 or less.
This paper discusses the problem of recovering a function from a finite number of its geometric moments for the PSD application. Linear transformations were used, as needed, so that the function is supported on the unit interval [0, 1], or on [0, α] for some choice of α. This transformation forces the sequence of moments to vanish. Then, an orthogonal expansion of the Scaled Shifted Legendre Polynomials, as well as the Chebyshev Polynomials, are developed. The result shows good accuracy in recovering different types of synthetic functions. It is believed that up to fifteen moments, this approach is safe and reliable.
In fact, the problem of determining f from a given finite sequence Mkf takes different forms due to the related physical and mathematical assumptions. Specifically, if Mfk is known for all orders, then f can be recovered completely, but if only a finite number of these moments are given, then we have the well-known inverse ill –conditioned problem. Furthermore, it is known that the support of the objective function f categorizes the problem into different scenarios [1-4]. The Hausdorff moment problem, where the support of f is a closed interval (a, b), the Stieltjes moment problem, where the support of f on (0, +∞), and the Hamburger moment problem, where f is supported on (−∞, +∞).
Reconstructing a function from a finite number of its moments is an essential tool for many problems in science and technology. Among many applications that involve the moment problems, three major fields are described. Namely, chemical engineering applications, tomography, and image processing. The most known existing methods of solving the moment problem are reviewed in . A general review of these applications is now given.
In the field of chemical engineering, the Particle Size Distribution (PSD) is a crucial process that results in several industrial operations in chemical engineering, especially in dynamic multiphase flows. The size distribution of particles can be essential for several applications. For example, this property may have an impact on the efficiency of processes like filtration, as a small product size may result in a significant increase in processing time. Moreover, PSD generally represents a pivotal result to assess the excellent quality of chemical process output. Methods to retrieve PSD can be divided into three main categories [1-4]. The first approach is based on analytical inversion techniques. In the second approach, PSD is recovered using discrete linear equations sets implemented in the independent model algorithm. The third approach consists of reconstructing PSD from known moments. In the last decade, several research studies in chemical engineering focused on PSD applications using moment-based techniques to determine distributions [4-10]. Moreover, most of the applications implement a limited, finite number of moments for the reconstruction introducing possible inaccuracies. This moment constraint makes chemical engineering applications restricted only to elementary distribution shapes such as Gaussian or lognormal functions.
Moment-based approach for several types of image processing and tomography problems attracted the attention of many researchers, for instance [11-20]. For example, in image processing, we compute the image moments from the given projections for the purpose of shape classification or object position and orientation, recovering a general linear transformation of images, segmentation, texture analysis [12-16], and others. In the field of tomography, including digital rock physics, we deal with the well-known application of reconstructing an image from its moments or the reconstruction of the Radon Transforms from their moments [17-21]. Specifically, we use the connection between the projection moments and the image moments, and the connections among the projection moments from different views. Using these known relations [13-17], we obtain all possible image moments from the given projections. The image can then be recovered.
As said, a full review of the most known existing methods of solving the moment problem is reviewed .
This work considers the Hausdorff moment problem and proposes the use of orthogonal polynomial expansion techniques to solve this problem. Without loss of generality,
This work is organized as follows: In the next section, our proposed method is presented. Section 3 is concerned with experiments and discussion. Finally, the conclusion can be found in the last section.
2. MATERIALS AND METHODS
Our tool is the orthogonal expansion. Mathematics Literature provides a rich theory and tools for the classical orthogonal expansion of functions [22-29]. The choice of several options of orthogonal bases that serve and fit the physical, geometry, and settings of our current problem is explored. Undoubtedly, the role of the Fourier series, the Legendre’s and Chebyshev polynomials in many fields of pure and applied sciences are well-established. An orthogonal expansion that allows us to represent the expansion's coefficients in terms of the moments rather than the function itself since it is not known, is required. It is found, for example, that the Fourier series is not relevant to this problem. Expressing the Fourier series coefficients in terms of moments is possible, but the numerical implementation immediately would suffer the overflow issues. On the other hand, the Legendre series and Chebyshev series proved very well stable solutions using a few moments of the target function.
2.1. Using Legendre Polynomials
The Legendre polynomials ϕm(x) form a complete orthogonal system over the interval [-1,1]:
where δmn denotes the Kronecker delta.
Since we require an approximation on the interval [ 0,1], we first use the mapping (transformation)
that moves the interval [0,
Using (5), we write (7) as:
But so (8) is written as:
Using (9), equation (6) is written as:
If we consider the N-partial sum of (10), we obtain:
2.2. Using Chebyshev Polynomials
The Shifted Chebyshev Polynomial of the second kind , say
We can express our objective function in the following manner:
Using (12), we solve for the coefficients,
Using (13), we write (15) as
Thus, (14) is written as
Finally, we consider the partial sum of (18) to obtain:
Examples and discussion of these results are given in the next section.
3. RESULTS AND DISCUSSION
Now, the following remarks concerning our method are addressed. First, in (3.1), our theory using synthetic functions is tested and validated using MATLAB. In doing so, moments of order up to fifteen or less are employed, and a reliable approximation using either one of the two families of polynomials of this study is shown. Second, in (3.2), the behavior of a series of polynomials with a large number of terms and other properties is considered. This work is not a classical interpolation since interpolation requires a sample of the objective function. In the classical theory of interpolation, the Chebyshev series is believed to be a better approximation if the interpolation nodes are chosen to be the Chebyshev nodes. In the context of this work, the two series (11) and (19) are not comparable in terms of accuracy, given that we want to rely on a few terms of these series. However, they exhibit different behaviors in regard to errors. Overall, thanks to the restriction of using only a few moments, we will not need many terms. It is believed that up to fifteen moments, this approach is safe and reliable.
In testing our formulas (11) and (19), the support of the testing functions will be the interval (0,
As a first example, we consider the function:
|Fig. (1). (a-e) The function f(x)=sin(2πx)+1 on (0,1) recovered using (11) with different moments: N=2,4,6,8,10, along with the corresponding errors (20). (f) plot of elk .|
In the second example, consider the function:
|Fig. (2). a-e)_The function f(x)=exp [ -80(x-0.3)^2 ] + 1/2 exp [ -80 (x-0.6)^2 ] on (0,1) recovered using (19) with different moments: N=6, 8, 10, 12, 15 along with the corresponding errors (21). (f) plot of elk.|
The assumption that f(0) = f(1) = 0 is natural in some applications. For example, in image processing and tomography, we can assume that the image is supported in the interior of the unit circle. Similarly, we consider the value of PSD out of the support (0, 1) to be small enough and can be set as zero. For the rest of our experiments and discussion, we will be under this assumption.
|Fig. (3). (a-e) The function f(x)=sin(πx) e^10x normailzed on [0,1] recovered using (11), red graphs, and (19), blue graphs, with different moments: N=3,5,7,10,12 along with the corresponding errors (20) and (21). (f) plots of [el]_k and [ec]_k.|
(a-b) The function
(c-d) The function
3.2. The Case of Large N
Although our approach never needs a large N, the completeness of this discussion needs to address several concerns regarding the approximation by polynomials. The Weierstrass approximation theorem  states that for every continuous function
In the classical interpolation practice, this issue using different approaches is mitigated, such as change of interpolation points, using the S-Runge algorithm without resampling, use of constrained minimization, use of piecewise polynomials, Least-squares fitting, and others. Perhaps, the most common of these is the standard Chebyshev points. Although our work here is not a classical interpolation since interpolations require the knowledge of a sample of
For visual display, we repeat the test of the function
This paper discusses the problem of recovering a function from a finite number of its geometric moments for the PSD application. Linear transformations were used, as needed so that the function is supported on the unit interval
[0, 1], or on [0,
LIST OF ABBREVIATIONS
|PSD||= Particle Size Distribution|
CONSENT FOR PUBLICATION
AVAILABILITY OF DATA AND MATERIALS
The data supporting the findings of the article is available within the article.
CONFLICT OF INTEREST
The authors declare no conflict of interest, financial or otherwise.