Optimal wavelet filter construction using X and Y data

R K H Galvao, G E Jose, H A Dantas, M C U Araujo, E C da Silva, H M Paiva, T C B Saldanha, E S O N de Souza

Research output: Contribution to journalArticle

27 Citations (Scopus)

Abstract

It has been recently shown that the predictive ability of wavelet models in multivariate calibration problems can be improved by optimizing the filters employed in the Discrete Wavelet Transform (DWT) with respect to the statistics of the matrix of instrumental responses. However, no attempt has been made at exploiting the statistics of the matrix of predicted parameters in the optimization process. This work addresses this issue and proposes a novel strategy for wavelet filter optimization that aims at directly minimizing the prediction error of a wavelet regression model with respect to a given validation set. Moreover, some theoretical and algorithmic aspects of the angular parameterization of wavelet filters needed for the optimization procedure are clarified. The parameterization is explained in a simple graphical manner. A requirement on the sum of the angular parameters and its implications in the optimization strategy are discussed. Finally, a procedure for obtaining the angular parameters associated to any traditional mother wavelet is provided, both as an algorithm and as a Matlab code. The proposed strategy is illustrated in a simulated multivariate calibration example involving two analytes and also in a problem of total sulphur determination in diesel samples by near-infrared (NIR) absorption spectrometry. Both the simulated and the real examples show that the proposed filter optimization procedure improves the prediction ability of wavelet regression models. Moreover, in the sulphur determination problem, the wavelet models result in a smaller prediction error than a traditional Partial Least Squares Regression (PLS) model. (C) 2003 Elsevier B.V All rights reserved.

LanguageEnglish
Pages110-119
Number of pages10
JournalChemometrics and intelligent laboratory systems
Volume70
Issue number1-2
DOIs
Publication statusPublished - 28 Jan 2004

Fingerprint

Sulfur determination
Parameterization
Statistics
Calibration
Discrete wavelet transforms
Infrared absorption
Spectrometry

Keywords

  • wavelet transform optimization
  • quadrature-mirror filter banks
  • NIR spectrometry
  • diesel analysis
  • total sulphur determination
  • multivariate calibration
  • variable selection
  • regression

Cite this

Galvao, R. K. H., Jose, G. E., Dantas, H. A., Araujo, M. C. U., da Silva, E. C., Paiva, H. M., ... de Souza, E. S. O. N. (2004). Optimal wavelet filter construction using X and Y data. Chemometrics and intelligent laboratory systems, 70(1-2), 110-119. https://doi.org/10.1016/j.chemolab.2003.09.001
Galvao, R K H ; Jose, G E ; Dantas, H A ; Araujo, M C U ; da Silva, E C ; Paiva, H M ; Saldanha, T C B ; de Souza, E S O N . / Optimal wavelet filter construction using X and Y data. In: Chemometrics and intelligent laboratory systems. 2004 ; Vol. 70, No. 1-2. pp. 110-119.
@article{dbea99110b74433086a4593a7be0fee3,
title = "Optimal wavelet filter construction using X and Y data",
abstract = "It has been recently shown that the predictive ability of wavelet models in multivariate calibration problems can be improved by optimizing the filters employed in the Discrete Wavelet Transform (DWT) with respect to the statistics of the matrix of instrumental responses. However, no attempt has been made at exploiting the statistics of the matrix of predicted parameters in the optimization process. This work addresses this issue and proposes a novel strategy for wavelet filter optimization that aims at directly minimizing the prediction error of a wavelet regression model with respect to a given validation set. Moreover, some theoretical and algorithmic aspects of the angular parameterization of wavelet filters needed for the optimization procedure are clarified. The parameterization is explained in a simple graphical manner. A requirement on the sum of the angular parameters and its implications in the optimization strategy are discussed. Finally, a procedure for obtaining the angular parameters associated to any traditional mother wavelet is provided, both as an algorithm and as a Matlab code. The proposed strategy is illustrated in a simulated multivariate calibration example involving two analytes and also in a problem of total sulphur determination in diesel samples by near-infrared (NIR) absorption spectrometry. Both the simulated and the real examples show that the proposed filter optimization procedure improves the prediction ability of wavelet regression models. Moreover, in the sulphur determination problem, the wavelet models result in a smaller prediction error than a traditional Partial Least Squares Regression (PLS) model. (C) 2003 Elsevier B.V All rights reserved.",
keywords = "wavelet transform optimization, quadrature-mirror filter banks, NIR spectrometry, diesel analysis, total sulphur determination, multivariate calibration, variable selection, regression",
author = "Galvao, {R K H} and Jose, {G E} and Dantas, {H A} and Araujo, {M C U} and {da Silva}, {E C} and Paiva, {H M} and Saldanha, {T C B} and {de Souza}, {E S O N}",
year = "2004",
month = "1",
day = "28",
doi = "10.1016/j.chemolab.2003.09.001",
language = "English",
volume = "70",
pages = "110--119",
journal = "Chemometrics and intelligent laboratory systems",
issn = "0169-7439",
number = "1-2",

}

Galvao, RKH, Jose, GE, Dantas, HA, Araujo, MCU, da Silva, EC, Paiva, HM, Saldanha, TCB & de Souza, ESON 2004, 'Optimal wavelet filter construction using X and Y data' Chemometrics and intelligent laboratory systems, vol. 70, no. 1-2, pp. 110-119. https://doi.org/10.1016/j.chemolab.2003.09.001

Optimal wavelet filter construction using X and Y data. / Galvao, R K H ; Jose, G E ; Dantas, H A ; Araujo, M C U ; da Silva, E C ; Paiva, H M ; Saldanha, T C B ; de Souza, E S O N .

In: Chemometrics and intelligent laboratory systems, Vol. 70, No. 1-2, 28.01.2004, p. 110-119.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Optimal wavelet filter construction using X and Y data

AU - Galvao, R K H

AU - Jose, G E

AU - Dantas, H A

AU - Araujo, M C U

AU - da Silva, E C

AU - Paiva, H M

AU - Saldanha, T C B

AU - de Souza, E S O N

PY - 2004/1/28

Y1 - 2004/1/28

N2 - It has been recently shown that the predictive ability of wavelet models in multivariate calibration problems can be improved by optimizing the filters employed in the Discrete Wavelet Transform (DWT) with respect to the statistics of the matrix of instrumental responses. However, no attempt has been made at exploiting the statistics of the matrix of predicted parameters in the optimization process. This work addresses this issue and proposes a novel strategy for wavelet filter optimization that aims at directly minimizing the prediction error of a wavelet regression model with respect to a given validation set. Moreover, some theoretical and algorithmic aspects of the angular parameterization of wavelet filters needed for the optimization procedure are clarified. The parameterization is explained in a simple graphical manner. A requirement on the sum of the angular parameters and its implications in the optimization strategy are discussed. Finally, a procedure for obtaining the angular parameters associated to any traditional mother wavelet is provided, both as an algorithm and as a Matlab code. The proposed strategy is illustrated in a simulated multivariate calibration example involving two analytes and also in a problem of total sulphur determination in diesel samples by near-infrared (NIR) absorption spectrometry. Both the simulated and the real examples show that the proposed filter optimization procedure improves the prediction ability of wavelet regression models. Moreover, in the sulphur determination problem, the wavelet models result in a smaller prediction error than a traditional Partial Least Squares Regression (PLS) model. (C) 2003 Elsevier B.V All rights reserved.

AB - It has been recently shown that the predictive ability of wavelet models in multivariate calibration problems can be improved by optimizing the filters employed in the Discrete Wavelet Transform (DWT) with respect to the statistics of the matrix of instrumental responses. However, no attempt has been made at exploiting the statistics of the matrix of predicted parameters in the optimization process. This work addresses this issue and proposes a novel strategy for wavelet filter optimization that aims at directly minimizing the prediction error of a wavelet regression model with respect to a given validation set. Moreover, some theoretical and algorithmic aspects of the angular parameterization of wavelet filters needed for the optimization procedure are clarified. The parameterization is explained in a simple graphical manner. A requirement on the sum of the angular parameters and its implications in the optimization strategy are discussed. Finally, a procedure for obtaining the angular parameters associated to any traditional mother wavelet is provided, both as an algorithm and as a Matlab code. The proposed strategy is illustrated in a simulated multivariate calibration example involving two analytes and also in a problem of total sulphur determination in diesel samples by near-infrared (NIR) absorption spectrometry. Both the simulated and the real examples show that the proposed filter optimization procedure improves the prediction ability of wavelet regression models. Moreover, in the sulphur determination problem, the wavelet models result in a smaller prediction error than a traditional Partial Least Squares Regression (PLS) model. (C) 2003 Elsevier B.V All rights reserved.

KW - wavelet transform optimization

KW - quadrature-mirror filter banks

KW - NIR spectrometry

KW - diesel analysis

KW - total sulphur determination

KW - multivariate calibration

KW - variable selection

KW - regression

U2 - 10.1016/j.chemolab.2003.09.001

DO - 10.1016/j.chemolab.2003.09.001

M3 - Article

VL - 70

SP - 110

EP - 119

JO - Chemometrics and intelligent laboratory systems

T2 - Chemometrics and intelligent laboratory systems

JF - Chemometrics and intelligent laboratory systems

SN - 0169-7439

IS - 1-2

ER -

Galvao RKH, Jose GE, Dantas HA, Araujo MCU, da Silva EC, Paiva HM et al. Optimal wavelet filter construction using X and Y data. Chemometrics and intelligent laboratory systems. 2004 Jan 28;70(1-2):110-119. https://doi.org/10.1016/j.chemolab.2003.09.001