A strategy for selecting calibration samples for multivariate modelling

H A Dantas, R K H Galvao, M C U Araujo, E C da Silva, T C B Saldanha, G E Jose, C Pasquini, I M Raimundo, J J R Rohwedder

Research output: Contribution to journalArticle

63 Citations (Scopus)

Abstract

A sample selection strategy based on the Successive Projections Algorithm (SPA), which is a technique originally developed for variable selection, is proposed. The strategy selects a subset of samples that are minimally redundant but still representative of the data set. The selection takes into account both X and Y statistics, thus tailoring the choice of samples according to the spectral profiles of the chemical species involved in the analysis. Such procedure is of value to reduce the experimental and computational workload involved in the multivariate calibration, as well as in the transfer of calibration between different instruments. The strategy was applied to UV-VIS spectrometric simultaneous multicomponent analysis of complexes of Co2+, Cu2+, Mn2+, Ni2+ and Zn2+ with 4-(2-piridilazo)resorcinol and also to total sulphur determination in diesel by NIR spectrometry. The selection of samples was preceded by wavelength selection to avoid ill-conditioning problems in the multiple linear regression (MLR) modeling employed by SPA. In both applications, SPA reduced the number of variables and samples considerably, especially in the NIR data set, where it provided an impressive reduction in the number of wavelengths from 3071 to 10 and in the number of samples from 92 to 10. MLR models developed with the selected calibration samples displayed no significant loss of prediction ability when compared to MLR and PLS1 models built with the full set of calibration samples. This finding shows that the selected samples do convey the information needed for modeling. Moreover, in the NIR application, sample selection by SPA provided significantly better results than the classic Kennard-Stone (KS) algorithm. (C) 2004 Elsevier B.V. All rights reserved.

Original languageEnglish
Pages (from-to)83-91
Number of pages9
JournalChemometrics and Intelligent Laboratory Systems
Volume72
Issue number1
DOIs
Publication statusPublished - 28 Jun 2004

Keywords

  • successive Projections algorithm
  • sample selection
  • UV-VIS and NIR spectrometry
  • diesel analysis
  • total sulphur determination
  • multivariate calibration
  • multicomponent analysis
  • genetic algorithms
  • spectra

Fingerprint Dive into the research topics of 'A strategy for selecting calibration samples for multivariate modelling'. Together they form a unique fingerprint.

Cite this