A strategy for selecting calibration samples for multivariate modelling

A sample selection strategy based on the Successive Projections Algorithm (SPA), which is a technique originally developed for variable selection, is proposed. The strategy selects a subset of samples that are minimally redundant but still representative of the data set. The selection takes into account both X and Y statistics, thus tailoring the choice of samples according to the spectral profiles of the chemical species involved in the analysis. Such procedure is of value to reduce the experimental and computational workload involved in the multivariate calibration, as well as in the transfer of calibration between different instruments. The strategy was applied to UV-VIS spectrometric simultaneous multicomponent analysis of complexes of Co2+, Cu2+, Mn2+, Ni2+ and Zn2+ with 4-(2-piridilazo)resorcinol and also to total sulphur determination in diesel by NIR spectrometry. The selection of samples was preceded by wavelength selection to avoid ill-conditioning problems in the multiple linear regression (MLR) modeling employed by SPA. In both applications, SPA reduced the number of variables and samples considerably, especially in the NIR data set, where it provided an impressive reduction in the number of wavelengths from 3071 to 10 and in the number of samples from 92 to 10. MLR models developed with the selected calibration samples displayed no significant loss of prediction ability when compared to MLR and PLS1 models built with the full set of calibration samples. This finding shows that the selected samples do convey the information needed for modeling. Moreover, in the NIR application, sample selection by SPA provided significantly better results than the classic Kennard-Stone (KS) algorithm. (C) 2004 Elsevier B.V. All rights reserved.