Abstract
Maximum likelihood estimation (MLE) of hyperparameters in Gaussian process regression as well as other computational models usually and frequently requires the evaluation of the logarithm of the determinant of a positive-definite matrix (denoted by Chereafter). In general, the exact computation of log del C is of O(N-3) operations where N is the matrix dimension. The approximation of log del C could be developed with O(N-2) operations based on power-series expansion and randomized trace estimator. In this paper, the accuracy and effectiveness of using uniformly distributed seeds for log det C approximation are investigated. The research shows that uniform-seed based approximation is an equally good alternative to Gaussian-seed based approximation, having slightly better approximation accuracy and smaller variance. Gaussian process regression examples also substantiate the effectiveness of such a uniform-seed based log-det approximation scheme.
Original language | English |
---|---|
Pages (from-to) | 198-214 |
Number of pages | 17 |
Journal | Journal of Computational and Applied Mathematics |
Volume | 220 |
Issue number | 1-2 |
DOIs | |
Publication status | Published - 15 Oct 2008 |
Keywords
- Gaussian random seeds
- uniformly distributed seeds
- randomized trace estimator
- log-det approximation
- O(N2) operations