A principal component neural network with minimum error entropy for dimension reduction of non-Gaussian systems

Zhenhua Guo, Hong Yue, Hong Wang

Research output: Contribution to journalArticle

Abstract

Based on the minimum mean square error of principal component analysis and principal component neural network is an effective dimensionality reduction of multivariate statistical techniques, they extract the main element contains the system maximum variance approximation model non-Gaussian stochastic systems should contain maximum entropy system, but contains the maximum variance does not necessarily contain the maximum entropy. This paper presents a minimal residual entropy for the general index nonlinear principal component neural network model, and gives an approximate calculation method based on Parzen window density function estimation of entropy and network learning algorithm then analyzed from the perspective of information theory, the Gaussian random system based on minimum residual entropy and minimum mean square as an indicator of the primary element network learning outcomes consistent. Finally, simulation effectiveness of the method, and with comparative analysis based on minimum mean square error calculation principal component analysis and principal component neural network method.
Translated title of the contributionA principal component neural network with minimum error entropy for dimension reduction of non-Gaussian systems
LanguageChinese
Pages91-94
Number of pages4
JournalComputer Simulation
Volume22
Issue number11
DOIs
Publication statusPublished - 29 Dec 2005

Fingerprint

Entropy
Neural networks
Mean square error
Principal component analysis
Stochastic systems
Information theory
Probability density function
Learning algorithms

Keywords

  • PCA neural networks
  • minimum residual entropy
  • minimum mean squared error

Cite this

Guo, Zhenhua ; Yue, Hong ; Wang, Hong. / 用于非高斯系统降维的最小残差熵主元网络. In: Computer Simulation. 2005 ; Vol. 22, No. 11. pp. 91-94.
@article{94e83c3b1e614ddcae28441b6b95caa2,
title = "用于非高斯系统降维的最小残差熵主元网络",
abstract = "Based on the minimum mean square error of principal component analysis and principal component neural network is an effective dimensionality reduction of multivariate statistical techniques, they extract the main element contains the system maximum variance approximation model non-Gaussian stochastic systems should contain maximum entropy system, but contains the maximum variance does not necessarily contain the maximum entropy. This paper presents a minimal residual entropy for the general index nonlinear principal component neural network model, and gives an approximate calculation method based on Parzen window density function estimation of entropy and network learning algorithm then analyzed from the perspective of information theory, the Gaussian random system based on minimum residual entropy and minimum mean square as an indicator of the primary element network learning outcomes consistent. Finally, simulation effectiveness of the method, and with comparative analysis based on minimum mean square error calculation principal component analysis and principal component neural network method.",
keywords = "PCA neural networks, minimum residual entropy, minimum mean squared error",
author = "Zhenhua Guo and Hong Yue and Hong Wang",
year = "2005",
month = "12",
day = "29",
doi = "10.3969/j.issn.1006-9348.2005.11.026",
language = "Chinese",
volume = "22",
pages = "91--94",
journal = "Computer Simulation",
issn = "1006-9348",
number = "11",

}

用于非高斯系统降维的最小残差熵主元网络. / Guo, Zhenhua; Yue, Hong; Wang, Hong.

In: Computer Simulation, Vol. 22, No. 11, 29.12.2005, p. 91-94.

Research output: Contribution to journalArticle

TY - JOUR

T1 - 用于非高斯系统降维的最小残差熵主元网络

AU - Guo, Zhenhua

AU - Yue, Hong

AU - Wang, Hong

PY - 2005/12/29

Y1 - 2005/12/29

N2 - Based on the minimum mean square error of principal component analysis and principal component neural network is an effective dimensionality reduction of multivariate statistical techniques, they extract the main element contains the system maximum variance approximation model non-Gaussian stochastic systems should contain maximum entropy system, but contains the maximum variance does not necessarily contain the maximum entropy. This paper presents a minimal residual entropy for the general index nonlinear principal component neural network model, and gives an approximate calculation method based on Parzen window density function estimation of entropy and network learning algorithm then analyzed from the perspective of information theory, the Gaussian random system based on minimum residual entropy and minimum mean square as an indicator of the primary element network learning outcomes consistent. Finally, simulation effectiveness of the method, and with comparative analysis based on minimum mean square error calculation principal component analysis and principal component neural network method.

AB - Based on the minimum mean square error of principal component analysis and principal component neural network is an effective dimensionality reduction of multivariate statistical techniques, they extract the main element contains the system maximum variance approximation model non-Gaussian stochastic systems should contain maximum entropy system, but contains the maximum variance does not necessarily contain the maximum entropy. This paper presents a minimal residual entropy for the general index nonlinear principal component neural network model, and gives an approximate calculation method based on Parzen window density function estimation of entropy and network learning algorithm then analyzed from the perspective of information theory, the Gaussian random system based on minimum residual entropy and minimum mean square as an indicator of the primary element network learning outcomes consistent. Finally, simulation effectiveness of the method, and with comparative analysis based on minimum mean square error calculation principal component analysis and principal component neural network method.

KW - PCA neural networks

KW - minimum residual entropy

KW - minimum mean squared error

U2 - 10.3969/j.issn.1006-9348.2005.11.026

DO - 10.3969/j.issn.1006-9348.2005.11.026

M3 - Article

VL - 22

SP - 91

EP - 94

JO - Computer Simulation

T2 - Computer Simulation

JF - Computer Simulation

SN - 1006-9348

IS - 11

ER -