Improving feature extraction performance of greedy network-growing algorithm by inverse euclidean distance
We propose here a new computational method for the information-theoretic method, called the greedy network-growing algorithm , to facilitate a process of information acquisition. We have so far used the sigmoidal activation function for competitive unit outputs. The method can effectively suppress many competitive units by generating strongly negative connections. However, because methods with the sigmoidal activation function are not very sensitive to input patterns, we have observed that in some cases final representations obtained by the method do not necessarily faithfully describe input patterns. To remedy this shortcoming, we employ the inverse of distance between input patterns and connection weights for competitive unit outputs. As the distance becomes smaller, competitive units are more strongly activated. Thus, winning units tend to represent input patterns more faithfully than in the previous method with the sigmoidal activation function. We applied the new method to artificial data analysis and animal classification. Experimental results confirmed that more information can be acquired and more explicit features can be extracted by our new method.
Keywords: Euclidean distance; competitive leaning; greedy; information maximization; network-growing
Document Type: Research Article
Affiliations: Information Science Laboratory Tokai University 1117 Kitakaname Hiratsuka Kanagawa 259-1292 Japan, Email: [email protected]
Publication date: 01 June 2004
- Editorial Board
- Information for Authors
- Subscribe to this Title
- Ingenta Connect is not responsible for the content or availability of external websites
- Access Key
- Free content
- Partial Free content
- New content
- Open access content
- Partial Open access content
- Subscribed content
- Partial Subscribed content
- Free trial content