Title | Cascade wavelet transform based convolutional neural networks with application to image classification |
Authors | Sun, Jieqi Li, Yafeng Zhao, Qijun Guo, Ziyu Li, Ning Hai, Tao Zhang, Wenbo Chen, Dong |
Affiliation | Baoji Univ Arts & Sci, Sch Math & Informat Sci, Baoji 721013, Peoples R China Baoji Univ Arts & Sci, Sch Comp, Baoji 721016, Peoples R China Sichuan Univ, Coll Comp Sci, Chengdu 610065, Peoples R China Peking Univ, Sch Software & Microelect, Beijing 100871, Peoples R China |
Issue Date | 1-Dec-2022 |
Publisher | NEUROCOMPUTING |
Abstract | Pooling has been the core ingredient of modern convolutional neural networks (CNNs). Although classic pooling methods are simple and effective, it will inevitably lead to the problem that some features that make a great contribution to classification may be ignored. To solve this issue, this paper presents a novel cascade wavelet transform module, which makes full use of different frequency components and can be seamlessly integrated into the existing CNNs by replacing the existing pooling operation. In our method, wavelet transforms are performed in both spatial and channel domain. In spatial domain, using 2D dis-crete wavelet transform, we design a spatial pooling layer with attention mechanism by integrating low -frequency and high-frequency information. In channel domain, based on 1D discrete wavelet transform, a channel pooling layer with the attention mechanism is proposed for the final feature reconstruction. We call the proposed cascade wavelet transform based CNNs CasDWTNets. Compared to the traditional CNNs, experiments demonstrate that CasDWTNets obtain outstanding consistency and accuracy in image classification. Code will be made available.(c) 2022 Elsevier B.V. All rights reserved. |
URI | http://hdl.handle.net/20.500.11897/657351 |
ISSN | 0925-2312 |
DOI | 10.1016/j.neucom.2022.09.149 |
Indexed | SCI(E) |
Appears in Collections: | 软件与微电子学院 |