Wavelet J-Net: A Frequency Perspective on Convolutional Neural Networks

Linfeng Zhang Institute for Interdisciplinary Information Science, Tsinghua University Xiaoman Zhang Institute for Interdisciplinary Information Core Technology Chenglong Bao YAU Mathematical Sciences Center, Tsinghua University Kaisheng Ma Institute for Interdisciplinary Information Science, Tsinghua University

TBD mathscidoc:2206.43014

IJCNN, 2021.7
It is well acknowledged in image processing domain that the information can be decomposed into different frequency parts and each part has its own merits. However, existing neural networks always ignore the distinctions and straightforwardly feed all the information into neural networks together, treating them equally. In this paper, we propose a novel neural networks framework named J-Net that decomposes images into different frequency bands and then processes them sequentially. Concretely, the images have been decomposed by wavelet transformation and then the wavelet coefficients are fed into neural networks gradually in different depth according to their decomposition levels. An attention module is utilized to facilitate the fusion of neural network features and injected information, yielding significant performance gain. Furthermore, we show how does the information with different frequency impact the accuracy of neural networks. Experiments show that 5.91%, 5.32% and 2.00% accuracy improvements on Caltech 101, Caltech256 and ImageNet, respectively.
No keywords uploaded!
[ Download ] [ 2022-06-15 22:12:05 uploaded by Baocl ] [ 699 downloads ] [ 0 comments ]
@inproceedings{linfeng2021wavelet,
  title={Wavelet J-Net: A Frequency Perspective on Convolutional Neural Networks},
  author={Linfeng Zhang, Xiaoman Zhang, Chenglong Bao, and Kaisheng Ma},
  url={http://archive.ymsc.tsinghua.edu.cn/pacm_paperurl/20220615221206772451370},
  booktitle={IJCNN},
  year={2021},
}
Linfeng Zhang, Xiaoman Zhang, Chenglong Bao, and Kaisheng Ma. Wavelet J-Net: A Frequency Perspective on Convolutional Neural Networks. 2021. In IJCNN. http://archive.ymsc.tsinghua.edu.cn/pacm_paperurl/20220615221206772451370.
Please log in for comment!
 
 
Contact us: office-iccm@tsinghua.edu.cn | Copyright Reserved