qichaoliu / HSI_SSFTT

L. Sun, G. Zhao, Y. Zheng, and Z. Wu, "Spectral–Spatial Feature Tokenization Transformer for Hyperspectral Image Classification," IEEE TGRS, 2022.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

PyTorch Demo of the Hyperspectral Image Classification method - SSFTT.

Using the code should cite the following paper:

L. Sun, G. Zhao, Y. Zheng and Z. Wu, "Spectral–Spatial Feature Tokenization Transformer for Hyperspectral Image Classification," in IEEE Transactions on Geoscience and Remote Sensing, vol. 60, pp. 1-14, 2022, Art no. 5522214, DOI:10.1109/TGRS.2022.3144158.

@ARTICLE{9684381,
author={Sun, Le and Zhao, Guangrui and Zheng, Yuhui and Wu, Zebin},
journal={IEEE Transactions on Geoscience and Remote Sensing},
title={Spectral–Spatial Feature Tokenization Transformer for Hyperspectral Image Classification},
year={2022}, volume={60},
number={},
pages={1-14},
doi={10.1109/TGRS.2022.3144158} }

Feel free to contact us if there is anything we can help. Thanks for your support!

cs_zhaogr@nuist.edu.cn

Description.

In hyperspectral image (HSI) classification, each pixel sample is assigned to a land-cover category. In the recent past, convolutional neural network (CNN)-based HSI classification methods have greatly improved performance due to their superior ability to represent features. However, these methods have limited ability to obtain deep semantic features, and as the layer’s number increases, computational costs rise significantly. The transformer framework can represent highlevel semantic features well. In this article, a spectral–spatial feature tokenization transformer (SSFTT) method is proposed to capture spectral–spatial features and high-level semantic features. First, a spectral–spatial feature extraction module is built to extract low-level features. This module is composed of a 3-D convolution layer and a 2-D convolution layer, which are used to extract the shallow spectral and spatial features. Second, a Gaussian weighted feature tokenizer is introduced for features transformation. Third, the transformed features are input into the transformer encoder module for feature representation and learning. Finally, a linear layer is used to identify the first learnable token to obtain the sample label. Using three standard datasets, experimental analysis confirms that the computation time is less than other deep learning methods and the performance of the classification outperforms several current state-of-the-art methods.

About

L. Sun, G. Zhao, Y. Zheng, and Z. Wu, "Spectral–Spatial Feature Tokenization Transformer for Hyperspectral Image Classification," IEEE TGRS, 2022.


Languages

Language:Python 100.0%