REVIEW 6 cited by
HSIGene: A Foundation Model For Hyperspectral Image Generation
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
Hyperspectral image (HSI) plays a vital role in various fields such as agriculture and environmental monitoring. However, due to the expensive acquisition cost, the number of hyperspectral images is limited, degenerating the performance of downstream tasks. Although some recent studies have attempted to employ diffusion models to synthesize HSIs, they still struggle with the scarcity of HSIs, affecting the reliability and diversity of the generated images. Some studies propose to incorporate multi-modal data to enhance spatial diversity, but the spectral fidelity cannot be ensured. In addition, existing HSI synthesis models are typically uncontrollable or only support single-condition control, limiting their ability to generate accurate and reliable HSIs. To alleviate these issues, we propose HSIGene, a novel HSI generation foundation model which is based on latent diffusion and supports multi-condition control, allowing for more precise and reliable HSI generation. To enhance the spatial diversity of the training data while preserving spectral fidelity, we propose a new data augmentation method based on spatial super-resolution, in which HSIs are upscaled first, and thus abundant training patches could be obtained by cropping the high-resolution HSIs. In addition, to improve the perceptual quality of the augmented data, we introduce a novel two-stage HSI super-resolution framework, which first applies RGB bands super-resolution and then utilizes our proposed Rectangular Guided Attention Network (RGAN) for guided HSI super-resolution. Experiments demonstrate that the proposed model is capable of generating a vast quantity of realistic HSIs for downstream tasks such as denoising and super-resolution. The code and models are available at https://github.com/LiPang/HSIGene.
Forward citations
Cited by 6 Pith papers
-
Annotation-Free Open-Vocabulary Segmentation for Remote-Sensing Images
SegEarth-OV performs annotation-free open-vocabulary segmentation of remote-sensing images by upsampling CLIP features, removing global bias, and distilling optical knowledge into a SAR encoder.
-
Quantitative Comparison of Fine-Tuning Techniques for Pretrained Latent Diffusion Models in the Generation of Unseen SAR Images
A systematic comparison of fine-tuning strategies for Stable Diffusion XL on 100k real SAR images finds that full UNet fine-tuning with LoRA text encoders and a learned <SAR> token gives the best generation quality.
-
EarthMapper: Visual Autoregressive Models for Controllable Bidirectional Satellite-Map Translation
EarthMapper uses geo-conditioned joint scale autoregression with key-point guidance to set a new state of the art on bidirectional satellite-map translation, supported by a new 302k-pair Chinese city dataset.
-
Hyperspectral Image Generation with Unmixing Guided Diffusion Model
HUD generates hyperspectral images by running a diffusion process on unmixed abundance maps, then decoding with the endmember matrix, achieving high point fidelity but only average block diversity in the paper's own e...
-
AeroGen: Enhancing Remote Sensing Object Detection with Diffusion-Driven Data Generation
A layout-controlled diffusion model generates synthetic remote sensing images with horizontal or rotated boxes, and using these images as extra training data improves object detection mAP on three standard datasets.
-
Vision-Language Modeling Meets Remote Sensing: Models, Datasets and Perspectives
A structured review of remote sensing vision-language models, organizing contrastive, instruction-tuned, and generative approaches alongside their datasets and benchmarks.
Discussion (0). Continue with ORCID to comment.