Single image deraining using contrastive perceptual regularization

Rain streaks pollute the image captured from outdoor vision system, and single image deraining approach based on data‐driven has witnessed the continuously growing and achieved great success. Here, an end‐to‐end network for single image deraining is proposed. Firstly, to address the limit of convolu...

Full description

Saved in:
Bibliographic Details
Published in:IET image processing 2022-08, Vol.16 (10), p.2759-2768
Main Author: Hu, Bin
Format: Article
Language:eng
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Rain streaks pollute the image captured from outdoor vision system, and single image deraining approach based on data‐driven has witnessed the continuously growing and achieved great success. Here, an end‐to‐end network for single image deraining is proposed. Firstly, to address the limit of convolution neural network (CNN) which can only extract local feature, a graph based basic block is proposed to extract global feature. The basic block consists of graph convolutional network (GCN) and CNN. The GCN module which combines spatial coherence computing and channel correlation computing is introduced to extract non‐local information. While the CNN module, which combines the channel attention and pixel attention, is used to earn more weight from important local features. Secondly, a contrastive perceptual regularization is adopted to enhance the loss function, and a more natural image is restored by utilizing the information from both positive and negative samples with the regularization. The restored image is pulled closer to the positive clear image and pushed farther away to the negative rainy image. The experiment results on several datasets demonstrate that these methods achieve better results than the previous state‐of‐art methods.
ISSN:1751-9659
1751-9667