TY - JOUR
T1 - Dense Residual Generative Adversarial Network for Rapid Rain Removal
AU - Mi, Ying
AU - Yuan, Shihua
AU - Li, Xueyuan
AU - Zhou, Junjie
N1 - Publisher Copyright:
© 2013 IEEE.
PY - 2021
Y1 - 2021
N2 - Single-image rain removal always was one of the difficulties in the environment perception task. Usually, it has two paths to solve this problem: data-driven solutions and model-based solutions. Due to the benefits of convenient, learning features automatically and rapidly, data driven solutions has attracted tremendous interests. However, the time consumed per frame is still hard to match the requirement of high real-time performance, especially for high speed unmanned platform. In this article, we propose a fast dense residual generative adversarial network (FDRN), which can remove rain and reduce computation time consumption, the de-raining time of each frame only consumes 0.02s. We enhanced the data of original rainy images, put it into the generator network which is composed of long short-term memory networks (LSTM) and a newly designed dense residual network (DRN). The feature map in generator and discriminator is extracted to calculate the loss function and guide the direction of training. We selected 1500 pairs of synthetic images from existed datasets to train our network. And in order to test our method's de-raining ability realistically, we also selected 147 real-world rainy images from existed datasets. Experiments on both synthetic and real-world rainy images demonstrate that the proposed method can achieve competitive results to some existing methods in performance and effectiveness.
AB - Single-image rain removal always was one of the difficulties in the environment perception task. Usually, it has two paths to solve this problem: data-driven solutions and model-based solutions. Due to the benefits of convenient, learning features automatically and rapidly, data driven solutions has attracted tremendous interests. However, the time consumed per frame is still hard to match the requirement of high real-time performance, especially for high speed unmanned platform. In this article, we propose a fast dense residual generative adversarial network (FDRN), which can remove rain and reduce computation time consumption, the de-raining time of each frame only consumes 0.02s. We enhanced the data of original rainy images, put it into the generator network which is composed of long short-term memory networks (LSTM) and a newly designed dense residual network (DRN). The feature map in generator and discriminator is extracted to calculate the loss function and guide the direction of training. We selected 1500 pairs of synthetic images from existed datasets to train our network. And in order to test our method's de-raining ability realistically, we also selected 147 real-world rainy images from existed datasets. Experiments on both synthetic and real-world rainy images demonstrate that the proposed method can achieve competitive results to some existing methods in performance and effectiveness.
KW - FDRN
KW - Rain removal
KW - dense residual network
KW - time consuming
UR - http://www.scopus.com/inward/record.url?scp=85100499536&partnerID=8YFLogxK
U2 - 10.1109/ACCESS.2021.3055527
DO - 10.1109/ACCESS.2021.3055527
M3 - Article
AN - SCOPUS:85100499536
SN - 2169-3536
VL - 9
SP - 24848
EP - 24858
JO - IEEE Access
JF - IEEE Access
M1 - 9340238
ER -