TY - JOUR
T1 - S-LWSR
T2 - Super Lightweight Super-Resolution Network
AU - Li, Biao
AU - Wang, Bo
AU - Liu, Jiabin
AU - Qi, Zhiquan
AU - Shi, Yong
N1 - Publisher Copyright:
© 1992-2012 IEEE.
PY - 2020
Y1 - 2020
N2 - In recent years, deep models have achieved great success in the field of single-image super-resolution (SISR) by incorporating a large number of parameters to obtain satisfactory performance. However, this achievement typically gives rise to high computational complexity, which greatly restricts deep SISR applications in deployment on mobile devices with limited computation and storage resources. To address this problem, in this article, we propose a flexibly adjustable super-lightweight SISR pipeline: s-LWSR. First, to efficiently abstract features from low-resolution images, we design a highly efficient U-shaped backbone, along with an information pool, which is constructed to mix multilevel information from the first half of our pipeline. Second, a compression mechanism based on depthwise-separable convolution is employed to further reduce the number of parameters with a negligible degradation in performance. Third, by revealing the specific role of activation in many deep models, we remove several activation layers in our super-resolution (SR) model to retain useful information, leading to a further improvement in the final performance. Extensive experiments demonstrate that our s-LWSR, with limited parameters and operations, can achieve a similar performance to that of other cumbersome but state-of-the-art (SOTA) deep SR methods.
AB - In recent years, deep models have achieved great success in the field of single-image super-resolution (SISR) by incorporating a large number of parameters to obtain satisfactory performance. However, this achievement typically gives rise to high computational complexity, which greatly restricts deep SISR applications in deployment on mobile devices with limited computation and storage resources. To address this problem, in this article, we propose a flexibly adjustable super-lightweight SISR pipeline: s-LWSR. First, to efficiently abstract features from low-resolution images, we design a highly efficient U-shaped backbone, along with an information pool, which is constructed to mix multilevel information from the first half of our pipeline. Second, a compression mechanism based on depthwise-separable convolution is employed to further reduce the number of parameters with a negligible degradation in performance. Third, by revealing the specific role of activation in many deep models, we remove several activation layers in our super-resolution (SR) model to retain useful information, leading to a further improvement in the final performance. Extensive experiments demonstrate that our s-LWSR, with limited parameters and operations, can achieve a similar performance to that of other cumbersome but state-of-the-art (SOTA) deep SR methods.
KW - Super-resolution
KW - activation operation removal
KW - lightweight model
KW - model compression
KW - multilevel information
UR - http://www.scopus.com/inward/record.url?scp=85090131776&partnerID=8YFLogxK
U2 - 10.1109/TIP.2020.3014953
DO - 10.1109/TIP.2020.3014953
M3 - Article
AN - SCOPUS:85090131776
SN - 1057-7149
VL - 29
SP - 8368
EP - 8380
JO - IEEE Transactions on Image Processing
JF - IEEE Transactions on Image Processing
M1 - 9166725
ER -