The Invertible Rescaling Net (IRN) is modeling image downscaling and upscaling as a unified task to alleviate the ill-posed problem in the super-resolution task. However, the ability of potential variables of the model embedded high-frequency information is general, which affects the performance of the reconstructed image. In order to improve the ability of embedding high-frequency information and further reduce the complexity of the model, the potential variables and feature extraction of key components of IRN are improved. Attention mechanism and dilated convolution are used to improve the feature extraction block, reduce the parameters of feature extraction block, and allocate more attention to the image details. The high frequency sub-band interpolation method of wavelet domain is used to improve the potential variables, process and save the image edge, and enhance the ability of embedding high frequency information. Experimental results show that compared with IRN model, improved model has less complexity and excellent performance.