AffectSRNet : Facial Emotion-Aware Super-Resolution Network

Akae N, Makihara Y, Yagi Y. Gait recognition using periodic temporal super resolution for low frame-rate videos. In: In the proceedings of 2011 international joint conference on biometrics (IJCB); 2011. pp 1–7. IEEE.

Anwar S, Khan S, Barnes N. A deep journey into super-resolution: A survey. ACM Comput Surv (CSUR). 2020;53(3):1–34.

Article  Google Scholar 

Bulat A, Tzimiropoulos G. Super-fan: Integrated facial landmark localization and super-resolution of real-world low resolution faces in arbitrary poses with gans. In In the Proceedings of IEEE Conference on Computer Vision and Pattern Recognition; 2018. pp 109–117.

Bulat A, Yang J, Tzimiropoulos G. To learn image super-resolution, use a gan to learn how to do image degradation first. In: In the Proceedings of European Conference on Computer Vision (ECCV); 2018. pp 185–200.

Caballero J, Ledig C, Aitken A, Diaz AAA, Theis L, Huszar F, Totz J, Wang Z, Shi W. Real-time video super-resolution with spatio-temporal networks and motion compensation; 2020. US Patent 10,701,394.

Chen C, Gong D, Wang H, Li Z, Wong KYK. Learning spatial attention for face super-resolution. IEEE Trans Image Process. 2021:30.

Chen Y, Tai Y, Liu X, Shen C, Yang J. Fsrnet: End-to-end learning face super-resolution with facial priors. In In the proceedings of IEEE conference on computer vision and pattern recognition; 2018. pp 2492–2501.

Chen Y, Xia R, Yang K, Zou K. Mffn: image super-resolution via multi-level features fusion network. Vis Comput. 2024;40(2):489–504.

Article  Google Scholar 

Chudasama V, Nighania K, Upla K, Raja K, Ramachandra R, Busch C. E-comsupresnet: Enhanced face super-resolution through compact network. IEEE Trans Biometrics Behav Identity Sci. 2021;3(2):166–79.

Article  Google Scholar 

Dai T, Cai J, Zhang Y, Xia S-T, Zhang L. Second-order attention network for single image super-resolution. In: In the proceedings of IEEE/CVF conference on computer vision and pattern recognition; 2019. pp 11065–11074.

Dong C, Loy CC, He K, Tang X. Image super-resolution using deep convolutional networks; 2015.

Dong C, Loy CC, Tang X. Accelerating the super-resolution convolutional neural network. In: In the proceedings of computer vision–eccv 2016: 14th European Conference, Amsterdam, the Netherlands, October 11-14, 2016, Proceedings, Part II 14; 2016. pp 391–407. Springer.

Dou H, Chen C, Hu X, Xuan Z, Hu Z, Peng S. Pca-srgan: Incremental orthogonal projection discrimination for face super-resolution. In: In the Proceedings of 28th ACM international conference on multimedia; 2020. pp 1891–1899.

Fan Y, Lin Z. G2rl: Geometry-guided representation learning for facial action unit intensity estimation. In: Bessiere C, editor, In the Proceedings of Twenty-ninth international joint conference on artificial intelligence, IJCAI-20; 2020. pp 731–737. International Joint Conferences on Artificial Intelligence Organization. Main track.

Greenspan H. Super-resolution in medical imaging. Comput J. 2009;52(1):43–63.

Article  Google Scholar 

Grgic M, Delac K, Grgic S. Scface – surveillance cameras face database. Multimedia Tools Appl. 2011;51(3):863–79.

Article  Google Scholar 

Han W, Chang S, Liu D, Yu M, Witbrock M, Huang TS. Image super-resolution via dual-state recurrent networks. In: In the Proceedings of IEEE conference on computer vision and pattern recognition; 2018. pp. 1654–1663.

Haris M, Shakhnarovich G, Ukita N. Deep back-projection networks for super-resolution. In: In the Proceedings of IEEE conference on computer vision and pattern recognition; 2018. pp 1664–1673.

Haris M, Shakhnarovich G, Ukita N. Recurrent back-projection network for video super-resolution. In: In the proceedings of IEEE/CVF conference on computer vision and pattern recognition; 2019. pp. 3897–3906.

He J, Shi W, Chen K, Fu L, Dong C. Gcfsr: a generative and controllable face super resolution method without facial and gan priors. In: In the Proceedings of IEEE/CVF conference on computer vision and pattern recognition; 2022. pp 1889–1898.

Hong C, Yu J, Tao D, Wang M. Image-based three-dimensional human pose recovery by multiview locality-sensitive sparse retrieval. IEEE Trans Industr Electron. 2014;62(6):3742–51.

Google Scholar 

Hong C, Yu J, Wan J, Tao D, Wang M. Multimodal deep autoencoder for human pose recovery. IEEE Trans Image Process. 2015;24(12):5659–70.

Article  MathSciNet  Google Scholar 

Huang H, He R, Sun Z, Tan T. Wavelet-srnet: A wavelet-based cnn for multi-scale face super resolution. In: In the proceedings of IEEE international conference on computer vision; 2017. pp 1689–1697.

S.-R. Imaging. by p. milanfar; 2010.

Irani M, Peleg S. Improving resolution by image registration. CVGIP: Graph Models Image Process. 1991;53(3):231–9.

Google Scholar 

Isaac JS, Kulkarni R. Super resolution techniques for medical image processing. In: In the proceedings of 2015 international conference on technologies for sustainable development (ICTSD); 2015. pp 1–6. IEEE.

Jiang J, Wang C, Liu X, Ma J. Deep learning-based face super-resolution: A survey. ACM Comput Surv (CSUR). 2021;55(1):1–36.

Article  Google Scholar 

Jiang K, Wang Z, Yi P, Lu T, Jiang J, Xiong Z. Dual-path deep fusion network for face image hallucination. IEEE Trans Neural Netw Learn Syst. 2020;33(1):378–91.

Article  Google Scholar 

Kalarot R, Li T, Porikli F. Component attention guided face super-resolution network: Cagface. In: In the Proceedings of IEEE/CVF winter conference on applications of computer vision; 2020. pp 370–380.

Karras T Laine, S, Aila T. A style-based generator architecture for generative adversarial networks. In: In the Proceedings of IEEE/CVF conference on computer vision and pattern recognition; 2019. pp 4401–4410.

Kartynnik Y, Ablavatski A, Grishchenko I, Grundmann M. Real-time facial surface geometry from monocular video on mobile gpus. In: In the Proceedings of CVPR workshop on computer vision for augmented and virtual reality 2019; 2019. Long Beach, CA.

Kim J, Lee JK, Lee KM. Accurate image super-resolution using very deep convolutional networks. In: In the Proceedings of IEEE conference on computer vision and pattern recognition; 2016. pp 1646–1654.

Kim J, Lee JK, Lee KM. Deeply-recursive convolutional network for image super-resolution. In: In the Proceedings of IEEE conference on computer vision and pattern recognition; 2016. pp 1637–1645.

Kim J, Li G, Yun I, Jung C, Kim J. Edge and identity preserving network for face super-resolution. Neurocomputing. 2021;446:11–22.

Article  Google Scholar 

Ko S, Dai B-R. Multi-laplacian gan with edge enhancement for face super resolution. In: In the Proceedings of 2020 25th international conference on pattern recognition (ICPR); 2021. pp 3505–3512. IEEE.

Lai W-S, Huang J-B, Ahuja N, Yang M-H. Deep laplacian pyramid networks for fast and accurate super-resolution. In: In the Proceedings of IEEE conferene on computer vision and pattern recognition; 2017.

Lai W-S, Huang J-B, Ahuja N, Yang M-H. Fast and accurate image super-resolution with deep laplacian pyramid networks. IEEE Trans Pattern Anal Mach Intell. 2018;41(11):2599–613.

Article  Google Scholar 

Lau CP, Castillo CD, Chellappa R. Atfacegan: Single face semantic aware image restoration and recognition from atmospheric turbulence. IEEE Trans Biometr Behav Identity Sci. 2021;3(2):240–51.

Article  Google Scholar 

Le V, Brandt, J, Lin Z, Bourdev L, Huang T. Interactive facial feature localization. In: In the proceedings of computer vision, ECCV 2012 - 12th European conference on computer vision, proceedings, number PART 3 in Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); 2012. pp 679–692. 12th European Conference on Computer Vision, ECCV 2012 ; Conference date: 07-10-2012 Through 13-10-2012.

Ledig C, Theis L, Huszár F, Caballero J, Cunningham A, Acosta A, Aitken A, Tejani A, Totz J, Wang Z, et al. Photo-realistic single image super-resolution using a generative adversarial network. In: In the Proceedings of IEEE conference on computer vision and pattern recognition; 2017. pp 4681–4690.

Li F, Feng X, Chen F, Lu G, Pei W. Learning generalizable latent representations for novel degradations in super-resolution. In: In the Proceedings of 30th ACM international conference on multimedia; 2022 pp 1797–1807.

Li J, Feng J, Kuo C-CJ. Deep convolutional neural network for latent fingerprint enhancement. Signal Process Image Commun. 2018;60:52–63.

Article  Google Scholar 

Li K, Bare B, Yan B, Feng B, Yao C. Face hallucination based on key parts enhancement. In: In the Proceedings of 2018 IEEE international conference on acoustics, speech and signal processing (ICASSP); 2018. pp 1378–1382. IEEE.

Li K, Zhu Y, Yang J, Jiang J. Video super-resolution using an adaptive superpixel-guided auto-regressive model. Pattern Recogn. 2016;51:59–71.

Article  Google Scholar 

Li X, Wu Y, Zhang W, Wang R, Hou F. Deep learning methods in real-time image super-resolution: a survey. J Real-Time Image Proc. 2020;17(6):1885–909.

Article  Google Scholar 

Li Z, Yang J, Liu Z, Yang X, Jeon G, Wu W. Feedback network for image super-resolution. In In the Proceedings of IEEE/CVF conference on computer vision and pattern recognition; 2019. pp 3867–3876.

Lillesand T, Kiefer RW, Chipman J. Remote sensing and image interpretation. John Wiley & Sons, 2015.

Lim B, Son S, Kim H, Nah S, Lee KM. Enhanced deep residual networks for single image super-resolution, 2017.

Liu S, Xiong C, Gao Z. Face super-resolution network with incremental enhancement of facial parsing information. In: In the proceedings of 2020 25th international conference on pattern recognition (ICPR); 2021. pp 7537–7543. IEEE.

Liu Z, Luo P, Wang X, Tang X. Deep learning face attributes in the wild. In: In the proceedings of international conference on computer vision (ICCV); 2015.

Lobanov AP. Resolution limits in astronomical images. arXiv:astro-ph/0503225, 2005.

Lu T, Wang Y, Zhang Y, Wang Y, Wei L, Wang Z, Jiang J. Face hallucination via split-attention in split-attention network. In: In the proceedings of 29th ACM international conference on multimedia; 2021. pp 5501–5509.

Luo C, Song S, Xie W, Shen L, Gunes H. Learning multi-dimensional edge feature-based au relation graph for facial action unit recognition. In: In the Proceedings of IJCAI international joint conference on artificial intelligence; 2022.

Ma C, Jiang Z, Rao Y, Lu J, Zhou J. Deep face super-resolution with iterative collaboration between attentive recovery and landmark estimation. In: In the proceedings of IEEE computer society conference on computer vision and pattern recognition; 2020.

Michaeli T, Irani M. Nonparametric blind super-resolution. In In the Proceedings of IEEE international conference on computer vision; 2013. pp 945–952.

Nasrollahi K, Escalera S, Rasti P, Anbarjafari G, Baro X, Escalante HJ, Moeslund TB. Deep learning based super-resolution for improved action recognition. In: In the Proceedings of 2015 international conference on image processing theory, tools and applications (IPTA); 2015. pp 67–72. IEEE.

Ngoc QT, Lee S, Song BC. Facial landmark-based emotion recognition via directed graph neural network. Electronics (Switzerland). 2020:9.

Paszke A, Gross S, Massa F, Lerer A, Bradbury J, Chanan G, et al. Pytorch: An imperative style, high-performance deep learning library. Adv Neural Inf Process Syst. 2019;32:8026–37.

Google Scholar 

Rasti P, Uiboupin T, Escalera S, Anbarjafari G. Convolutional neural network super resolution for face recognition in surveillance monitoring. In: In the proceedings of international conference on articulated motion and deformable objects; 2016. pp 175–184. Springer.

Ryoo MS, Rothrock B, Fleming C, Yang HJ. Privacy-preserving human activity recognition from extreme low resolution. In In the proceedings of thirty-first AAAI conference on artificial intelligence; 2017.

Shi W Caballero, J, Huszár F, Totz J, Aitken AP, Bishop R, Rueckert D, Wang Z. Real-time single image and video super-resolution using an efficient sub-pixel convolutional neural network. In: In the proceedings of IEEE conference on computer vision and pattern recognition; 2016. pp 1874–1883.

Shocher A, Cohen N, Irani M. “zero-shot” super-resolution using deep internal learning. In: In the proceedings of IEEE conference on computer vision and pattern recognition; 2018. pp 3118–3126.

Singh K, Gupta A, Kapoor R. Fingerprint image super-resolution via ridge orientation-based clustered coupled sparse dictionaries. J Electron Imaging. 2015;24(4):043015.

Article  Google Scholar 

Su L, Hu C, Li G, Cao D. Msaf: Multimodal split attention fusion; 2020.

Sun B, Zhang Y, Jiang S, and Y. Fu. Hybrid pixel-unshuffled network for lightweight image super-resolution. In: In the Proceedings of Thirty-seventh AAAI conference on artificial intelligence and thirty-fifth conference on innovative applications of artificial intelligence and thirteenth symposium on educational advances in artificial intelligence; 2023. AAAI’23/IAAI’23/EAAI’23. AAAI Press.

Swaminathan A, Wu M, Liu KR. Digital image forensics via intrinsic fingerprints. IEEE Trans Inf Forensics Secur. 2008;3(1):101–17.

Article  Google Scholar 

Tai Y, Yang J, Liu X. Image super-resolution via deep recursive residual network. In: In the proceedings of IEEE conference on computer vision and pattern recognition; 2017 pp 3147–3155.

Tai Y, Yang J, Liu X, Xu C. Memnet: A persistent memory network for image restoration. In: In the Proceedings of IEEE international conference on computer vision; 2017. pp 4539–4547.

Timofte R, Rothe R, Van Gool L. Seven ways to improve example-based single image super resolution. In: In the Proceedings of IEEE conference on computer vision and pattern recognition; 2016. pp 1865–1873.

Tomar AS, Arya K, Rajput SS. Deep hyfeat based attention in attention model for face super-resolution. IEEE Trans Instrum Meas. 2023;72:1–11.

Article  Google Scholar 

Tong T, Li G, Liu X, Gao Q. Image super-resolution using dense skip connections. In: In the Proceedings of IEEE international conference on computer vision; 2017. pp 4799–4807.

Ulyanov D, Vedaldi A, Lempitsky V. Improved texture networks: Maximizing quality and diversity in feed-forward stylization and texture synthesis; 2017.

Ulyanov D, Vedaldi A, Lempitsky V. Instance normalization: The missing ingredient for fast stylization; 2017.

Wang C, Jiang J, Liu X. Heatmap-aware pyramid face hallucination. In: In the Proceedings of 2021 IEEE international conference on multimedia and expo (ICME); 2021. pp 1–6. IEEE.

Wang C, Jiang J, Zhong Z, Zhai D, Liu X. Super-resolving face image by facial parsing information. IEEE Trans Biomet Behav Identity Sci. 2023;5(4):435–48.

Article  Google Scholar 

Wang H, Hu Q, Wu C, Chi J, Yu X, Wu H. Dclnet: Dual closed-loop networks for face super-resolution. Knowl-Based Syst. 2021;222:106987.

Article  Google Scholar 

Wang X, Yu K, Wu S, Gu J, Liu Y, Dong C, Qiao Y, Change Loy C. Esrgan: Enhanced super-resolution generative adversarial networks. In: In the proceedings of European conference on computer vision (ECCV) Workshops; 2018.

Wang Y, Perazzi F, McWilliams B, Sorkine-Hornung A, Sorkine-Hornung O, Schroers C. A fully progressive approach to single-image super-resolution. In: In the proceedings of IEEE conference on computer vision and pattern recognition workshops; 2018. pp 864–873.

Wang Z, Bovik AC. A universal image quality index. IEEE Signal Process Lett. 2002;9:81–4.

Article  Google Scholar 

Wang Z, Chen J, Hoi SC. Deep learning for image super-resolution: A survey. IEEE Trans Pattern Anal Mach Intell. 2020;43(10):3365–87.

Article  Google Scholar 

Wu Y, Ji Q. Constrained joint cascade regression framework for simultaneous facial action unit recognition and facial landmark detection. In: In the Proceedings of IEEE computer society conference on computer vision and pattern recognition; 2016. vol. 2016.

Yang L, Wang S, Ma S, Gao W, Liu C, Wang P, Ren P. Hifacegan: Face renovation via collaborative suppression and replenishment. In: In the proceedings of 28th ACM international conference on multimedia; 2020. pp 1551–1560.

Yin Y, Robinson J, Zhang Y, Fu Y. Joint super-resolution and alignment of tiny faces. Proc AAAI Conf Artif Intell. 2020;34(07):12693–700.

Google Scholar 

Yu X, Porikli F. Ultra-resolving face images by discriminative generative networks. In: In the proceedings of European conference on computer vision; 2016. pp 318–333. Springer.

Yuan Y, Liu S, Zhang J, Zhang Y, Dong C, Lin L. Unsupervised image super-resolution using cycle-in-cycle generative adversarial networks. In: 2018 IEEE/CVF conference on computer vision and pattern recognition workshops (CVPRW); 2018. pp 814–81409.

Zhang H, Yang Z, Zhang L, Shen H. Super-resolution reconstruction for multi-angle remote sensing images considering resolution differences. Remote Sens. 2014;6(1):637–57.

Article  Google Scholar 

Zhang H, Zhang L, Shen H. A super-resolution reconstruction algorithm for hyperspectral images. Signal Process. 2012;92(9):2082–96.

Article  Google Scholar 

Zhang J, Pu J, Chen C, Fleischer R. Low-resolution gait recognition. IEEE Trans Syst Man Cybernet Part B (Cybernetics). 2010;40(4):986–96.

Article  Google Scholar 

Zhang L, Zhang H, Shen H, Li P. A super-resolution reconstruction algorithm for surveillance images. Signal Process. 2010;90(3):848–59.

Article  Google Scholar 

Zhang M, Ling Q. Supervised pixel-wise gan for face super-resolution. IEEE Trans Multimed. 2020;23:1938–50.

Article  Google Scholar 

Zhang R, Isola P, Efros AA, Shechtman E, Wang O. The unreasonable effectiveness of deep features as a perceptual metric. In: In the Proceedings of 2018 IEEE/CVF conference on computer vision and pattern recognition (CVPR); 2018. pp 586–595, Los Alamitos, CA, USA. IEEE Computer Society.

Zhang S, Zhang Y, Zhang Y, Wang Y, Song Z. A dual-direction attention mixed feature network for facial expression recognition. Electronics. 2023;12(17):3595.

Article 

Comments (0)

No login
gif