# Awesome Face Restoration & Enhancement | Massive Resources ⭐ **URL:** \ **Category:** Tools & Scripts\ **Tags:** tools\ **Created:** [October 16, 2024, 3:57am UTC](https://onehack.st/t/awesome-face-restoration-enhancement-massive-resources/293713 "2024-10-16T03:57:14Z")\ **Posts on this page:** 1\ **Page:** 1
**Author:** ![Aina](https://onehack.st/user_avatar/onehack.st/aina/32/167469_2.png) [@Aina](https://onehack.st/u/Aina)\ **Post date:** [October 16, 2024, 3:57am UTC](https://onehack.st/t/awesome-face-restoration-enhancement-massive-resources/293713/1 "2024-10-16T03:57:14Z")
# Awesome Face Restoration & Enhancement [![Awesome](https://camo.githubusercontent.com/8693bde04030b1670d5097703441005eba34240c32d1df1eb82a5f0d6716518e/68747470733a2f2f63646e2e7261776769742e636f6d2f73696e647265736f726875732f617765736f6d652f643733303566333864323966656437386661383536353265336136336531353464643865383832392f6d656469612f62616467652e737667)](https://github.com/sindresorhus/awesome) [![collection](https://camo.githubusercontent.com/c2bd17adbe4fcebc5de5909b1e0afae99def5cd9ea1bb90679f8e93a16711f0b/68747470733a2f2f696d672e736869656c64732e696f2f62616467652f436f6c6c656374696f6e2d4b6565702532305570646174696e672d677265656e)](https://camo.githubusercontent.com/c2bd17adbe4fcebc5de5909b1e0afae99def5cd9ea1bb90679f8e93a16711f0b/68747470733a2f2f696d672e736869656c64732e696f2f62616467652f436f6c6c656374696f6e2d4b6565702532305570646174696e672d677265656e) [![visitors](https://camo.githubusercontent.com/2e8ca9d93d5dbcf0cbf2bf279f19100babf3138c3472bf64834e5a0045ddd2e2/68747470733a2f2f6170692e696e66696e6974657363726970742e636f6d2f62616467656e2f636f756e743f6e616d653d73637a686f752f417765736f6d6546616365526573746f726174696f6e266c746578743d56697369746f727326636f6c6f723d333937376464)](https://camo.githubusercontent.com/2e8ca9d93d5dbcf0cbf2bf279f19100babf3138c3472bf64834e5a0045ddd2e2/68747470733a2f2f6170692e696e66696e6974657363726970742e636f6d2f62616467656e2f636f756e743f6e616d653d73637a686f752f417765736f6d6546616365526573746f726174696f6e266c746578743d56697369746f727326636f6c6f723d333937376464) A curated list of awesome face restoration & enhancement papers and resources 🐳, inspired by [awesome-NeRF](https://github.com/yenchenlin/awesome-NeRF). #### Welcome to add papers and other resources related to this topic [[submit a pull request]](https://github.com/sczhou/Awesome-Face-Restoration/blob/master/how-to-PR.md) 🤗 ## Table of Contents - [Papers](https://github.com/sczhou/Awesome-Face-Restoration#papers) - [Face Image Restoration](https://github.com/sczhou/Awesome-Face-Restoration#face-image-restoration) - [Face Video Restoration](https://github.com/sczhou/Awesome-Face-Restoration#face-video-restoration) - [Datasets](https://github.com/sczhou/Awesome-Face-Restoration#datasets) - [High-Res Face Dataset](https://github.com/sczhou/Awesome-Face-Restoration#high-resolution-face-dataset) - [Low-Res Face Dataset](https://github.com/sczhou/Awesome-Face-Restoration#low-resolution-face-dataset) - [Video Face Dataset](https://github.com/sczhou/Awesome-Face-Restoration#video-face-dataset) - [Other Face Dataset](https://github.com/sczhou/Awesome-Face-Restoration#other-face-dataset) ## Papers ### Face Image Restoration #### Diffusion Model - `[CVPR 2023]` DR2: Diffusion-based Robust Degradation Remover for Blind Face Restoration, Wang et al. [Paper](https://arxiv.org/abs/2303.06885) | [Bibtex](https://github.com/sczhou/Awesome-Face-Restoration/blob/master/facebib.bib#L114-L119) - `[Arxiv 2022]` DifFace: Blind Face Restoration with Diffused Error Contraction, Yue et al. [Paper](https://arxiv.org/abs/2212.06512) | [Github](https://github.com/zsyOAOA/DifFace) | [Demo](https://huggingface.co/spaces/OAOA/DifFace) | [Bibtex](https://github.com/sczhou/Awesome-Face-Restoration/blob/master/facebib.bib#L121-L127) #### Generative Prior - VQGAN - `[NeurIPS 2022]` CodeFormer: Towards Robust Blind Face Restoration with Codebook Lookup Transformer, Zhou et al. [Paper](https://arxiv.org/abs/2206.11253) | [Project](https://shangchenzhou.com/projects/CodeFormer/) | [Github](https://github.com/sczhou/CodeFormer) | [Demo](https://huggingface.co/spaces/sczhou/CodeFormer) | [Bibtex](https://github.com/sczhou/Awesome-Face-Restoration/blob/master/facebib.bib#L1-L6) - `[ECCV 2022]` VQFR: Blind Face Restoration with Vector-Quantized Dictionary and Parallel Decoder, Gu et al. [Paper](https://arxiv.org/abs/2205.06803) | [Project](https://ycgu.site/projects/vqfr/) | [Github](https://github.com/sczhou/CodeFormer) | [Bibtex](https://github.com/sczhou/Awesome-Face-Restoration/blob/master/facebib.bib#L8-L13) - `[CVPR 2022]` RestoreFormer: High-Quality Blind Face Restoration from Undegraded Key-Value Pairs, Wang et al. [Paper](https://arxiv.org/abs/2201.06374) | [Github](https://github.com/wzhouxiff/RestoreFormer) | [Bibtex](https://github.com/sczhou/Awesome-Face-Restoration/blob/master/facebib.bib#L15-L20) - `[CVPR 2022]` Rethinking Deep Face Restoration. Zhao et al. [Paper](https://openaccess.thecvf.com/content/CVPR2022/papers/Zhao_Rethinking_Deep_Face_Restoration_CVPR_2022_paper.pdf) | [Bibtex](https://github.com/sczhou/Awesome-Face-Restoration/blob/master/facebib.bib#L85-L91) #### Generative Prior - StyleGAN2 - `[CVPR 2021]` GFPGAN: Towards Real-World Blind Face Restoration with Generative Facial Prior, Wang et al. [Paper](https://arxiv.org/abs/2101.04061) | [Project](https://xinntao.github.io/projects/gfpgan) | [Github](https://github.com/TencentARC/GFPGAN) | [Demo](https://huggingface.co/spaces/Xintao/GFPGAN) | [Bibtex](https://github.com/sczhou/Awesome-Face-Restoration/blob/master/facebib.bib#L43-L48) - `[CVPR 2021]` GLEAN: Generative Latent Bank for Large-Factor Image Super-Resolution, Chan et al. [Paper](https://arxiv.org/abs/2012.00739) | [Project](https://mmlab-ntu.github.io/project/glean/) | [Github](https://github.com/open-mmlab/mmediting) | [Bibtex](https://github.com/sczhou/Awesome-Face-Restoration/blob/master/facebib.bib#L36-L41) - `[CVPR 2021]` GPEN: GAN Prior Embedded Network for Blind Face Restoration in the Wild, Yang et al. [Paper](https://arxiv.org/abs/2105.06070) | [Github](https://github.com/yangxy/GPEN) | [Bibtex](https://github.com/sczhou/Awesome-Face-Restoration/blob/master/facebib.bib#L50-L55) #### GAN Inversion - `[CVPR 2020]` PULSE: Self-Supervised Photo Upsampling via Latent Space Exploration of Generative Models, Menon et al. [Paper](https://arxiv.org/abs/2003.03808) | [Github](https://github.com/adamian98/pulse) | [Bibtex](https://github.com/sczhou/Awesome-Face-Restoration/blob/master/facebib.bib#L64-L69) #### Dictionary Learning - `[TPAMI 2022]` DMDNet: Learning Dual Memory Dictionaries for Blind Face Restoration, Li et al. [Paper](https://arxiv.org/abs/2210.08160) | [Github](https://github.com/csxmli2016/DMDNet) | [CelebRef-HQ Dataset](https://github.com/csxmli2016/DMDNet#celebref-hq-dataset) | [Bibtex](https://github.com/sczhou/Awesome-Face-Restoration/blob/master/facebib.bib#L107-L112) - `[ECCV 2020]` DFDNet: Blind Face Restoration via Deep Multi-scale Component Dictionaries, Li et al. [Paper](https://arxiv.org/abs/2008.00418) | [Github](https://github.com/csxmli2016/DFDNet) | [Bibtex](https://github.com/sczhou/Awesome-Face-Restoration/blob/master/facebib.bib#L22-L27) #### Reference/Exemplar Prior - `[CVPR 2020]` ASFFNet: Enhanced Blind Face Restoration With Multi-Exemplar Images and Adaptive Spatial Feature Fusion, Li et al. [Paper](https://openaccess.thecvf.com/content_CVPR_2020/papers/Li_Enhanced_Blind_Face_Restoration_With_Multi-Exemplar_Images_and_Adaptive_Spatial_CVPR_2020_paper.pdf) | [Github](https://github.com/csxmli2016/ASFFNet) | [Bibtex](https://github.com/sczhou/Awesome-Face-Restoration/blob/master/facebib.bib#L57-L62) #### Geometry Facial Prior - `[CVPR 2021]` PSFRGAN: Progressive Semantic-Aware Style Transformation for Blind Face Restoration, Chen et al. [Paper](https://arxiv.org/abs/2009.08709) | [Github](https://github.com/chaofengc/PSFRGAN) | [Bibtex](https://github.com/sczhou/Awesome-Face-Restoration/blob/master/facebib.bib#L29-L34) #### 3D Face Shape Prior - `[CVPR 2022]` SGPN: Blind Face Restoration via Integrating Face Shape and Generative Priors, Zhu et al. [Paper](https://openaccess.thecvf.com/content/CVPR2022/papers/Zhu_Blind_Face_Restoration_via_Integrating_Face_Shape_and_Generative_Priors_CVPR_2022_paper.pdf) | [Bibtex](https://github.com/sczhou/Awesome-Face-Restoration/blob/master/facebib.bib#L71-L76) #### Personalized Restoration - `[ArXiv 2022]` MyStyle: A Personalized Generative Prior, Nitzan et al. [Paper](https://arxiv.org/abs/2203.17272) | [Github](https://github.com/google/mystyle) | [Project](https://mystyle-personalized-prior.github.io/) | [Bibtex](https://github.com/sczhou/Awesome-Face-Restoration/blob/master/facebib.bib#L78-L83) #### Others - `[TIP 2020]` Learning Spatial Attention for Face Super-Resolution, Chen et al. [Paper](https://arxiv.org/abs/2012.01211) | [Github](https://github.com/chaofengc/Face-SPARNet) | [Bibtex](https://github.com/sczhou/Awesome-Face-Restoration/blob/master/facebib.bib#L93-L98) ### Face Video Restoration - `[CVPRW 2022]` VFHQ: A High-Quality Dataset and Benchmark for Video Face Super-Resolution, Xie et al. [Paper](https://arxiv.org/abs/2205.03409) | [Project](https://liangbinxie.github.io/projects/vfhq/) | [Bibtex](https://github.com/sczhou/Awesome-Face-Restoration/blob/master/facebib.bib#L100-L105) ## Datasets #### High-Resolution Face Dataset | Dataset | Resolution | Description | | --- | --- | --- | | [FFHQ](https://github.com/NVlabs/ffhq-dataset) | 1024 x 1024 | 7,0000 high-quality face images (usually used for training) | | [CelebA-HQ](https://github.com/nperraud/download-celebA-HQ) | 1024 x 1024 | 3,0000 high-quality face images (usually used for evaluation) | | [CelebAMask-HQ](https://github.com/switchablenorms/CelebAMask-HQ) | 512 x 512 | 3,0000 face images with 19 facial classes | | [CelebRef-HQ](https://github.com/csxmli2016/DMDNet#celebref-hq-dataset) | 512 x 512 | high-quality face images with multiple same-identity references | #### Low-Resolution Face Dataset | Dataset | Description | | --- | --- | | [CelebA](https://mmlab.ie.cuhk.edu.hk/projects/CelebA.html) | a large-scale face attributes dataset with more than 200K celebrity images | | [WIDER-Test](https://shangchenzhou.com/projects/CodeFormer/) | 970 real-world severely degraded face images from the [WIDER Face dataset](http://shuoyang1213.me/WIDERFACE/) (for test) | | [LFW-Test](https://xinntao.github.io/projects/gfpgan) | 1711 real-world degraded faces collected from the [LFW dataset](https://vis-www.cs.umass.edu/lfw/) (for test) | | [WebPhoto-Test](https://xinntao.github.io/projects/gfpgan) | 407 real-world degraded faces collected from the Internet (for test) | | [CelebChild-Test](https://xinntao.github.io/projects/gfpgan) | 180 real-world degraded child faces collected from the Internet (for test) | #### Video Face Dataset | Dataset | Description | | --- | --- | | [TalkingHead-1KH](https://github.com/tcwang0509/TalkingHead-1KH) | 500k video clips, of which about 80k are greater than 512x512 resolution | | [VFHQ](https://liangbinxie.github.io/projects/vfhq) | 16,000 high-fidelity clips of diverse interview scenarios | | [CelebV-HQ](https://celebv-hq.github.io/) | 35,666 video clips involving 15,653 identities and 83 manually labeled facial attributes | | [CelebV-Text](https://celebv-text.github.io/) | 70,000 in-the-wild face video clips covering diverse visual content | #### Other Face Dataset | Dataset | Description | | --- | --- | | [CelebA-Dialog](https://github.com/ziqihuangg/CelebA-Dialog) | a large-scale visual-language face dataset with fine-grained labels and captions | | [CelebA-Spoof](https://github.com/ZhangYuanhan-AI/CelebA-Spoof) | a large-scale face anti-spoofing dataset with rich attributes and spoof types | | [PPR10K](https://github.com/csjliang/PPR10K) | a large-scale portrait photo retouching dataset | ### Deep Face Restoartion: Denoise, Super-Resolution, Deblur and Artifact Removal - [https://github.com/TaoWangzj/Awesome-Face-Restoration](https://github.com/TaoWangzj/Awesome-Face-Restoration) Source: [GitHub](https://github.com/sczhou/Awesome-Face-Restoration) ## ENJOY & HAPPY LEARNING! ❤