Skip to content

Latest commit

 

History

History
74 lines (69 loc) · 10.5 KB

README.md

File metadata and controls

74 lines (69 loc) · 10.5 KB

Paper and Code

Inspired by sczhou Awesome-Face-Restoration and TaoWangzj Awesome-Face-Restoration.

Blind Face Restoration (Image)

Geometric Prior

Year
Pub
Title
Links
Arch
Abbreviation
2018 CVPR FSRNet: End-to-End Learning Face Super-Resolution with Facial Priors [paper][code] CNN FSRNet
2021 TPAMI Face Restoration via Plug-and-Play 3D Facial Priors [paper][code] CNN -
2021 CVPR Progressive Semantic-Aware Style Transformation for Blind Face Restoration [paper][code] GAN PSFRGAN
2023 TNNLS Multi-prior learning via neural architecture search for blind face restoration [paper][code] CNN MFPSNet
2022 CVPR Blind Face Restoration via Integrating Face Shape and Generative Priors [paper][code] GAN SGPN

Reference Prior

Year
Pub
Title
Links
Arch
Abbreviation
2018 ECCV Learning Warped Guidance for Blind Face Restoration [paper][code] CNN GFRNet
2020 ECCV Blind Face Restoration via Deep Multi-scale Component Dictionaries [paper][code] CNN DFDNet
2020 CVPR Enhanced Blind Face Restoration with Multi-Exemplar Images
and Adaptive Spatial Feature Fusion
[paper][code] CNN ASFFNet
2022 TPAMI Learning Dual Memory Dictionaries for Blind Face Restoration [paper][code] CNN DMDNet

Generative Prior (good)

Year
Pub
Title
Links
Arch
Abbreviation
2020 MM HiFaceGAN: Face Renovation via Collaborative Suppression and Replenishment [paper][code] GAN HiFaceGAN
2020 CVPR Image Processing Using Multi-Code GAN Prior [paper][code] GAN mGANprior
2021 CVPR Towards Real-World Blind Face Restoration with Generative Facial Prior [paper][code] GAN GFPGAN
2021 CVPR GAN Prior Embedded Network for Blind Face Restoration in the Wild [paper][code] GAN GPEN
2022 CVPR Blind Face Restoration via Integrating Face Shape and Generative Priors [paper][code] GAN SGPN
2022 AAAI Panini-Net: GAN Prior Based Degradation-Aware Feature Interpolation for Face Restoration [paper][code] GAN Panini-Net
2022 Arxiv FaceFormer: Scale-aware Blind Face Restoration with Transformers [paper][code] ViT FaceFormer
2023 CVPR TFRGAN: Leveraging Text Information for Blind Face Restoration with Extreme Degradation [paper][code] GAN TFRGAN
2023 TCSVT DEAR-GAN: Degradation-Aware Face Restoration With GAN Prior [paper][code] GAN DEAR-GAN
2023 FSP Degradation Learning and Skip-Transformer for Blind Face Restoration [paper][code] GAN -
2024 AAAI Blind Face Restoration under Extreme Conditions: Leveraging 3D-2D Prior Fusion for Superior Structural and Texture Recovery [paper][code] GAN FREx

Vector Quantized Codebook Prior (good)

Year
Pub
Title
Links
Arch
Abbreviation
2022 CVPR RestoreFormer: High-Quality Blind Face Restoration
from Undegraded Key-Value Pairs
[paper][code] ViT RestoreFormer
2022 NeurIPS Towards Robust Blind Face Restoration with Codebook Lookup Transformer [paper][code] ViT CodeFormer
2022 ECCV VQFR: Blind Face Restoration with Vector-Quantized Dictionary and Parallel Decoder [paper][code] CNN VQFR
2023 TPAMI RestoreFormer++: Towards Real-World Blind Face Restoration from Undegraded Key-Value Pairs [paper][code] ViT RestoreFormer++
2022 CVPR Rethinking Deep Face Restoration [paper][code] GAN -
2024 ICLR Dual Associated Encoder for Face Restoration [paper][code] ViT DAEFR

Diffusion

Year
Pub
Title
Links
Arch
Abbreviation
2022 Arxiv Difface: Blind Face Restoration with Diffused Error Contraction [paper][code] Diffusion DifFace
2023 CVPR DR2: Diffusion-based Robust Degradation Remover for Blind Face Restoration [paper][code] Diffusion DR2
2023 WACV AT-DDPM: Restoring Faces degraded by Atmospheric Turbulence using Denoising Diffusion Probabilistic Models [paper][code] Diffusion AT-DDPM
2023 ACMMM DiffBFR: Bootstrapping Diffusion Model for Blind Face Restoration [paper][code] Diffusion DiffBFR
2024 TCSVT Towards Real-World Blind Face Restoration with Generative Diffusion Prior [paper][code] Diffusion BFRffusion
2024 WACV Diffuse and Restore: A Region-Adaptive Diffusion Model for Identity-Preserving Blind Face Restoration [paper][code] Diffusion -

Blind Face Restoration (Video)

Year
Pub
Title
Links
Arch
Abbreviation
2023 Arxiv FLAIR: A Conditional Diffusion Framework with Applications to Face Video Restoration [paper][code] Diffusion FLAIR
2024 IJCAI Beyond Alignment: Blind Video Face Restoration via Parsing-Guided Temporal-Coherent Transformer [paper][code] ViT PGTFormer
2024 ECCV KEEP: Kalman-Inspired Feature Propagation for Video Face Super-Resolution [paper][code] ViT KEEP

Datasets

Image Face Dataset

Dataset Resolution Description
FFHQ 1024 x 1024 7,0000 high-quality face images (usually used for training)
CelebA-HQ 1024 x 1024 3,0000 high-quality face images (usually used for evaluation)
CelebAMask-HQ 512 x 512 3,0000 face images with 19 facial classes
CelebRef-HQ 512 x 512 high-quality face images with multiple same-identity references

Video Face Dataset

Dataset Description
TalkingHead-1KH 500k video clips, of which about 80k are greater than 512x512 resolution
VFHQ 16,000 high-fidelity clips of diverse interview scenarios