Duplicate from CVPR/DualStyleGAN
Browse filesCo-authored-by: hysts <hysts@users.noreply.huggingface.co>
- .gitattributes +28 -0
- README.md +43 -0
- models/anime/exstyle_code.npy +3 -0
- models/anime/generator.pt +3 -0
- models/anime/refined_exstyle_code.npy +3 -0
- models/anime/sampler.pt +3 -0
- models/arcane/exstyle_code.npy +3 -0
- models/arcane/generator.pt +3 -0
- models/arcane/sampler.pt +3 -0
- models/caricature/exstyle_code.npy +3 -0
- models/caricature/generator.pt +3 -0
- models/caricature/refined_exstyle_code.npy +3 -0
- models/caricature/sampler.pt +3 -0
- models/cartoon/exstyle_code.npy +3 -0
- models/cartoon/generator.pt +3 -0
- models/cartoon/refined_exstyle_code.npy +3 -0
- models/cartoon/sampler.pt +3 -0
- models/comic/exstyle_code.npy +3 -0
- models/comic/generator.pt +3 -0
- models/comic/sampler.pt +3 -0
- models/encoder.pt +3 -0
- models/generator-pretrain.pt +3 -0
- models/pixar/exstyle_code.npy +3 -0
- models/pixar/generator.pt +3 -0
- models/pixar/sampler.pt +3 -0
- models/slamdunk/exstyle_code.npy +3 -0
- models/slamdunk/generator.pt +3 -0
- models/slamdunk/sampler.pt +3 -0
.gitattributes
ADDED
@@ -0,0 +1,28 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
*.npy filter=lfs diff=lfs merge=lfs -text
|
2 |
+
*.7z filter=lfs diff=lfs merge=lfs -text
|
3 |
+
*.arrow filter=lfs diff=lfs merge=lfs -text
|
4 |
+
*.bin filter=lfs diff=lfs merge=lfs -text
|
5 |
+
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
6 |
+
*.ftz filter=lfs diff=lfs merge=lfs -text
|
7 |
+
*.gz filter=lfs diff=lfs merge=lfs -text
|
8 |
+
*.h5 filter=lfs diff=lfs merge=lfs -text
|
9 |
+
*.joblib filter=lfs diff=lfs merge=lfs -text
|
10 |
+
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
11 |
+
*.model filter=lfs diff=lfs merge=lfs -text
|
12 |
+
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
13 |
+
*.onnx filter=lfs diff=lfs merge=lfs -text
|
14 |
+
*.ot filter=lfs diff=lfs merge=lfs -text
|
15 |
+
*.parquet filter=lfs diff=lfs merge=lfs -text
|
16 |
+
*.pb filter=lfs diff=lfs merge=lfs -text
|
17 |
+
*.pt filter=lfs diff=lfs merge=lfs -text
|
18 |
+
*.pth filter=lfs diff=lfs merge=lfs -text
|
19 |
+
*.rar filter=lfs diff=lfs merge=lfs -text
|
20 |
+
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
21 |
+
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
22 |
+
*.tflite filter=lfs diff=lfs merge=lfs -text
|
23 |
+
*.tgz filter=lfs diff=lfs merge=lfs -text
|
24 |
+
*.wasm filter=lfs diff=lfs merge=lfs -text
|
25 |
+
*.xz filter=lfs diff=lfs merge=lfs -text
|
26 |
+
*.zip filter=lfs diff=lfs merge=lfs -text
|
27 |
+
*.zstandard filter=lfs diff=lfs merge=lfs -text
|
28 |
+
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
README.md
ADDED
@@ -0,0 +1,43 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
license: mit
|
3 |
+
library_name: pytorch
|
4 |
+
tags:
|
5 |
+
- style-transfer
|
6 |
+
- face-stylization
|
7 |
+
datasets:
|
8 |
+
- cartoon
|
9 |
+
- caricature
|
10 |
+
- anime
|
11 |
+
- pixar
|
12 |
+
- slamdunk
|
13 |
+
- arcane
|
14 |
+
- comic
|
15 |
+
duplicated_from: CVPR/DualStyleGAN
|
16 |
+
---
|
17 |
+
|
18 |
+
## Model Details
|
19 |
+
|
20 |
+
This system provides a web demo for the following paper:
|
21 |
+
|
22 |
+
**Pastiche Master: Exemplar-Based High-Resolution Portrait Style Transfer (CVPR 2022)**
|
23 |
+
|
24 |
+
- Algorithm developed by: Shuai Yang, Liming Jiang, Ziwei Liu and Chen Change Loy
|
25 |
+
- Web demo developed by: [hysts](https://huggingface.co/hysts)
|
26 |
+
- Resources for more information:
|
27 |
+
- [Project Page](https://www.mmlab-ntu.com/project/dualstylegan/)
|
28 |
+
- [Research Paper](https://arxiv.org/abs/2203.13248)
|
29 |
+
- [GitHub Repo](https://github.com/williamyang1991/DualStyleGAN)
|
30 |
+
|
31 |
+
**Abstract**
|
32 |
+
> Recent studies on StyleGAN show high performance on artistic portrait generation by transfer learning with limited data. In this paper, we explore more challenging exemplar-based high-resolution portrait style transfer by introducing a novel DualStyleGAN with flexible control of dual styles of the original face domain and the extended artistic portrait domain. Different from StyleGAN, DualStyleGAN provides a natural way of style transfer by characterizing the content and style of a portrait with an intrinsic style path and a new extrinsic style path, respectively. The delicately designed extrinsic style path enables our model to modulate both the color and complex structural styles hierarchically to precisely pastiche the style example. Furthermore, a novel progressive fine-tuning scheme is introduced to smoothly transform the generative space of the model to the target domain, even with the above modifications on the network architecture. Experiments demonstrate the superiority of DualStyleGAN over state-of-the-art methods in high-quality portrait style transfer and flexible style control.
|
33 |
+
|
34 |
+
|
35 |
+
## Citation Information
|
36 |
+
```bibtex
|
37 |
+
@inproceedings{yang2022Pastiche,
|
38 |
+
author = {Yang, Shuai and Jiang, Liming and Liu, Ziwei and and Loy, Chen Change},
|
39 |
+
title = {Pastiche Master: Exemplar-Based High-Resolution Portrait Style Transfer},
|
40 |
+
booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition},
|
41 |
+
year = {2022}
|
42 |
+
}
|
43 |
+
```
|
models/anime/exstyle_code.npy
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:31465bcb616bce061d973d794443a800eb96fb58633ed563494e91d2bd530617
|
3 |
+
size 6428496
|
models/anime/generator.pt
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:7336adf17ddb45ebfb64b76a86f8d3986df6482313fd1b0716013b1a8b743056
|
3 |
+
size 307988244
|
models/anime/refined_exstyle_code.npy
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:09d3022b12d96e02c888babc02ca7288bc169f2b282f1e2de29fc4d5816314b9
|
3 |
+
size 6428496
|
models/anime/sampler.pt
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:6d892c805992f1b434b5dd632d1a90ae4ac616b0119cd13a9a5d6ace5962114a
|
3 |
+
size 4997529
|
models/arcane/exstyle_code.npy
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:437d2fdd0bb9bf7337a59db515a356de0527fe49e926ab10052e16a01153d026
|
3 |
+
size 3694721
|
models/arcane/generator.pt
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:c9b3b8c1a300911299e66e07a656333ba85ac79e1ff04a55e9357d0f915b5e6a
|
3 |
+
size 307988244
|
models/arcane/sampler.pt
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:d402f3fff0523983b962b32ad54a7ab3d4f70cbb0c1676fba1eaba96eee3b1f9
|
3 |
+
size 4997529
|
models/caricature/exstyle_code.npy
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:528dd3e6d331daa5d0848dd94fccbca50b1bb3f1daa3ce3f717734bcc155d20d
|
3 |
+
size 7354601
|
models/caricature/generator.pt
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:25ca1d3b5d281c880136d812176304e842d060e8cf6403d51ea637bb3cdcd9e3
|
3 |
+
size 307988244
|
models/caricature/refined_exstyle_code.npy
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:29fd9d6609458690fb4ea85a2456dd251c2db6bf41f0f9a9ca868e5100f08b49
|
3 |
+
size 7354601
|
models/caricature/sampler.pt
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:c5904238bcda699f70d744ff8c723a274410562d1d04a75eb963c1b20ee3faa6
|
3 |
+
size 4997529
|
models/cartoon/exstyle_code.npy
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:12a51461a56b5640435f9d428e18676096a10c11dc4cb3c193cbd68cfb4972dc
|
3 |
+
size 11714990
|
models/cartoon/generator.pt
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:de40db8bc79db5184f65b91a3fd710e2806d3010903cd9af754c9906b38edd8f
|
3 |
+
size 307988244
|
models/cartoon/refined_exstyle_code.npy
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:b8ccd6be0154c233920b7694dbb20c8353ab3f5bd33a426a18eb2702e2f8d068
|
3 |
+
size 11714990
|
models/cartoon/sampler.pt
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:e477698efdcbc8b5f4a57c017ca64369ca9bb429eecc11500283d8b2ae7b2d2e
|
3 |
+
size 4997529
|
models/comic/exstyle_code.npy
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:b901ffeed34bfae885a3481cabb7574481f3d9de57bb0e000c916f969bcd871a
|
3 |
+
size 3731118
|
models/comic/generator.pt
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:1221f44422239c7d0c56464ebfe19880ee0aac694c2ba5b728875486a1261d2e
|
3 |
+
size 307988244
|
models/comic/sampler.pt
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:b4398f5783f7adf5ede865b7d827b744ea3613d8185517ee9d1f7c69001d87f9
|
3 |
+
size 4997529
|
models/encoder.pt
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:264f263987efb847f1ff2f2bf729178d0ee25a6d65731f5a4d194de2c3ba3507
|
3 |
+
size 1201660560
|
models/generator-pretrain.pt
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:124da354f099f26d649c9f9c7d761b2a9d8b75cb85493503b3e1dc2a3985d582
|
3 |
+
size 1314687837
|
models/pixar/exstyle_code.npy
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:d0bd9447e7bbccc918106f780e471bd309ad0d416752e82e7781f60a4558e34f
|
3 |
+
size 4506989
|
models/pixar/generator.pt
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:0f68d75f297ba2614944e5ca7ad96e798f74b3ef0f6dfc74e6c5170f8983ac8b
|
3 |
+
size 307988244
|
models/pixar/sampler.pt
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:521826dc5b881d00936e456f340082f0a33f21219f6f2e72efe71314261a519a
|
3 |
+
size 4997529
|
models/slamdunk/exstyle_code.npy
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:e37b340fac788924813529ced3deedffe070f4c8bbc9c820723c7e25510802fc
|
3 |
+
size 4433133
|
models/slamdunk/generator.pt
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:784c1fee8621f91a1c06af4b0fd9ed4cf6e436e884fa62d85bf8c766ac98df71
|
3 |
+
size 307988244
|
models/slamdunk/sampler.pt
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:d1d218849d7e7a310e799a2e043b53992e42d0c571ee800b6d194da16d1b19aa
|
3 |
+
size 4997529
|