Upload with huggingface_hub
Browse files- README.md +93 -6
- images/barredspiral.png +0 -0
- images/brightconstellation.png +0 -0
- images/galaxy_sd.png +0 -0
- images/galaxy_std.png +0 -0
- images/nebula.png +0 -0
- images/ngc7714.png +0 -0
- tags.txt +281 -0
README.md
CHANGED
|
@@ -6,27 +6,82 @@ tags:
|
|
| 6 |
- text-to-image
|
| 7 |
---
|
| 8 |
|
| 9 |
-
#Stellar Diffusion
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 10 |
|
| 11 |
Version: 0.1
|
| 12 |
|
| 13 |
Stable Diffusion 1.5 finetuned on high quality processed space imagery.
|
| 14 |
|
| 15 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 16 |
|
| 17 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 18 |
|
|
|
|
| 19 |
```
|
| 20 |
-
|
|
|
|
|
|
|
| 21 |
```
|
| 22 |
|
| 23 |
-
|
|
|
|
|
|
|
| 24 |
|
| 25 |
512x512
|
| 26 |
|
| 27 |
---
|
| 28 |
|
| 29 |
-
#
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 30 |
|
| 31 |
```py
|
| 32 |
from diffusers import StableDiffusionPipeline
|
|
@@ -44,11 +99,43 @@ image.save("hubble_galaxy.png")
|
|
| 44 |
|
| 45 |
---
|
| 46 |
|
| 47 |
-
#Dataset
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 48 |
|
| 49 |
91 of the 100 images from https://esahubble.org/ Top 100 Hubble Images
|
| 50 |
ESA/Hubble
|
| 51 |
|
| 52 |
---
|
| 53 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 54 |
|
|
|
|
|
|
| 6 |
- text-to-image
|
| 7 |
---
|
| 8 |
|
| 9 |
+
# Stellar Diffusion
|
| 10 |
+
|
| 11 |
+
Stellar Diffusion v0.1 vs Base Stable Diffusion v1.5
|
| 12 |
+
<img src="images/galaxy_std.png" width="300" height="300"> <img src="images/galaxy_sd.png" width="300" height="300">
|
| 13 |
+
```
|
| 14 |
+
prompt = A hubble photograph of a galaxy
|
| 15 |
+
seed = 42
|
| 16 |
+
size = 512x512
|
| 17 |
+
```
|
| 18 |
+
|
| 19 |
|
| 20 |
Version: 0.1
|
| 21 |
|
| 22 |
Stable Diffusion 1.5 finetuned on high quality processed space imagery.
|
| 23 |
|
| 24 |
---
|
| 25 |
+
# Example Results
|
| 26 |
+
|
| 27 |
+
<img src="images/barredspiral.png" width="200" height="200">
|
| 28 |
+
```
|
| 29 |
+
prompt = A barred spiral galaxy
|
| 30 |
+
seed = 44
|
| 31 |
+
size = 512x512
|
| 32 |
+
```
|
| 33 |
+
|
| 34 |
+
<img src="images/brightconstellation.png" width="200" height="200">
|
| 35 |
+
```
|
| 36 |
+
prompt = bright, constellation, hubble, clouds
|
| 37 |
+
seed = 42
|
| 38 |
+
size = 512x512
|
| 39 |
+
```
|
| 40 |
|
| 41 |
+
<img src="images/nebula.png" width="200" height="200">
|
| 42 |
+
```
|
| 43 |
+
prompt = a hubble photograph of a nebula
|
| 44 |
+
seed = 42
|
| 45 |
+
size = 512x512
|
| 46 |
+
```
|
| 47 |
|
| 48 |
+
<img src="images/ngc7714.png" width="200" height="200">
|
| 49 |
```
|
| 50 |
+
prompt = ngc 7714
|
| 51 |
+
seed = 42
|
| 52 |
+
size = 512x512
|
| 53 |
```
|
| 54 |
|
| 55 |
+
---
|
| 56 |
+
|
| 57 |
+
# Suggested parameters
|
| 58 |
|
| 59 |
512x512
|
| 60 |
|
| 61 |
---
|
| 62 |
|
| 63 |
+
# Reconized Tags
|
| 64 |
+
|
| 65 |
+
All reconized tags can be found in the tags.txt file. They are generated from the annotated descriptions of the photograph.
|
| 66 |
+
Current Dataset is small and is poor at generating exact celestial bodies, but is better at generating common generic bodies like nebula, galaxies etc.
|
| 67 |
+
|
| 68 |
+
### Partial support for scientific celestial body tags as follows:
|
| 69 |
+
|
| 70 |
+
NGC - New General Catalogue of Nebulae and Clusters of Stars
|
| 71 |
+
|
| 72 |
+
M / Messier - A set of 110 astronomical objects catalogued by the French astronomer Charles Messier
|
| 73 |
+
|
| 74 |
+
UGC – (catalog) Uppsala General Catalogue, a catalog of galaxies
|
| 75 |
+
|
| 76 |
+
### Partial support for the following classification methods as follows:
|
| 77 |
+
|
| 78 |
+
By recording instrument/spacecraft (ex. Voyager, Hubble)
|
| 79 |
+
|
| 80 |
+
By Color
|
| 81 |
+
|
| 82 |
+
By Celestial Body type
|
| 83 |
+
|
| 84 |
+
# Python Usage
|
| 85 |
|
| 86 |
```py
|
| 87 |
from diffusers import StableDiffusionPipeline
|
|
|
|
| 99 |
|
| 100 |
---
|
| 101 |
|
| 102 |
+
# Dataset and Credits
|
| 103 |
+
|
| 104 |
+
### Model
|
| 105 |
+
|
| 106 |
+
Rex Wang (me!)
|
| 107 |
+
|
| 108 |
+
RunwayML for their SD 1.5
|
| 109 |
+
|
| 110 |
+
### Compute
|
| 111 |
+
|
| 112 |
+
Coreweave - 2x A40s
|
| 113 |
+
|
| 114 |
+
### Dataset
|
| 115 |
|
| 116 |
91 of the 100 images from https://esahubble.org/ Top 100 Hubble Images
|
| 117 |
ESA/Hubble
|
| 118 |
|
| 119 |
---
|
| 120 |
|
| 121 |
+
# Planned
|
| 122 |
+
|
| 123 |
+
Expansion of dataset to include:
|
| 124 |
+
|
| 125 |
+
Solar system
|
| 126 |
+
|
| 127 |
+
Asteroids
|
| 128 |
+
|
| 129 |
+
More star types
|
| 130 |
+
|
| 131 |
+
Black holes
|
| 132 |
+
|
| 133 |
+
Exo planets
|
| 134 |
+
|
| 135 |
+
More data in general
|
| 136 |
+
|
| 137 |
+
---
|
| 138 |
+
|
| 139 |
+
# Version History
|
| 140 |
|
| 141 |
+
V0.1 - 91 image dataset
|
images/barredspiral.png
ADDED
|
images/brightconstellation.png
ADDED
|
images/galaxy_sd.png
ADDED
|
images/galaxy_std.png
ADDED
|
images/nebula.png
ADDED
|
images/ngc7714.png
ADDED
|
tags.txt
ADDED
|
@@ -0,0 +1,281 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
hubble: 81
|
| 2 |
+
space: 65
|
| 3 |
+
red: 63
|
| 4 |
+
hubble space telescope: 62
|
| 5 |
+
star: 61
|
| 6 |
+
nasa: 56
|
| 7 |
+
esa: 56
|
| 8 |
+
galaxy: 53
|
| 9 |
+
gas: 37
|
| 10 |
+
constellation: 36
|
| 11 |
+
dust: 35
|
| 12 |
+
galaxies: 32
|
| 13 |
+
spiral: 29
|
| 14 |
+
bright: 29
|
| 15 |
+
earth: 28
|
| 16 |
+
cloud: 27
|
| 17 |
+
nebula: 26
|
| 18 |
+
young: 22
|
| 19 |
+
glow: 22
|
| 20 |
+
blue: 20
|
| 21 |
+
clouds: 20
|
| 22 |
+
milky way: 19
|
| 23 |
+
spiral galaxy: 18
|
| 24 |
+
wide field camera 3: 18
|
| 25 |
+
disc: 17
|
| 26 |
+
sun: 17
|
| 27 |
+
dark: 16
|
| 28 |
+
planetary: 16
|
| 29 |
+
hydrogen: 15
|
| 30 |
+
star formation: 15
|
| 31 |
+
infrared: 12
|
| 32 |
+
advanced camera for surveys: 12
|
| 33 |
+
glowing: 12
|
| 34 |
+
elliptical: 11
|
| 35 |
+
radiation: 11
|
| 36 |
+
wfc3: 11
|
| 37 |
+
gravitation: 10
|
| 38 |
+
star forming: 10
|
| 39 |
+
star cluster: 9
|
| 40 |
+
arc: 9
|
| 41 |
+
messier: 9
|
| 42 |
+
ultraviolet: 9
|
| 43 |
+
globular cluster: 8
|
| 44 |
+
globular clusters: 8
|
| 45 |
+
supernova: 8
|
| 46 |
+
eso: 8
|
| 47 |
+
merge: 7
|
| 48 |
+
green: 7
|
| 49 |
+
planetary nebula: 7
|
| 50 |
+
starburst: 7
|
| 51 |
+
moon: 6
|
| 52 |
+
barred spiral galaxy: 6
|
| 53 |
+
dust lane: 6
|
| 54 |
+
acs: 6
|
| 55 |
+
black hole: 6
|
| 56 |
+
turbulent: 6
|
| 57 |
+
atmosphere: 6
|
| 58 |
+
dust lanes: 5
|
| 59 |
+
star clusters: 5
|
| 60 |
+
carina: 5
|
| 61 |
+
comet: 5
|
| 62 |
+
aging: 5
|
| 63 |
+
reddish: 5
|
| 64 |
+
hunter: 5
|
| 65 |
+
galaxy cluster: 5
|
| 66 |
+
pillar: 5
|
| 67 |
+
large magellanic cloud: 5
|
| 68 |
+
saturn: 5
|
| 69 |
+
orange: 4
|
| 70 |
+
halo: 4
|
| 71 |
+
nebulae: 4
|
| 72 |
+
orion: 4
|
| 73 |
+
pink: 4
|
| 74 |
+
collection: 4
|
| 75 |
+
starburst galaxy: 4
|
| 76 |
+
solar system: 4
|
| 77 |
+
stellar nursery: 4
|
| 78 |
+
coma berenices: 3
|
| 79 |
+
colliding: 3
|
| 80 |
+
supermassive: 3
|
| 81 |
+
supermassive black hole: 3
|
| 82 |
+
satellite: 3
|
| 83 |
+
planetary nebulae: 3
|
| 84 |
+
tilt: 3
|
| 85 |
+
white dwarf: 3
|
| 86 |
+
tint: 3
|
| 87 |
+
hubble servicing mission: 3
|
| 88 |
+
stellar wind: 3
|
| 89 |
+
great red spot: 3
|
| 90 |
+
tendril: 3
|
| 91 |
+
tendrils: 3
|
| 92 |
+
carina nebula: 3
|
| 93 |
+
deep field: 2
|
| 94 |
+
pinwheel: 2
|
| 95 |
+
draco: 2
|
| 96 |
+
puppis: 2
|
| 97 |
+
lepus: 2
|
| 98 |
+
small magellanic cloud: 2
|
| 99 |
+
satellite galaxy: 2
|
| 100 |
+
filaments: 2
|
| 101 |
+
filament: 2
|
| 102 |
+
web: 2
|
| 103 |
+
lacy: 2
|
| 104 |
+
pegasus: 2
|
| 105 |
+
twins: 2
|
| 106 |
+
tinted: 2
|
| 107 |
+
arcs: 2
|
| 108 |
+
grand: 2
|
| 109 |
+
hidden treasures: 2
|
| 110 |
+
stellar winds: 2
|
| 111 |
+
voyager: 2
|
| 112 |
+
supernovae: 2
|
| 113 |
+
dorado: 2
|
| 114 |
+
white dwarfs: 2
|
| 115 |
+
variable star: 2
|
| 116 |
+
variable: 2
|
| 117 |
+
ngc 6302: 2
|
| 118 |
+
butterfly nebula: 2
|
| 119 |
+
butterfly: 2
|
| 120 |
+
virgo: 2
|
| 121 |
+
cetus: 2
|
| 122 |
+
eagle nebula: 2
|
| 123 |
+
tarantula nebula: 2
|
| 124 |
+
crab nebula: 2
|
| 125 |
+
crab: 2
|
| 126 |
+
thread: 2
|
| 127 |
+
ngc4826: 1
|
| 128 |
+
black eye: 1
|
| 129 |
+
evil eye: 1
|
| 130 |
+
ngc 1672: 1
|
| 131 |
+
ugc 10214: 1
|
| 132 |
+
3b: 1
|
| 133 |
+
hubble deep field: 1
|
| 134 |
+
tadpole: 1
|
| 135 |
+
ngc 2525: 1
|
| 136 |
+
ngc2525: 1
|
| 137 |
+
messier 79: 1
|
| 138 |
+
messier's: 1
|
| 139 |
+
ngc 346: 1
|
| 140 |
+
smc: 1
|
| 141 |
+
ngc 7049: 1
|
| 142 |
+
indus: 1
|
| 143 |
+
pn m2: 1
|
| 144 |
+
m2: 1
|
| 145 |
+
twin jet nebula: 1
|
| 146 |
+
bipolar planetary nebula: 1
|
| 147 |
+
outburst: 1
|
| 148 |
+
binary: 1
|
| 149 |
+
binary system: 1
|
| 150 |
+
ngc 3717: 1
|
| 151 |
+
hydra: 1
|
| 152 |
+
sea serpent: 1
|
| 153 |
+
ngc 7331: 1
|
| 154 |
+
winged horse: 1
|
| 155 |
+
whirlpool: 1
|
| 156 |
+
ngc 2841: 1
|
| 157 |
+
horsehead nebula: 1
|
| 158 |
+
horsehead: 1
|
| 159 |
+
barnard: 1
|
| 160 |
+
m81: 1
|
| 161 |
+
1993j: 1
|
| 162 |
+
messier 94: 1
|
| 163 |
+
ngc 2371: 1
|
| 164 |
+
galaxy clusters: 1
|
| 165 |
+
brightest cluster galaxy: 1
|
| 166 |
+
bcg: 1
|
| 167 |
+
sloan digital sky survey: 1
|
| 168 |
+
sdss j1156+1911: 1
|
| 169 |
+
greenish: 1
|
| 170 |
+
ngc 7320: 1
|
| 171 |
+
7318a: 1
|
| 172 |
+
7318b: 1
|
| 173 |
+
natal cloud: 1
|
| 174 |
+
n90: 1
|
| 175 |
+
messier 106: 1
|
| 176 |
+
ic 418: 1
|
| 177 |
+
ngc 3201: 1
|
| 178 |
+
ngc 7635: 1
|
| 179 |
+
ic 10: 1
|
| 180 |
+
ugca 193: 1
|
| 181 |
+
sextans: 1
|
| 182 |
+
sextant: 1
|
| 183 |
+
abell 1703: 1
|
| 184 |
+
westerlund 2: 1
|
| 185 |
+
022058s: 1
|
| 186 |
+
einstein rings: 1
|
| 187 |
+
einstein ring: 1
|
| 188 |
+
molten ring: 1
|
| 189 |
+
new horizons: 1
|
| 190 |
+
spacecraft: 1
|
| 191 |
+
turbulence: 1
|
| 192 |
+
m74: 1
|
| 193 |
+
eso 510: 1
|
| 194 |
+
eso 381: 1
|
| 195 |
+
ngc 2022: 1
|
| 196 |
+
ngc 4038: 1
|
| 197 |
+
antennae: 1
|
| 198 |
+
antennae galaxies: 1
|
| 199 |
+
ngc 1792: 1
|
| 200 |
+
ngc 5866: 1
|
| 201 |
+
ngc 2264: 1
|
| 202 |
+
m16: 1
|
| 203 |
+
cone nebula: 1
|
| 204 |
+
europa: 1
|
| 205 |
+
ngc 1805: 1
|
| 206 |
+
n11: 1
|
| 207 |
+
messier 57: 1
|
| 208 |
+
variable stars: 1
|
| 209 |
+
rs puppis: 1
|
| 210 |
+
cepheid: 1
|
| 211 |
+
cepheid variable: 1
|
| 212 |
+
north pole: 1
|
| 213 |
+
auroras: 1
|
| 214 |
+
hh 901: 1
|
| 215 |
+
ngc 1052: 1
|
| 216 |
+
ngc 6960: 1
|
| 217 |
+
ngc 4621: 1
|
| 218 |
+
messier 59: 1
|
| 219 |
+
virgin: 1
|
| 220 |
+
ngc 3256: 1
|
| 221 |
+
outer planet atmospheres legacy: 1
|
| 222 |
+
opal: 1
|
| 223 |
+
messier 77: 1
|
| 224 |
+
pinwheeling: 1
|
| 225 |
+
pillars of creation: 1
|
| 226 |
+
ngc 4676: 1
|
| 227 |
+
mice: 1
|
| 228 |
+
v838 monocerotis: 1
|
| 229 |
+
v838 mon: 1
|
| 230 |
+
ngc 1015: 1
|
| 231 |
+
black holes: 1
|
| 232 |
+
whale: 1
|
| 233 |
+
catherine wheel: 1
|
| 234 |
+
ngc 1512: 1
|
| 235 |
+
ngc 3603: 1
|
| 236 |
+
ngc 3372: 1
|
| 237 |
+
keyhole nebula: 1
|
| 238 |
+
ngc 1999: 1
|
| 239 |
+
alpha centauri: 1
|
| 240 |
+
ag carinae: 1
|
| 241 |
+
remnants: 1
|
| 242 |
+
ngc 2008: 1
|
| 243 |
+
pictor: 1
|
| 244 |
+
spiralling: 1
|
| 245 |
+
collections: 1
|
| 246 |
+
ngc 6217: 1
|
| 247 |
+
ursa major: 1
|
| 248 |
+
ngc 2174: 1
|
| 249 |
+
monkey head nebula: 1
|
| 250 |
+
1980s: 1
|
| 251 |
+
uranus: 1
|
| 252 |
+
ionosphere: 1
|
| 253 |
+
space telescope imaging spectrograph: 1
|
| 254 |
+
stis: 1
|
| 255 |
+
canis major: 1
|
| 256 |
+
messier 100: 1
|
| 257 |
+
messier 104: 1
|
| 258 |
+
m104: 1
|
| 259 |
+
sombrero galaxy: 1
|
| 260 |
+
sombrero: 1
|
| 261 |
+
photogenic: 1
|
| 262 |
+
ngc 1316: 1
|
| 263 |
+
ngc 1300: 1
|
| 264 |
+
turquoise: 1
|
| 265 |
+
archival pure parallel project: 1
|
| 266 |
+
appp: 1
|
| 267 |
+
afgl 5180: 1
|
| 268 |
+
ngc 1866: 1
|
| 269 |
+
ngc 1275: 1
|
| 270 |
+
threads: 1
|
| 271 |
+
elliptical central cluster galaxy: 1
|
| 272 |
+
m61: 1
|
| 273 |
+
european southern observatory: 1
|
| 274 |
+
ngc 5128: 1
|
| 275 |
+
centaurus a: 1
|
| 276 |
+
bug nebula: 1
|
| 277 |
+
hourglass: 1
|
| 278 |
+
ngc 7714: 1
|
| 279 |
+
lagoon nebula: 1
|
| 280 |
+
messier 82: 1
|
| 281 |
+
m82: 1
|