Spaces:

Alpha-VLLM
/

Lumina-Next-T2I

Running on Zero

PommesPeter commited on May 29, 2024

Commit

0b9e35d

•

1 Parent(s): 7a92cca

Update models/model.py

Files changed (1) hide show

models/model.py CHANGED Viewed

@@ -543,7 +543,7 @@ class TransformerBlock(nn.Module):
             nn.SiLU(),
             nn.Linear(
                 min(dim, 1024),
-                2 * dim,
                 bias=True,
             ),
         )

             nn.SiLU(),
             nn.Linear(
                 min(dim, 1024),
+                4 * dim,
                 bias=True,
             ),
         )