Commit
•
d3bc67e
1
Parent(s):
fff0528
Update README.md
Browse files
README.md
CHANGED
|
@@ -1,18 +1,41 @@
|
|
| 1 |
---
|
| 2 |
library_name: keras
|
|
|
|
|
|
|
|
|
|
|
|
|
| 3 |
---
|
| 4 |
|
| 5 |
## Model description
|
| 6 |
|
| 7 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 8 |
|
| 9 |
## Intended uses & limitations
|
| 10 |
|
| 11 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 12 |
|
| 13 |
## Training and evaluation data
|
| 14 |
|
| 15 |
-
|
|
|
|
| 16 |
|
| 17 |
## Model Plot
|
| 18 |
|
|
|
|
| 1 |
---
|
| 2 |
library_name: keras
|
| 3 |
+
license: openrail
|
| 4 |
+
tags:
|
| 5 |
+
- keras-dreambooth
|
| 6 |
+
- wild-card
|
| 7 |
---
|
| 8 |
|
| 9 |
## Model description
|
| 10 |
|
| 11 |
+
Riffusion-Currulao (WIP) is a fine-tuned version of the Riffusion model, which is based on the Stable Diffusion 1.5 framework. This model is specifically designed to generate spectrograms for [Currulao music](https://es.wikipedia.org/wiki/Currulao), a traditional Afro-Colombian genre characterized by the use of the [Marimba de Chonta](https://en.wikipedia.org/wiki/Marimba), a unique wooden percussion instrument.
|
| 12 |
+
|
| 13 |
+
Currulao is an essential part of the Afro-Colombian cultural heritage and represents the rich history, traditions, and artistic expressions of the Afro-Colombian community. By leveraging the power of the Riffusion model and the additional fine-tuning through Keras using the (DreamBooth)[https://dreambooth.github.io/] technique, Riffusion-Currulao is capable of generating spectrograms that capture the essence of Currulao music.
|
| 14 |
+
|
| 15 |
+
The model was further enhanced using DreamBooth, which allowed the integration of the concepts of Currulao and Marimba de Chonta, ensuring that the generated spectrograms somehow represent the musical characteristics of this genre.
|
| 16 |
+
|
| 17 |
+
Riffusion-Currulao can be used for various applications, including music synthesis, audio analysis, and research on Afro-Colombian music and culture. It can also serve as a creative tool for artists and musicians who wish to explore Currulao music and incorporate its elements into their compositions.
|
| 18 |
+
|
| 19 |
+
The model is designed to be accessible and user-friendly, making it suitable for both professionals and enthusiasts interested in generating spectrograms of Currulao music for their projects or studies.
|
| 20 |
+
|
| 21 |
+
## Examples:
|
| 22 |
+
|
| 23 |
|
| 24 |
## Intended uses & limitations
|
| 25 |
|
| 26 |
+
Riffusion-Currulao (work in progress) will be intended for:
|
| 27 |
+
|
| 28 |
+
- Music synthesis: Generate new Currulao music pieces or augment existing compositions with Marimba de Chonta sounds.
|
| 29 |
+
- Audio analysis: Study the characteristics of Currulao music and its elements, such as rhythm, melody, and timbre, through the generated spectrograms.
|
| 30 |
+
- Research: Explore the Afro-Colombian cultural heritage and its musical expressions by analyzing the generated Currulao music.
|
| 31 |
+
- Creative inspiration: Use the model as a tool to inspire new musical ideas and compositions that incorporate the unique sounds and rhythms of Currulao music.
|
| 32 |
+
|
| 33 |
+
Always ensure that the use of generated spectrograms aligns with the intended purpose and respects the cultural significance of the Currulao music and Afro-Colombian heritage.
|
| 34 |
|
| 35 |
## Training and evaluation data
|
| 36 |
|
| 37 |
+
This model was fine-tuned using the DreamBooth technique. The spectrograms for fine-tuning the model were generated from the song: ["MUSICA PARA RELAJAR DEL PACÍFICO"](https://www.youtube.com/watch?v=Ryi4LLj1sEY).
|
| 38 |
+
The spectrograms were generated using the ("Riffusion Manipulation Tools")[https://github.com/chavinlo/riffusion-manipulation] repo
|
| 39 |
|
| 40 |
## Model Plot
|
| 41 |
|