File size: 1,631 Bytes
ff6b136 11b15dd b6a3d52 11b15dd |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 |
---
# For reference on model card metadata, see the spec: https://github.com/huggingface/hub-docs/blob/main/modelcard.md?plain=1
# Doc / guide: https://huggingface.co/docs/hub/model-cards
{}
---
# POP2PIANO
Pop2Piano, a Transformer network that generates piano covers given waveforms of pop
music.
# Model Details
Pop2Piano was proposed in the paper [Pop2Piano : Pop Audio-based Piano Cover Generation](https://arxiv.org/abs/2211.00895) by Jongho Choi and Kyogu Lee.
Inspired by [T5](https://arxiv.org/abs/1910.10683), Pop2Piano
is the first model to generate a piano cover directly from pop audio without using melody and
chord extraction modules.
## Model Sources
- [**Original Repository**](https://github.com/sweetcocoa/pop2piano)
- [**Paper**](https://arxiv.org/abs/2211.00895)
- [**Demo**]# TODO (after the ongoing PR is merged)
# Usage
First, install the required packages:
```
pip install --upgrade transformers
```
## Pop music to Piano
TODO (after the ongoing PR is merged)
## Example
### Pop Music
<audio controls>
<source src="https://datasets-server.huggingface.co/assets/sweetcocoa/pop2piano_ci/--/sweetcocoa--pop2piano_ci/test/0/audio/audio.mp3" type="audio/mpeg">
Your browser does not support the audio element.
</audio>
### Generated MIDI
TODO (after the MIDI version is uploaded to the same repo above)
## Tips
TODO
# Citation
**BibTeX:**
```
@misc{choi2023pop2piano,
title={Pop2Piano : Pop Audio-based Piano Cover Generation},
author={Jongho Choi and Kyogu Lee},
year={2023},
eprint={2211.00895},
archivePrefix={arXiv},
primaryClass={cs.SD}
}
``` |