NekoMikoReimu
commited on
Update README.md
Browse files
README.md
CHANGED
@@ -5,9 +5,13 @@ language:
|
|
5 |
- en
|
6 |
---
|
7 |
|
8 |
-
A diarization pipeline
|
9 |
Can be given a video file or mp3/wav file.
|
10 |
|
11 |
-
Performance is considerably better than default JP whisper for most tasks involving Japanese content, with the exception of singing/karaoke.
|
|
|
|
|
|
|
|
|
|
|
12 |
|
13 |
-
Requires ffmpeg, pyannote and facebookresearch's demux model. Torch is also strongly encouraged.
|
|
|
5 |
- en
|
6 |
---
|
7 |
|
8 |
+
A Japanese transcription/diarization pipeline with Pyannote and Whisper large-v2 that uses a custom-tuned segmentation model and custom filtering on the audio (low-pass filter, equalizer, etc.) for improved performance.
|
9 |
Can be given a video file or mp3/wav file.
|
10 |
|
11 |
+
Performance is considerably better than default JP whisper for most tasks involving Japanese content, with the exception of singing/karaoke (Where performance is below the origin.
|
12 |
+
|
13 |
+
Requires ffmpeg, openai-whisper, pyannote and facebookresearch's demux model. Torch is also strongly encouraged.
|
14 |
+
Pyannote requies a Huggingface API key, which it will currently look for under the environment variable "HF_TOKEN_NOT_LOGIN" (At the time of this writing, naming your HF token "HF_TOKEN" causes bugs.)
|
15 |
+
|
16 |
+
Originally intended as a solo project, but I'm upping it here in the hopes it will be useful to practicioners. If you're doing work in this space please feel free to reach out.
|
17 |
|
|