Hugging Face's logo

hicustomer
/
pyannote-speaker-diarization

Automatic Speech Recognition
pyannote.audio
pyannote
pyannote-audio-pipeline
audio
voice
speech
speaker
speaker-diarization
speaker-change-detection
voice-activity-detection
overlapped-speech-detection
Inference Endpoints
Model card Files Community
Hervé BREDIN commited on
Commit
25bcc7e
•
2 Parent(s): fa95f91 c7fe49a

Merge branch 'develop'

Browse files
Files changed (40) hide show
  1. README.md +27 -23
  2. config.yaml +10 -12
  3. reproducible_research/{2022.07 → 2.0.1}/AISHELL.SpeakerDiarization.Full.test.eval +0 -0
  4. reproducible_research/{2022.07 → 2.0.1}/AISHELL.SpeakerDiarization.Full.test.rttm +0 -0
  5. reproducible_research/{2022.07 → 2.0.1}/AMI-SDM.SpeakerDiarization.only_words.test.eval +0 -0
  6. reproducible_research/{2022.07 → 2.0.1}/AMI-SDM.SpeakerDiarization.only_words.test.rttm +0 -0
  7. reproducible_research/{2022.07 → 2.0.1}/AMI.SpeakerDiarization.only_words.test.eval +0 -0
  8. reproducible_research/{2022.07 → 2.0.1}/AMI.SpeakerDiarization.only_words.test.rttm +0 -0
  9. reproducible_research/{2022.07 → 2.0.1}/CALLHOME.SpeakerDiarization.CALLHOME.test.eval +0 -0
  10. reproducible_research/{2022.07 → 2.0.1}/CALLHOME.SpeakerDiarization.CALLHOME.test.rttm +0 -0
  11. reproducible_research/{2022.07 → 2.0.1}/DIHARD.SpeakerDiarization.Full.test.eval +0 -0
  12. reproducible_research/{2022.07 → 2.0.1}/DIHARD.SpeakerDiarization.Full.test.rttm +0 -0
  13. reproducible_research/{2022.07 → 2.0.1}/REPERE.SpeakerDiarization.Full.test.eval +0 -0
  14. reproducible_research/{2022.07 → 2.0.1}/REPERE.SpeakerDiarization.Full.test.rttm +0 -0
  15. reproducible_research/{2022.07 → 2.0.1}/VoxConverse.SpeakerDiarization.VoxConverse.test.eval +0 -0
  16. reproducible_research/{2022.07 → 2.0.1}/VoxConverse.SpeakerDiarization.VoxConverse.test.rttm +0 -0
  17. reproducible_research/2.1/.DS_Store +0 -0
  18. reproducible_research/2.1/AISHELL.test.eval +24 -0
  19. reproducible_research/2.1/AISHELL.test.rttm +0 -0
  20. reproducible_research/2.1/AMI-SDM.test.eval +20 -0
  21. reproducible_research/2.1/AMI-SDM.test.rttm +0 -0
  22. reproducible_research/2.1/AMI.test.eval +20 -0
  23. reproducible_research/2.1/AMI.test.rttm +0 -0
  24. reproducible_research/2.1/Albayzin2020.test.eval +58 -0
  25. reproducible_research/2.1/Albayzin2020.test.rttm +0 -0
  26. reproducible_research/2.1/AliMeeting.test.eval +24 -0
  27. reproducible_research/2.1/AliMeeting.test.rttm +0 -0
  28. reproducible_research/2.1/CALLHOME.test.eval +254 -0
  29. reproducible_research/2.1/CALLHOME.test.rttm +0 -0
  30. reproducible_research/2.1/DIHARD.test.eval +263 -0
  31. reproducible_research/2.1/DIHARD.test.rttm +0 -0
  32. reproducible_research/2.1/Ego4D.development.eval +54 -0
  33. reproducible_research/2.1/Ego4D.development.rttm +0 -0
  34. reproducible_research/2.1/REPERE.test.eval +65 -0
  35. reproducible_research/2.1/REPERE.test.rttm +0 -0
  36. reproducible_research/2.1/ThisAmericanLife.test.eval +40 -0
  37. reproducible_research/2.1/ThisAmericanLife.test.rttm +0 -0
  38. reproducible_research/2.1/VoxConverse.test.eval +236 -0
  39. reproducible_research/2.1/VoxConverse.test.rttm +0 -0
  40. technical_report_2.1.pdf +0 -0
README.md CHANGED
@@ -29,14 +29,18 @@ extra_gated_fields:
29
 
30
  # 🎹 Speaker diarization
31
 
32
- Relies on pyannote.audio 2.0.1: see [installation instructions](https://github.com/pyannote/pyannote-audio#installation).
33
 
34
  ## TL;DR
35
 
36
  ```python
37
- # load the pipeline from Hugginface Hub
 
 
38
  from pyannote.audio import Pipeline
39
- pipeline = Pipeline.from_pretrained("pyannote/speaker-diarization@2.0.1")
 
 
40
 
41
  # apply the pipeline to an audio file
42
  diarization = pipeline("audio.wav")
@@ -60,22 +64,13 @@ One can also provide lower and/or upper bounds on the number of speakers using `
60
  diarization = pipeline("audio.wav", min_speakers=2, max_speakers=5)
61
  ```
62
 
63
- If you feel adventurous, you can try and play with the various pipeline hyper-parameters.
64
- For instance, one can use a more aggressive voice activity detection by increasing the value of `segmentation_onset` threshold:
65
-
66
- ```python
67
- hparams = pipeline.parameters(instantiated=True)
68
- hparams["segmentation_onset"] += 0.1
69
- pipeline.instantiate(hparams)
70
- ```
71
-
72
  ## Benchmark
73
 
74
  ### Real-time factor
75
 
76
- Real-time factor is around 5% using one Nvidia Tesla V100 SXM2 GPU (for the neural inference part) and one Intel Cascade Lake 6248 CPU (for the clustering part).
77
 
78
- In other words, it takes approximately 3 minutes to process a one hour conversation.
79
 
80
  ### Accuracy
81
 
@@ -93,15 +88,24 @@ Processing is fully automatic:
93
  * evaluation of overlapped speech
94
 
95
 
96
- | Benchmark (2.0.1) | [DER%](. "Diarization error rate") | [FA%](. "False alarm rate") | [Miss%](. "Missed detection rate") | [Conf%](. "Speaker confusion rate") | Expected output | File-level evaluation |
97
- | ---------------------------------------------------------------------------------------------------------------------------------- | ---------------------------------- | --------------------------- | ---------------------------------- | ----------------------------------- | -------------------------------------------------------------------------------------------------------------------------------------------------------- | -------------------------------------------------------------------------------------------------------------------------------------------------------- |
98
- | [AISHELL-4](http://www.openslr.org/111/) | 14.61 | 3.31 | 4.35 | 6.95 | [RTTM](https://huggingface.co/pyannote/speaker-diarization/blob/2022.07/reproducible_research/2022.07/AISHELL.SpeakerDiarization.Full.test.rttm) | [eval](https://huggingface.co/pyannote/speaker-diarization/blob/2022.07/reproducible_research/2022.07/AISHELL.SpeakerDiarization.Full.test.eval) |
99
- | [AMI *Mix-Headset*](https://groups.inf.ed.ac.uk/ami/corpus/) [*only_words*](https://github.com/BUTSpeechFIT/AMI-diarization-setup) | 18.21 | 3.28 | 11.07 | 3.87 | [RTTM](https://huggingface.co/pyannote/speaker-diarization/blob/2022.07/reproducible_research/2022.07/AMI.SpeakerDiarization.only_words.test.rttm) | [eval](https://huggingface.co/pyannote/speaker-diarization/blob/2022.07/reproducible_research/2022.07/AMI.SpeakerDiarization.only_words.test.eval) |
100
- | [AMI *Array1-01*](https://groups.inf.ed.ac.uk/ami/corpus/) [*only_words*](https://github.com/BUTSpeechFIT/AMI-diarization-setup) | 29.00 | 2.71 | 21.61 | 4.68 | [RTTM](https://huggingface.co/pyannote/speaker-diarization/blob/2022.07/reproducible_research/2022.07/AMI-SDM.SpeakerDiarization.only_words.test.rttm) | [eval](https://huggingface.co/pyannote/speaker-diarization/blob/2022.07/reproducible_research/2022.07/AMI-SDM.SpeakerDiarization.only_words.test.eval) |
101
- | [CALLHOME](https://catalog.ldc.upenn.edu/LDC2001S97) [*Part2*](https://github.com/BUTSpeechFIT/CALLHOME_sublists/issues/1) | 30.24 | 3.71 | 16.86 | 9.66 | [RTTM](https://huggingface.co/pyannote/speaker-diarization/blob/2022.07/reproducible_research/2022.07/CALLHOME.SpeakerDiarization.CALLHOME.test.rttm) | [eval](https://huggingface.co/pyannote/speaker-diarization/blob/2022.07/reproducible_research/2022.07/CALLHOME.SpeakerDiarization.CALLHOME.test.eval) |
102
- | [DIHARD 3 *Full*](https://arxiv.org/abs/2012.01477) | 20.99 | 4.25 | 10.74 | 6.00 | [RTTM](https://huggingface.co/pyannote/speaker-diarization/blob/2022.07/reproducible_research/2022.07/DIHARD.SpeakerDiarization.Full.test.rttm) | [eval](https://huggingface.co/pyannote/speaker-diarization/blob/2022.07/reproducible_research/2022.07/DIHARD.SpeakerDiarization.Full.test.eval) |
103
- | [REPERE *Phase 2*](https://islrn.org/resources/360-758-359-485-0/) | 12.62 | 1.55 | 3.30 | 7.76 | [RTTM](https://huggingface.co/pyannote/speaker-diarization/blob/2022.07/reproducible_research/2022.07/REPERE.SpeakerDiarization.Full.test.rttm) | [eval](https://huggingface.co/pyannote/speaker-diarization/blob/2022.07/reproducible_research/2022.07/REPERE.SpeakerDiarization.Full.test.eval) |
104
- | [VoxConverse *v0.3*](https://github.com/joonson/voxconverse) | 12.61 | 3.45 | 3.85 | 5.31 | [RTTM](https://huggingface.co/pyannote/speaker-diarization/blob/main/reproducible_research/2022.07/VoxConverse.SpeakerDiarization.VoxConverse.test.rttm) | [eval](https://huggingface.co/pyannote/speaker-diarization/blob/main/reproducible_research/2022.07/VoxConverse.SpeakerDiarization.VoxConverse.test.eval) |
 
 
 
 
 
 
 
 
 
105
 
106
  ## Support
107
 
 
29
 
30
  # 🎹 Speaker diarization
31
 
32
+ Relies on pyannote.audio 2.1: see [installation instructions](https://github.com/pyannote/pyannote-audio#installation).
33
 
34
  ## TL;DR
35
 
36
  ```python
37
+ # 1. visit hf.co/pyannote/speaker-diarization and accept user conditions (when requested)
38
+ # 2. visit hf.co/settings/tokens to create an access token (if you had to go through 1.)
39
+ # 3. instantiate pretrained speaker diarization pipeline
40
  from pyannote.audio import Pipeline
41
+ pipeline = Pipeline.from_pretrained("pyannote/speaker-diarization@2.1",
42
+ use_auth_token="ACCESS_TOKEN_GOES_HERE")
43
+
44
 
45
  # apply the pipeline to an audio file
46
  diarization = pipeline("audio.wav")
 
64
  diarization = pipeline("audio.wav", min_speakers=2, max_speakers=5)
65
  ```
66
 
 
 
 
 
 
 
 
 
 
67
  ## Benchmark
68
 
69
  ### Real-time factor
70
 
71
+ Real-time factor is around 2.5% using one Nvidia Tesla V100 SXM2 GPU (for the neural inference part) and one Intel Cascade Lake 6248 CPU (for the clustering part).
72
 
73
+ In other words, it takes approximately 1.5 minutes to process a one hour conversation.
74
 
75
  ### Accuracy
76
 
 
88
  * evaluation of overlapped speech
89
 
90
 
91
+ | Benchmark | [DER%](. "Diarization error rate") | [FA%](. "False alarm rate") | [Miss%](. "Missed detection rate") | [Conf%](. "Speaker confusion rate") | Expected output | File-level evaluation |
92
+ | ------------------------------------------------------------------------------------------------------------------------------------------- | ---------------------------------- | --------------------------- | ---------------------------------- | ----------------------------------- | ------------------------------------------------------------------------------------------------------------------------- | ------------------------------------------------------------------------------------------------------------------------- |
93
+ | [AISHELL-4](http://www.openslr.org/111/) | 14.09 | 5.17 | 3.27 | 5.65 | [RTTM](https://huggingface.co/pyannote/speaker-diarization/blob/2.1/reproducible_research/2.1/AISHELL.test.rttm) | [eval](https://huggingface.co/pyannote/speaker-diarization/blob/2.1/reproducible_research/2.1/AISHELL.test.eval) |
94
+ | [AliMeeting (*channel 1*)](https://www.openslr.org/119/) | 27.42 | 4.84 | 14.00 | 8.58 | [RTTM](https://huggingface.co/pyannote/speaker-diarization/blob/2.1/reproducible_research/2.1/AliMeeting.test.rttm) | [eval](https://huggingface.co/pyannote/speaker-diarization/blob/2.1/reproducible_research/2.1/AliMeeting.test.eval) |
95
+ | [AMI (*headset mix,*](https://groups.inf.ed.ac.uk/ami/corpus/) [*only_words*)](https://github.com/BUTSpeechFIT/AMI-diarization-setup) | 18.91 | 4.48 | 9.51 | 4.91 | [RTTM](https://huggingface.co/pyannote/speaker-diarization/blob/2.1/reproducible_research/2.1/AMI.test.rttm) | [eval](https://huggingface.co/pyannote/speaker-diarization/blob/2.1/reproducible_research/2.1/AMI.test.eval) |
96
+ | [AMI (*array1, channel 1,*](https://groups.inf.ed.ac.uk/ami/corpus/) [*only_words)*](https://github.com/BUTSpeechFIT/AMI-diarization-setup) | 27.12 | 4.11 | 17.78 | 5.23 | [RTTM](https://huggingface.co/pyannote/speaker-diarization/blob/2.1/reproducible_research/2.1/AMI-SDM.test.rttm) | [eval](https://huggingface.co/pyannote/speaker-diarization/blob/2.1/reproducible_research/2.1/AMI-SDM.test.eval) |
97
+ | [CALLHOME](https://catalog.ldc.upenn.edu/LDC2001S97) [(*part2*)](https://github.com/BUTSpeechFIT/CALLHOME_sublists/issues/1) | 32.37 | 6.30 | 13.72 | 12.35 | [RTTM](https://huggingface.co/pyannote/speaker-diarization/blob/2.1/reproducible_research/2.1/CALLHOME.test.rttm) | [eval](https://huggingface.co/pyannote/speaker-diarization/blob/2.1/reproducible_research/2.1/CALLHOME.test.eval) |
98
+ | [DIHARD 3 (*Full*)](https://arxiv.org/abs/2012.01477) | 26.94 | 10.50 | 8.41 | 8.03 | [RTTM](https://huggingface.co/pyannote/speaker-diarization/blob/2.1/reproducible_research/2.1/DIHARD.test.rttm) | [eval](https://huggingface.co/pyannote/speaker-diarization/blob/2.1/reproducible_research/2.1/DIHARD.test.eval) |
99
+ | [Ego4D *v1 (validation)*](https://arxiv.org/abs/2110.07058) | 63.99 | 3.91 | 44.42 | 15.67 | [RTTM](https://huggingface.co/pyannote/speaker-diarization/blob/2.1/reproducible_research/2.1/Ego4D.development.rttm) | [eval](https://huggingface.co/pyannote/speaker-diarization/blob/2.1/reproducible_research/2.1/Ego4D.development.eval) |
100
+ | [REPERE (*phase 2*)](https://islrn.org/resources/360-758-359-485-0/) | 8.17 | 2.23 | 2.49 | 3.45 | [RTTM](https://huggingface.co/pyannote/speaker-diarization/blob/2.1/reproducible_research/2.1/REPERE.test.rttm) | [eval](https://huggingface.co/pyannote/speaker-diarization/blob/2.1/reproducible_research/2.1/REPERE.test.eval) |
101
+ | [This American Life](https://arxiv.org/abs/2005.08072) | 20.82 | 2.03 | 11.89 | 6.90 | [RTTM](https://huggingface.co/pyannote/speaker-diarization/blob/2.1/reproducible_research/2.1/ThisAmericanLife.test.rttm) | [eval](https://huggingface.co/pyannote/speaker-diarization/blob/2.1/reproducible_research/2.1/ThisAmericanLife.test.eval) |
102
+ | [VoxConverse (*v0.3*)](https://github.com/joonson/voxconverse) | 11.24 | 4.42 | 2.88 | 3.94 | [RTTM](https://huggingface.co/pyannote/speaker-diarization/blob/main/reproducible_research/2.1/VoxConverse.test.rttm) | [eval](https://huggingface.co/pyannote/speaker-diarization/blob/main/reproducible_research/2.1/VoxConverse.test.eval) |
103
+
104
+ ## Technical report
105
+
106
+ This [report](technical_report_2.1.pdf) describes the main principles behind version `2.1` of pyannote.audio speaker diarization pipeline.
107
+ It also provides recipes explaining how to adapt the pipeline to your own set of annotated data. In particular, those are applied to the above benchmark and consistently leads to significant performance improvement over the above out-of-the-box performance.
108
+
109
 
110
  ## Support
111
 
config.yaml CHANGED
@@ -1,20 +1,18 @@
1
  pipeline:
2
  name: pyannote.audio.pipelines.SpeakerDiarization
3
  params:
4
- segmentation: pyannote/segmentation@2022.07
5
- segmentation_step: 0.1
6
- segmentation_batch_size: 32
7
- # embedding: speechbrain/spkrec-ecapa-voxceleb@5c0be3875fda05e81f3c004ed8c7c06be308de1e
8
  embedding: speechbrain/spkrec-ecapa-voxceleb
9
- embedding_exclude_overlap: True
10
  embedding_batch_size: 32
11
- clustering: HiddenMarkovModelClustering
 
 
12
 
13
  params:
14
- segmentation_onset: 0.58
15
  clustering:
16
- covariance_type: diag
17
- threshold: 0.35
18
- single_cluster_detection:
19
- quantile: 0.05
20
- threshold: 1.15
 
 
1
  pipeline:
2
  name: pyannote.audio.pipelines.SpeakerDiarization
3
  params:
4
+ clustering: AgglomerativeClustering
 
 
 
5
  embedding: speechbrain/spkrec-ecapa-voxceleb
 
6
  embedding_batch_size: 32
7
+ embedding_exclude_overlap: true
8
+ segmentation: pyannote/segmentation@2022.07
9
+ segmentation_batch_size: 32
10
 
11
  params:
 
12
  clustering:
13
+ method: centroid
14
+ min_cluster_size: 15
15
+ threshold: 0.7153814381597874
16
+ segmentation:
17
+ min_duration_off: 0.5817029604921046
18
+ threshold: 0.4442333667381752
reproducible_research/{2022.07 → 2.0.1}/AISHELL.SpeakerDiarization.Full.test.eval RENAMED
File without changes
reproducible_research/{2022.07 → 2.0.1}/AISHELL.SpeakerDiarization.Full.test.rttm RENAMED
File without changes
reproducible_research/{2022.07 → 2.0.1}/AMI-SDM.SpeakerDiarization.only_words.test.eval RENAMED
File without changes
reproducible_research/{2022.07 → 2.0.1}/AMI-SDM.SpeakerDiarization.only_words.test.rttm RENAMED
File without changes
reproducible_research/{2022.07 → 2.0.1}/AMI.SpeakerDiarization.only_words.test.eval RENAMED
File without changes
reproducible_research/{2022.07 → 2.0.1}/AMI.SpeakerDiarization.only_words.test.rttm RENAMED
File without changes
reproducible_research/{2022.07 → 2.0.1}/CALLHOME.SpeakerDiarization.CALLHOME.test.eval RENAMED
File without changes
reproducible_research/{2022.07 → 2.0.1}/CALLHOME.SpeakerDiarization.CALLHOME.test.rttm RENAMED
File without changes
reproducible_research/{2022.07 → 2.0.1}/DIHARD.SpeakerDiarization.Full.test.eval RENAMED
File without changes
reproducible_research/{2022.07 → 2.0.1}/DIHARD.SpeakerDiarization.Full.test.rttm RENAMED
File without changes
reproducible_research/{2022.07 → 2.0.1}/REPERE.SpeakerDiarization.Full.test.eval RENAMED
File without changes
reproducible_research/{2022.07 → 2.0.1}/REPERE.SpeakerDiarization.Full.test.rttm RENAMED
File without changes
reproducible_research/{2022.07 → 2.0.1}/VoxConverse.SpeakerDiarization.VoxConverse.test.eval RENAMED
File without changes
reproducible_research/{2022.07 → 2.0.1}/VoxConverse.SpeakerDiarization.VoxConverse.test.rttm RENAMED
File without changes
reproducible_research/2.1/.DS_Store ADDED
Binary file (6.15 kB). View file
 
reproducible_research/2.1/AISHELL.test.eval ADDED
@@ -0,0 +1,24 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ diarization error rate total correct correct false alarm false alarm missed detection missed detection confusion confusion
2
+ % % % % %
3
+ item
4
+ L_R003S01C02 18.19 2311.97 2043.93 88.41 152.60 6.60 112.93 4.88 155.11 6.71
5
+ L_R003S02C02 10.87 2036.79 1904.97 93.53 89.53 4.40 67.31 3.30 64.50 3.17
6
+ L_R003S03C02 17.38 2376.45 2072.84 87.22 109.50 4.61 167.09 7.03 136.52 5.74
7
+ L_R003S04C02 17.87 2011.85 1806.03 89.77 153.63 7.64 51.53 2.56 154.29 7.67
8
+ L_R004S01C01 11.15 2041.84 1905.80 93.34 91.58 4.49 43.15 2.11 92.89 4.55
9
+ L_R004S02C01 16.23 2204.89 1976.40 89.64 129.31 5.86 41.09 1.86 187.40 8.50
10
+ L_R004S03C01 12.82 2314.18 2119.30 91.58 101.77 4.40 67.27 2.91 127.61 5.51
11
+ L_R004S06C01 9.23 2029.95 1892.13 93.21 49.57 2.44 14.27 0.70 123.55 6.09
12
+ M_R003S01C01 16.13 2191.47 1951.15 89.03 113.07 5.16 102.65 4.68 137.67 6.28
13
+ M_R003S02C01 12.78 2376.79 2135.06 89.83 62.04 2.61 169.82 7.14 71.91 3.03
14
+ M_R003S04C01 30.41 2015.63 1651.43 81.93 248.71 12.34 75.25 3.73 288.95 14.34
15
+ M_R003S05C01 35.14 2249.68 1656.76 73.64 197.54 8.78 102.98 4.58 489.94 21.78
16
+ S_R003S01C01 12.41 2127.86 1999.33 93.96 135.47 6.37 58.06 2.73 70.47 3.31
17
+ S_R003S02C01 11.58 2222.87 2087.55 93.91 122.17 5.50 44.47 2.00 90.85 4.09
18
+ S_R003S03C01 12.47 2071.12 1973.41 95.28 160.65 7.76 48.98 2.36 48.74 2.35
19
+ S_R003S04C01 16.71 2615.78 2295.79 87.77 117.13 4.48 179.47 6.86 140.52 5.37
20
+ S_R004S01C01 4.53 2117.91 2068.49 97.67 46.62 2.20 40.37 1.91 9.04 0.43
21
+ S_R004S02C01 5.21 2095.08 2043.77 97.55 57.82 2.76 18.99 0.91 32.32 1.54
22
+ S_R004S03C01 2.31 2074.39 2059.73 99.29 33.28 1.60 13.53 0.65 1.13 0.05
23
+ S_R004S04C01 5.94 2078.85 2035.55 97.92 80.28 3.86 5.27 0.25 38.03 1.83
24
+ TOTAL 14.09 43565.36 39679.41 91.08 2252.28 5.17 1424.51 3.27 2461.43 5.65
reproducible_research/2.1/AISHELL.test.rttm ADDED
The diff for this file is too large to render. See raw diff
 
reproducible_research/2.1/AMI-SDM.test.eval ADDED
@@ -0,0 +1,20 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ diarization error rate total correct correct false alarm false alarm missed detection missed detection confusion confusion
2
+ % % % % %
3
+ item
4
+ IS1009a 23.79 695.90 568.35 81.67 37.99 5.46 84.38 12.13 43.16 6.20
5
+ IS1009b 13.68 1982.97 1775.53 89.54 63.76 3.22 139.11 7.02 68.33 3.45
6
+ IS1009c 11.41 1584.45 1464.80 92.45 61.13 3.86 64.70 4.08 54.95 3.47
7
+ IS1009d 23.54 1738.60 1405.30 80.83 76.01 4.37 190.78 10.97 142.52 8.20
8
+ ES2004a 36.34 923.43 628.50 68.06 40.66 4.40 182.52 19.77 112.41 12.17
9
+ ES2004b 18.81 2233.05 1905.52 85.33 92.57 4.15 251.38 11.26 76.14 3.41
10
+ ES2004c 17.48 2244.47 1945.90 86.70 93.84 4.18 232.54 10.36 66.02 2.94
11
+ ES2004d 37.87 2006.77 1336.87 66.62 90.15 4.49 547.00 27.26 122.90 6.12
12
+ TS3003a 41.42 1025.96 625.94 61.01 24.96 2.43 363.84 35.46 36.18 3.53
13
+ TS3003b 21.03 1820.50 1509.79 82.93 72.14 3.96 257.27 14.13 53.44 2.94
14
+ TS3003c 24.19 1894.25 1486.22 78.46 50.27 2.65 357.02 18.85 51.01 2.69
15
+ TS3003d 37.42 2070.34 1365.41 65.95 69.69 3.37 599.83 28.97 105.10 5.08
16
+ EN2002a 32.93 2530.26 1811.53 71.59 114.47 4.52 556.33 21.99 162.40 6.42
17
+ EN2002b 31.06 1943.44 1445.79 74.39 105.92 5.45 371.81 19.13 125.84 6.47
18
+ EN2002c 26.39 3343.64 2605.00 77.91 143.81 4.30 605.21 18.10 133.43 3.99
19
+ EN2002d 38.69 2675.89 1766.29 66.01 125.79 4.70 657.55 24.57 252.05 9.42
20
+ TOTAL 27.12 30713.92 23646.75 76.99 1263.15 4.11 5461.29 17.78 1605.89 5.23
reproducible_research/2.1/AMI-SDM.test.rttm ADDED
The diff for this file is too large to render. See raw diff
 
reproducible_research/2.1/AMI.test.eval ADDED
@@ -0,0 +1,20 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ diarization error rate total correct correct false alarm false alarm missed detection missed detection confusion confusion
2
+ % % % % %
3
+ item
4
+ IS1009a 22.11 695.90 584.38 83.97 42.35 6.09 61.03 8.77 50.49 7.26
5
+ IS1009b 12.09 1982.97 1798.10 90.68 54.83 2.77 131.84 6.65 53.03 2.67
6
+ IS1009c 9.71 1584.45 1505.70 95.03 75.07 4.74 50.59 3.19 28.16 1.78
7
+ IS1009d 20.95 1738.60 1456.27 83.76 81.88 4.71 136.40 7.85 145.93 8.39
8
+ ES2004a 18.90 923.43 782.69 84.76 33.78 3.66 116.65 12.63 24.08 2.61
9
+ ES2004b 12.27 2233.05 2049.39 91.78 90.25 4.04 141.63 6.34 42.03 1.88
10
+ ES2004c 14.44 2244.47 2037.13 90.76 116.84 5.21 115.74 5.16 91.60 4.08
11
+ ES2004d 19.41 2006.77 1754.30 87.42 137.10 6.83 177.99 8.87 74.48 3.71
12
+ TS3003a 19.27 1025.96 864.60 84.27 36.33 3.54 115.10 11.22 46.26 4.51
13
+ TS3003b 12.04 1820.50 1716.21 94.27 114.85 6.31 83.22 4.57 21.08 1.16
14
+ TS3003c 14.18 1894.25 1724.95 91.06 99.29 5.24 142.28 7.51 27.02 1.43
15
+ TS3003d 22.77 2070.34 1719.40 83.05 120.48 5.82 268.64 12.98 82.31 3.98
16
+ EN2002a 27.22 2530.26 1960.92 77.50 119.37 4.72 332.28 13.13 237.06 9.37
17
+ EN2002b 23.73 1943.44 1565.31 80.54 83.11 4.28 223.20 11.49 154.92 7.97
18
+ EN2002c 21.74 3343.64 2683.44 80.25 66.73 2.00 404.48 12.10 255.72 7.65
19
+ EN2002d 26.18 2675.89 2079.99 77.73 104.76 3.91 421.29 15.74 174.61 6.53
20
+ TOTAL 18.91 30713.92 26282.79 85.57 1377.02 4.48 2922.35 9.51 1508.78 4.91
reproducible_research/2.1/AMI.test.rttm ADDED
The diff for this file is too large to render. See raw diff
 
reproducible_research/2.1/Albayzin2020.test.eval ADDED
@@ -0,0 +1,58 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ diarization error rate total correct correct false alarm false alarm missed detection missed detection confusion confusion
2
+ % % % % %
3
+ item
4
+ AT-20180422 20.31 1443.11 1237.82 85.77 87.75 6.08 29.35 2.03 175.94 12.19
5
+ AT-20180627 12.87 1698.89 1569.06 92.36 88.82 5.23 21.31 1.25 108.53 6.39
6
+ AT-20180829 15.10 1595.45 1419.71 88.98 65.10 4.08 63.89 4.00 111.85 7.01
7
+ AT-20180920 19.98 1591.64 1342.38 84.34 68.80 4.32 63.37 3.98 185.89 11.68
8
+ AT-20181010 14.05 1523.45 1353.08 88.82 43.66 2.87 40.90 2.68 129.46 8.50
9
+ AT-20181111 21.46 1612.05 1339.32 83.08 73.29 4.55 72.90 4.52 199.83 12.40
10
+ AT-20190113 27.90 1660.90 1245.65 75.00 48.13 2.90 177.75 10.70 237.51 14.30
11
+ AT-20190122 21.03 1581.73 1346.72 85.14 97.57 6.17 54.81 3.47 180.20 11.39
12
+ AT-20190213 12.36 1628.46 1477.18 90.71 50.01 3.07 57.99 3.56 93.29 5.73
13
+ AT-20190226 13.44 1545.47 1411.40 91.32 73.67 4.77 53.98 3.49 80.09 5.18
14
+ AT-20190319 21.48 1456.14 1225.00 84.13 81.65 5.61 46.49 3.19 184.65 12.68
15
+ AT-20190419 14.00 1442.37 1308.52 90.72 68.11 4.72 30.02 2.08 103.83 7.20
16
+ AT-20190515 17.49 1483.20 1308.07 88.19 84.25 5.68 52.21 3.52 122.92 8.29
17
+ AT-20190520 20.04 1378.89 1211.52 87.86 108.94 7.90 26.11 1.89 141.27 10.25
18
+ AT-20190626 16.90 1513.04 1339.11 88.50 81.71 5.40 23.50 1.55 150.43 9.94
19
+ AT-20190701 21.08 1518.81 1309.25 86.20 110.64 7.28 51.51 3.39 158.04 10.41
20
+ AT-20190811 26.57 1553.09 1264.69 81.43 124.26 8.00 43.02 2.77 245.38 15.80
21
+ AT-20190819 18.90 1557.31 1362.70 87.50 99.74 6.40 37.74 2.42 156.87 10.07
22
+ AT-20190901 14.69 692.80 639.77 92.35 48.73 7.03 10.29 1.49 42.74 6.17
23
+ AT-20190902 22.53 1468.11 1268.90 86.43 131.51 8.96 33.28 2.27 165.93 11.30
24
+ AT-20190903 22.95 1466.98 1247.65 85.05 117.27 7.99 32.73 2.23 186.60 12.72
25
+ AT-20190904 24.47 1393.56 1223.86 87.82 171.29 12.29 12.63 0.91 157.07 11.27
26
+ BN-C1 85.23 524.48 289.94 55.28 212.46 40.51 38.67 7.37 195.87 37.35
27
+ BN-C2 46.77 481.25 354.74 73.71 98.59 20.49 32.39 6.73 94.12 19.56
28
+ BN-C3 57.63 511.02 300.40 58.78 83.90 16.42 112.30 21.98 98.31 19.24
29
+ BR-C1 39.59 772.77 522.75 67.65 55.94 7.24 133.36 17.26 116.67 15.10
30
+ BR-C2 29.02 467.65 367.07 78.49 35.12 7.51 76.58 16.38 24.00 5.13
31
+ BR-C3 62.86 485.92 278.92 57.40 98.48 20.27 68.03 14.00 138.96 28.60
32
+ CA-20181022 27.98 3210.26 2574.81 80.21 262.80 8.19 157.86 4.92 477.59 14.88
33
+ CA-20190218 35.67 3325.42 2583.79 77.70 444.43 13.36 128.21 3.86 613.42 18.45
34
+ CA-20190403 13.85 3206.30 2896.77 90.35 134.48 4.19 50.24 1.57 259.29 8.09
35
+ CA-20190730 42.20 2565.28 1972.38 76.89 489.77 19.09 116.87 4.56 476.02 18.56
36
+ EP-20190228 15.61 1704.49 1505.98 88.35 67.48 3.96 100.31 5.89 98.20 5.76
37
+ EP-20190301 28.25 1666.53 1264.95 75.90 69.13 4.15 150.94 9.06 250.64 15.04
38
+ EP-20190304 32.44 1740.02 1251.36 71.92 75.78 4.35 157.00 9.02 331.66 19.06
39
+ EP-20190305 13.88 1858.68 1632.25 87.82 31.59 1.70 152.02 8.18 74.40 4.00
40
+ LD-20190225 2.61 5250.47 5161.73 98.31 48.26 0.92 38.45 0.73 50.29 0.96
41
+ LD-20190228 6.78 5627.48 5361.60 95.28 115.60 2.05 65.63 1.17 200.26 3.56
42
+ LD-20190304 5.69 5876.90 5605.31 95.38 62.90 1.07 115.90 1.97 155.69 2.65
43
+ LD-20190305 2.08 5582.35 5521.72 98.91 55.32 0.99 36.47 0.65 24.16 0.43
44
+ LD-20190627 2.55 5661.08 5581.39 98.59 64.60 1.14 36.60 0.65 43.10 0.76
45
+ LD-20190704 3.12 5637.65 5537.47 98.22 75.67 1.34 44.91 0.80 55.27 0.98
46
+ LD-20190708 3.66 5259.01 5165.52 98.22 99.24 1.89 38.29 0.73 55.20 1.05
47
+ ML-20190212 5.76 3497.92 3371.27 96.38 74.76 2.14 89.29 2.55 37.37 1.07
48
+ ML-20190226 10.65 3602.43 3318.91 92.13 100.18 2.78 147.60 4.10 135.92 3.77
49
+ NFMY-IAS 33.47 159.19 116.15 72.96 10.24 6.43 5.88 3.69 37.16 23.34
50
+ NFMY-KB 52.45 123.49 81.20 65.76 22.48 18.20 2.95 2.39 39.33 31.85
51
+ NFMY-VVNB 70.70 101.74 43.73 42.98 13.92 13.68 11.64 11.44 46.37 45.58
52
+ SFT-C1 79.75 238.91 133.63 55.93 85.24 35.68 35.37 14.81 69.91 29.26
53
+ SFT-C2 61.38 175.79 100.86 57.37 32.96 18.75 24.81 14.12 50.12 28.51
54
+ SFT-C3 61.17 150.00 77.26 51.51 19.02 12.68 21.30 14.20 51.45 34.30
55
+ WU-C1 46.80 523.56 322.58 61.61 44.05 8.41 111.06 21.21 89.92 17.17
56
+ WU-C2 55.76 296.30 161.65 54.55 30.56 10.32 55.26 18.65 79.39 26.79
57
+ WU-C3 67.50 468.25 192.33 41.07 40.13 8.57 184.16 39.33 91.76 19.60
58
+ TOTAL 15.97 103558.06 92101.74 88.94 5079.99 4.91 3576.17 3.45 7880.14 7.61
reproducible_research/2.1/Albayzin2020.test.rttm ADDED
The diff for this file is too large to render. See raw diff
 
reproducible_research/2.1/AliMeeting.test.eval ADDED
@@ -0,0 +1,24 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ diarization error rate total correct correct false alarm false alarm missed detection missed detection confusion confusion
2
+ % % % % %
3
+ item
4
+ R8006_M8012_MS803 30.08 2374.64 1818.10 76.56 157.83 6.65 372.80 15.70 183.73 7.74
5
+ R8009_M8027_MS812 13.62 1652.94 1594.44 96.46 166.58 10.08 37.81 2.29 20.69 1.25
6
+ R8004_M8005_MS803 25.66 2697.40 2159.37 80.05 154.12 5.71 305.06 11.31 232.96 8.64
7
+ R8009_M8022_MS810 10.58 2034.76 1880.57 92.42 61.06 3.00 141.26 6.94 12.94 0.64
8
+ R8005_M8007_MS806 44.54 3057.11 1816.54 59.42 121.07 3.96 703.54 23.01 537.03 17.57
9
+ R8002_M8003_MS803 44.88 2595.42 1510.21 58.19 79.64 3.07 593.84 22.88 491.37 18.93
10
+ R8008_M8017_MS808 13.25 1633.16 1514.30 92.72 97.53 5.97 90.66 5.55 28.20 1.73
11
+ R8009_M8026_MS812 11.01 1866.82 1722.11 92.25 60.89 3.26 112.92 6.05 31.79 1.70
12
+ R8005_M8008_MS806 25.14 2427.19 1967.34 81.05 150.30 6.19 259.65 10.70 200.20 8.25
13
+ R8008_M8015_MS808 19.56 1935.73 1691.37 87.38 134.32 6.94 166.12 8.58 78.23 4.04
14
+ R8009_M8024_MS811 9.58 1605.00 1558.35 97.09 107.17 6.68 44.35 2.76 2.31 0.14
15
+ R8004_M8006_MS805 46.83 3680.99 2050.74 55.71 93.62 2.54 1166.78 31.70 463.47 12.59
16
+ R8009_M8025_MS811 31.82 2094.46 1494.21 71.34 66.25 3.16 110.67 5.28 489.58 23.38
17
+ R8008_M8016_MS808 50.00 1860.44 1073.78 57.72 143.63 7.72 139.20 7.48 647.46 34.80
18
+ R8002_M8002_MS802 24.21 2504.37 1984.19 79.23 86.09 3.44 390.09 15.58 130.09 5.19
19
+ R8009_M8023_MS811 11.26 1789.93 1673.72 93.51 85.40 4.77 97.46 5.44 18.75 1.05
20
+ R8009_M8028_MS812 7.53 1833.49 1750.74 95.49 55.27 3.01 77.06 4.20 5.70 0.31
21
+ R8008_M8014_MS807 14.31 2034.08 1864.20 91.65 121.27 5.96 125.37 6.16 44.50 2.19
22
+ R8005_M8009_MS802 42.46 3344.16 2009.47 60.09 85.26 2.55 1184.00 35.41 150.69 4.51
23
+ R8009_M8021_MS810 20.87 1818.69 1583.25 87.05 144.18 7.93 158.06 8.69 77.38 4.25
24
+ TOTAL 27.42 44840.78 34717.00 77.42 2171.47 4.84 6276.71 14.00 3847.08 8.58
reproducible_research/2.1/AliMeeting.test.rttm ADDED
The diff for this file is too large to render. See raw diff
 
reproducible_research/2.1/CALLHOME.test.eval ADDED
@@ -0,0 +1,254 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ diarization error rate total correct correct false alarm false alarm missed detection missed detection confusion confusion
2
+ % % % % %
3
+ item
4
+ iaab 58.29 43.87 27.22 62.05 8.92 20.34 3.30 7.52 13.35 30.44
5
+ iaad 14.18 335.25 298.60 89.07 10.91 3.25 31.07 9.27 5.58 1.66
6
+ iaae 38.39 105.89 69.99 66.10 4.76 4.49 23.06 21.78 12.83 12.12
7
+ iaaf 25.58 70.37 56.76 80.67 4.40 6.25 9.26 13.16 4.35 6.18
8
+ iaag 46.08 117.45 77.94 66.36 14.62 12.45 22.56 19.21 16.94 14.42
9
+ iaai 19.71 82.64 68.36 82.71 2.00 2.42 11.32 13.70 2.97 3.59
10
+ iaaj 28.72 244.04 180.34 73.90 6.38 2.62 51.31 21.03 12.38 5.07
11
+ iaam 27.26 61.21 50.21 82.02 5.68 9.28 4.18 6.83 6.82 11.15
12
+ iaap 45.21 104.70 66.03 63.07 8.67 8.28 15.11 14.43 23.56 22.51
13
+ iaaq 21.36 61.28 49.27 80.40 1.07 1.75 7.09 11.57 4.92 8.03
14
+ iaar 38.30 115.40 98.61 85.45 27.41 23.75 9.85 8.53 6.94 6.01
15
+ iaas 20.46 209.43 170.11 81.22 3.53 1.69 25.03 11.95 14.29 6.83
16
+ iaaw 14.75 72.48 64.55 89.07 2.76 3.81 7.26 10.01 0.67 0.92
17
+ iaay 53.58 61.04 33.03 54.12 4.70 7.70 11.61 19.01 16.40 26.87
18
+ iaaz 45.73 107.98 60.63 56.15 2.03 1.88 28.96 26.82 18.39 17.03
19
+ iaba 31.59 455.81 332.27 72.90 20.46 4.49 95.87 21.03 27.67 6.07
20
+ iabe 23.12 90.45 75.12 83.05 5.59 6.18 13.15 14.53 2.18 2.41
21
+ iabg 16.94 83.78 75.43 90.03 5.84 6.97 6.73 8.03 1.62 1.94
22
+ iabj 7.15 119.05 113.87 95.65 3.33 2.79 4.64 3.90 0.54 0.46
23
+ iabo 59.63 59.73 30.53 51.11 6.41 10.74 8.52 14.26 20.69 34.64
24
+ iabp 21.79 57.68 47.60 82.52 2.48 4.31 5.49 9.51 4.59 7.97
25
+ iabt 39.98 75.10 46.98 62.55 1.90 2.53 14.61 19.46 13.51 17.99
26
+ iabv 34.76 84.94 56.38 66.37 0.96 1.13 14.22 16.74 14.35 16.89
27
+ iabw 17.31 65.73 59.06 89.86 4.71 7.16 3.19 4.85 3.48 5.29
28
+ iaby 17.82 86.85 79.35 91.36 7.98 9.19 6.32 7.27 1.18 1.36
29
+ iaca 32.91 89.41 63.13 70.60 3.14 3.52 18.27 20.43 8.01 8.96
30
+ iacb 28.30 95.49 77.39 81.05 8.92 9.34 10.77 11.28 7.33 7.67
31
+ iacd 56.71 54.95 26.30 47.86 2.51 4.57 9.44 17.17 19.21 34.96
32
+ iacf 50.48 311.34 166.33 53.42 12.16 3.91 48.88 15.70 96.13 30.88
33
+ iacg 39.75 581.46 426.83 73.41 76.51 13.16 55.39 9.53 99.23 17.07
34
+ iach 19.98 71.90 62.71 87.22 5.18 7.20 7.30 10.15 1.89 2.63
35
+ iacj 29.06 111.14 84.71 76.22 5.87 5.28 17.50 15.75 8.93 8.04
36
+ iacl 13.81 72.09 67.93 94.23 5.79 8.04 3.35 4.64 0.81 1.12
37
+ iacp 53.45 78.87 39.95 50.65 3.23 4.10 14.32 18.15 24.60 31.19
38
+ iact 26.29 77.53 60.34 77.83 3.19 4.12 16.57 21.37 0.62 0.80
39
+ iacu 48.78 67.00 36.58 54.60 2.27 3.39 12.91 19.26 17.51 26.13
40
+ iacv 37.82 67.96 46.67 68.68 4.41 6.50 7.14 10.50 14.15 20.82
41
+ iacw 10.48 63.90 61.86 96.81 4.66 7.29 2.04 3.19 0.00 0.00
42
+ iacy 29.65 50.91 40.88 80.30 5.06 9.94 5.73 11.26 4.30 8.44
43
+ iacz 32.32 96.50 66.39 68.80 1.07 1.11 15.76 16.33 14.35 14.87
44
+ iadb 49.97 44.38 27.12 61.11 4.92 11.08 4.49 10.12 12.77 28.77
45
+ iadc 20.77 90.45 73.90 81.70 2.23 2.47 15.14 16.74 1.41 1.56
46
+ iadd 30.22 55.02 43.18 78.48 4.79 8.71 3.85 7.00 7.99 14.51
47
+ iade 30.60 73.40 56.23 76.61 5.29 7.21 7.56 10.31 9.60 13.08
48
+ iadf 53.81 64.65 35.67 55.17 5.80 8.98 9.75 15.09 19.23 29.74
49
+ iadh 18.39 390.43 331.41 84.88 12.79 3.28 52.83 13.53 6.19 1.59
50
+ iadi 16.01 77.85 69.60 89.40 4.21 5.41 6.35 8.15 1.91 2.45
51
+ iadl 49.03 57.93 35.93 62.03 6.41 11.06 9.46 16.33 12.54 21.65
52
+ iadn 16.76 56.48 49.66 87.92 2.64 4.67 4.65 8.23 2.18 3.86
53
+ iado 26.96 70.46 54.94 77.97 3.48 4.94 7.67 10.89 7.85 11.14
54
+ iadp 41.51 56.41 44.78 79.38 11.79 20.89 2.45 4.35 9.18 16.27
55
+ iadr 25.71 276.34 217.01 78.53 11.73 4.25 45.90 16.61 13.43 4.86
56
+ iads 45.35 83.44 48.34 57.93 2.74 3.28 9.13 10.94 25.98 31.13
57
+ iadv 28.10 67.11 49.80 74.20 1.54 2.30 15.26 22.74 2.05 3.06
58
+ iadw 17.20 66.43 61.71 92.90 6.71 10.10 3.33 5.01 1.39 2.09
59
+ iaea 20.17 96.69 84.70 87.60 7.51 7.77 8.33 8.62 3.66 3.78
60
+ iaec 51.54 135.03 71.66 53.07 6.22 4.61 30.30 22.44 33.07 24.49
61
+ iaeg 23.45 56.94 49.11 86.25 5.52 9.69 6.33 11.12 1.50 2.63
62
+ iaeh 17.51 65.21 59.91 91.87 6.12 9.39 3.53 5.41 1.77 2.72
63
+ iaej 10.18 57.45 55.21 96.09 3.60 6.27 1.45 2.52 0.80 1.38
64
+ iaem 40.35 57.13 38.66 67.67 4.58 8.03 5.69 9.96 12.78 22.37
65
+ iaeo 18.92 56.20 48.29 85.93 2.73 4.85 7.32 13.03 0.58 1.04
66
+ iaeq 31.98 151.02 118.31 78.34 15.59 10.32 6.67 4.42 26.04 17.24
67
+ iaer 22.13 192.23 151.45 78.79 1.77 0.92 38.32 19.94 2.46 1.28
68
+ iaev 16.08 71.39 63.78 89.34 3.87 5.42 4.97 6.97 2.64 3.70
69
+ iaew 33.87 57.23 44.64 78.00 6.79 11.87 3.41 5.95 9.19 16.05
70
+ iaey 22.40 71.81 66.09 92.04 10.37 14.44 4.02 5.59 1.70 2.37
71
+ iaez 39.21 141.98 97.78 68.87 11.48 8.08 15.99 11.26 28.21 19.87
72
+ iafa 34.37 57.79 41.60 71.98 3.67 6.36 6.64 11.49 9.55 16.53
73
+ iafc 19.54 88.38 78.01 88.27 6.90 7.80 6.18 6.99 4.19 4.75
74
+ iafd 19.72 62.12 52.75 84.92 2.88 4.64 7.71 12.41 1.66 2.67
75
+ iafe 36.11 283.67 202.81 71.50 21.58 7.61 59.01 20.80 21.85 7.70
76
+ iafg 35.75 74.02 49.55 66.94 1.99 2.69 12.39 16.74 12.08 16.31
77
+ iafh 70.10 109.81 62.15 56.60 29.32 26.70 11.67 10.63 35.99 32.77
78
+ iafi 26.05 74.67 58.79 78.73 3.58 4.79 10.88 14.57 5.00 6.69
79
+ iafl 29.30 86.42 61.21 70.83 0.12 0.14 18.80 21.76 6.40 7.41
80
+ iafm 20.65 58.24 51.56 88.53 5.35 9.19 2.06 3.54 4.62 7.92
81
+ iafn 37.08 367.71 247.96 67.43 16.59 4.51 84.29 22.92 35.46 9.64
82
+ iafp 31.02 298.85 235.51 78.81 29.35 9.82 26.81 8.97 36.53 12.22
83
+ iafr 24.48 122.14 112.70 92.27 20.46 16.75 6.28 5.14 3.17 2.59
84
+ iafs 44.06 111.66 76.13 68.18 13.68 12.25 15.17 13.59 20.35 18.23
85
+ iaft 24.36 65.79 53.13 80.75 3.37 5.12 8.19 12.44 4.48 6.80
86
+ iafu 43.25 85.37 54.09 63.36 5.64 6.61 14.85 17.40 16.43 19.24
87
+ iafv 18.06 88.81 74.04 83.37 1.27 1.43 9.30 10.47 5.47 6.16
88
+ iafw 52.17 64.51 33.92 52.57 3.06 4.75 13.89 21.54 16.70 25.89
89
+ iafx 44.09 130.12 75.28 57.86 2.53 1.95 25.41 19.53 29.42 22.61
90
+ iafy 11.55 65.16 59.19 90.84 1.56 2.39 5.95 9.13 0.02 0.03
91
+ iaga 39.30 86.82 56.73 65.34 4.03 4.64 19.00 21.88 11.09 12.78
92
+ iagc 53.01 631.63 325.65 51.56 28.88 4.57 163.23 25.84 142.74 22.60
93
+ iagd 27.68 70.09 54.62 77.93 3.93 5.61 7.67 10.94 7.80 11.13
94
+ iagf 20.90 54.83 49.36 90.02 5.99 10.92 2.43 4.43 3.04 5.55
95
+ iagg 18.08 338.28 311.22 92.00 34.09 10.08 12.96 3.83 14.10 4.17
96
+ iagj 32.97 388.50 281.64 72.49 21.22 5.46 83.12 21.40 23.74 6.11
97
+ iagk 47.87 85.67 47.39 55.32 2.73 3.19 7.97 9.31 30.31 35.38
98
+ iagl 40.04 61.26 45.06 73.55 8.33 13.59 6.02 9.82 10.19 16.63
99
+ iago 8.74 67.12 62.74 93.47 1.48 2.21 2.59 3.86 1.79 2.67
100
+ iagq 54.26 60.02 32.64 54.38 5.19 8.64 10.82 18.03 16.56 27.59
101
+ iagv 24.60 286.20 226.25 79.05 10.45 3.65 40.73 14.23 19.22 6.72
102
+ iagx 55.56 383.32 184.98 48.26 14.65 3.82 61.88 16.14 136.46 35.60
103
+ iagy 58.16 338.66 165.53 48.88 23.84 7.04 56.57 16.70 116.56 34.42
104
+ iaha 40.25 67.80 43.17 63.67 2.66 3.92 14.18 20.91 10.46 15.42
105
+ iahb 32.23 457.31 344.82 75.40 34.92 7.64 45.73 10.00 66.76 14.60
106
+ iahc 20.58 106.42 85.49 80.33 0.98 0.92 13.67 12.85 7.26 6.82
107
+ iahe 12.04 315.58 294.10 93.19 16.51 5.23 18.94 6.00 2.54 0.80
108
+ iahh 32.40 67.10 50.19 74.80 4.83 7.20 6.98 10.40 9.93 14.80
109
+ iahk 22.50 253.63 209.13 82.45 12.57 4.95 22.61 8.91 21.90 8.63
110
+ iahl 38.97 52.35 39.80 76.03 7.85 15.00 3.13 5.98 9.42 17.99
111
+ iahm 29.83 65.43 48.87 74.69 2.96 4.52 10.69 16.34 5.86 8.96
112
+ iahn 17.77 123.21 115.39 93.66 14.08 11.42 6.47 5.25 1.35 1.09
113
+ iaht 13.91 61.02 58.00 95.06 5.47 8.96 2.75 4.51 0.27 0.44
114
+ iahx 33.06 76.43 52.95 69.28 1.79 2.34 13.91 18.20 9.57 12.52
115
+ iahz 17.06 86.79 74.67 86.04 2.69 3.10 5.73 6.60 6.39 7.36
116
+ iaic 16.62 54.84 48.31 88.10 2.58 4.71 5.52 10.06 1.01 1.84
117
+ iaif 33.74 373.38 267.84 71.73 20.44 5.47 36.46 9.76 69.08 18.50
118
+ iaih 37.75 84.54 57.39 67.89 4.77 5.64 15.33 18.13 11.82 13.98
119
+ iaij 55.01 425.99 222.12 52.14 30.46 7.15 100.20 23.52 103.66 24.34
120
+ iaim 48.63 63.55 34.37 54.09 1.73 2.72 9.34 14.69 19.84 31.22
121
+ iain 15.22 74.91 64.80 86.51 1.29 1.73 4.43 5.92 5.67 7.57
122
+ iaip 27.17 425.77 355.18 83.42 45.08 10.59 23.02 5.41 47.57 11.17
123
+ iaiq 25.35 288.95 261.48 90.49 45.77 15.84 14.25 4.93 13.22 4.57
124
+ iair 25.71 62.84 51.17 81.43 4.48 7.14 6.51 10.35 5.16 8.22
125
+ iaix 40.09 56.79 39.99 70.41 5.96 10.50 5.84 10.28 10.97 19.31
126
+ iaiy 37.65 146.05 95.94 65.69 4.88 3.34 9.28 6.36 40.83 27.95
127
+ iaja 45.98 85.67 46.38 54.13 0.10 0.11 25.88 30.21 13.42 15.66
128
+ iajb 31.22 182.24 141.41 77.59 16.06 8.81 24.14 13.24 16.69 9.16
129
+ iajc 52.34 58.74 33.95 57.79 5.95 10.13 7.55 12.86 17.24 29.35
130
+ iaje 23.67 58.71 47.69 81.22 2.87 4.89 5.62 9.58 5.40 9.20
131
+ iajg 32.77 177.43 131.92 74.35 12.63 7.12 20.99 11.83 24.52 13.82
132
+ iaji 30.74 78.34 62.17 79.36 7.91 10.10 12.09 15.43 4.09 5.22
133
+ iajk 39.59 92.21 63.32 68.67 7.62 8.26 19.40 21.04 9.49 10.29
134
+ iajl 16.15 58.66 54.98 93.73 5.80 9.88 2.49 4.25 1.19 2.03
135
+ iajm 16.78 62.31 57.63 92.50 5.78 9.28 3.97 6.36 0.71 1.14
136
+ iajn 26.65 232.31 188.48 81.13 18.08 7.78 18.81 8.10 25.02 10.77
137
+ iajq 68.46 172.33 79.88 46.35 25.54 14.82 33.72 19.57 58.73 34.08
138
+ iajs 36.01 200.82 144.26 71.84 15.76 7.85 23.09 11.50 33.46 16.66
139
+ iaju 28.11 102.17 77.98 76.33 4.53 4.44 16.49 16.14 7.70 7.53
140
+ iajv 40.69 75.33 46.42 61.62 1.74 2.31 14.77 19.60 14.14 18.77
141
+ iajw 38.05 80.53 50.90 63.20 1.01 1.25 13.18 16.37 16.45 20.43
142
+ iajx 36.67 63.21 40.91 64.71 0.88 1.39 7.52 11.90 14.78 23.39
143
+ iakb 26.77 80.15 62.02 77.38 3.33 4.15 9.92 12.38 8.21 10.24
144
+ iakc 13.48 73.70 68.01 92.28 4.24 5.75 4.08 5.53 1.62 2.19
145
+ iakd 21.15 72.78 58.04 79.74 0.65 0.89 12.83 17.63 1.91 2.63
146
+ iakf 21.28 218.21 184.50 84.55 12.72 5.83 17.38 7.96 16.33 7.48
147
+ iakg 36.27 160.03 106.04 66.26 4.05 2.53 36.44 22.77 17.55 10.97
148
+ iaki 24.81 184.77 160.81 87.03 21.89 11.85 8.68 4.70 15.28 8.27
149
+ iakl 14.95 70.73 66.79 94.43 6.63 9.38 3.01 4.26 0.93 1.31
150
+ iakm 36.17 62.98 42.05 66.77 1.85 2.94 11.81 18.75 9.12 14.49
151
+ iakn 14.36 164.25 144.29 87.85 3.62 2.20 17.28 10.52 2.68 1.63
152
+ iakr 29.00 206.86 174.50 84.35 27.63 13.36 6.08 2.94 26.28 12.70
153
+ iala 46.04 89.76 49.61 55.26 1.17 1.30 22.55 25.13 17.60 19.61
154
+ ialb 58.20 171.27 71.75 41.89 0.15 0.09 67.62 39.48 31.90 18.63
155
+ ialc 12.52 74.18 67.64 91.19 2.75 3.71 5.04 6.80 1.49 2.01
156
+ iale 18.64 49.93 43.24 86.60 2.61 5.24 6.41 12.83 0.28 0.57
157
+ ialh 14.85 121.18 108.18 89.27 5.00 4.12 12.74 10.52 0.25 0.21
158
+ iali 21.42 111.75 92.77 83.01 4.95 4.43 15.35 13.74 3.63 3.25
159
+ ialj 41.01 92.54 68.45 73.97 13.86 14.98 7.58 8.19 16.51 17.84
160
+ ialk 19.17 589.43 523.29 88.78 46.86 7.95 56.40 9.57 9.74 1.65
161
+ iall 20.02 200.77 164.13 81.75 3.55 1.77 17.46 8.70 19.18 9.55
162
+ ialo 21.36 77.35 63.64 82.28 2.81 3.64 13.19 17.05 0.52 0.68
163
+ ialp 22.19 79.91 64.66 80.92 2.48 3.10 14.74 18.44 0.51 0.64
164
+ ialq 10.49 64.89 62.69 96.60 4.60 7.10 2.18 3.36 0.03 0.04
165
+ ialr 14.27 71.87 62.60 87.11 0.99 1.38 6.78 9.43 2.49 3.46
166
+ ials 32.00 77.06 53.75 69.75 1.34 1.74 11.32 14.69 11.99 15.56
167
+ ialt 36.55 93.40 60.07 64.32 0.81 0.87 20.25 21.68 13.08 14.00
168
+ ialv 15.50 63.72 56.99 89.44 3.14 4.94 4.12 6.47 2.61 4.09
169
+ ialw 50.23 40.10 31.18 77.76 11.23 27.99 1.12 2.80 7.79 19.44
170
+ ialx 56.30 71.61 32.18 44.93 0.89 1.24 22.90 31.98 16.53 23.09
171
+ iamg 46.01 790.99 443.09 56.02 16.07 2.03 185.76 23.48 162.13 20.50
172
+ iamh 50.40 56.73 43.62 76.88 15.48 27.29 2.28 4.02 10.83 19.09
173
+ iami 37.83 52.00 36.57 70.33 4.25 8.16 7.44 14.31 7.98 15.35
174
+ iamk 19.22 66.92 60.44 90.31 6.38 9.53 4.60 6.87 1.88 2.81
175
+ iaml 37.99 125.23 85.76 68.48 8.11 6.47 12.26 9.79 27.21 21.73
176
+ iamp 25.72 63.80 53.48 83.83 6.10 9.56 4.73 7.41 5.59 8.76
177
+ iamr 36.36 86.47 61.66 71.31 6.63 7.67 7.07 8.18 17.73 20.51
178
+ iams 22.84 362.50 308.55 85.12 28.83 7.95 40.03 11.04 13.92 3.84
179
+ iamu 34.89 134.32 108.86 81.04 21.40 15.93 7.10 5.29 18.36 13.67
180
+ iamv 14.75 81.30 73.80 90.78 4.49 5.53 6.84 8.41 0.66 0.81
181
+ iamw 25.14 698.29 559.59 80.14 36.84 5.28 116.26 16.65 22.44 3.21
182
+ iamz 46.04 69.95 46.19 66.03 8.45 12.08 8.45 12.08 15.31 21.89
183
+ ianb 20.10 348.27 298.13 85.60 19.85 5.70 36.51 10.48 13.63 3.91
184
+ iand 24.32 90.71 82.37 90.81 13.72 15.12 4.12 4.55 4.22 4.65
185
+ ianf 9.47 93.90 88.05 93.77 3.03 3.23 5.81 6.19 0.05 0.05
186
+ iang 45.87 60.59 37.54 61.96 4.74 7.83 7.17 11.83 15.88 26.21
187
+ ianh 21.83 61.13 50.04 81.86 2.25 3.69 5.20 8.50 5.89 9.64
188
+ ianj 36.07 121.69 80.37 66.05 2.57 2.11 30.89 25.39 10.42 8.56
189
+ ianp 43.64 55.40 35.48 64.05 4.26 7.69 5.76 10.40 14.16 25.56
190
+ ianq 22.51 104.48 97.78 93.59 16.82 16.10 5.39 5.16 1.31 1.26
191
+ ianr 48.98 274.84 145.53 52.95 5.29 1.93 79.71 29.00 49.60 18.05
192
+ ians 13.57 272.42 251.38 92.27 15.91 5.84 18.10 6.64 2.95 1.08
193
+ ianv 41.55 250.98 165.31 65.87 18.62 7.42 42.18 16.80 43.49 17.33
194
+ ianx 20.03 128.56 104.44 81.23 1.63 1.27 21.47 16.70 2.66 2.07
195
+ iaob 38.82 70.89 44.49 62.76 1.12 1.58 16.69 23.55 9.70 13.69
196
+ iaoe 24.70 59.76 46.55 77.89 1.55 2.59 12.47 20.87 0.74 1.23
197
+ iaog 29.78 67.08 50.04 74.60 2.94 4.38 6.03 8.99 11.01 16.42
198
+ iaoi 19.20 82.96 70.74 85.27 3.70 4.46 12.13 14.62 0.10 0.11
199
+ iaoj 40.37 80.32 51.09 63.60 3.19 3.97 18.42 22.94 10.81 13.46
200
+ iaom 25.03 101.10 78.74 77.89 2.95 2.92 20.52 20.30 1.83 1.81
201
+ iaon 28.82 210.46 158.75 75.43 8.95 4.25 6.56 3.12 45.14 21.45
202
+ iaop 44.25 263.53 156.24 59.29 9.33 3.54 52.12 19.78 55.17 20.93
203
+ iaos 26.96 249.10 198.74 79.78 16.79 6.74 33.61 13.49 16.75 6.73
204
+ iaou 32.52 55.57 44.00 79.19 6.50 11.70 4.38 7.88 7.19 12.93
205
+ iaov 51.32 163.78 93.06 56.82 13.33 8.14 25.39 15.50 45.33 27.68
206
+ iaoz 26.63 86.45 70.96 82.08 7.53 8.71 11.60 13.41 3.90 4.51
207
+ iapa 48.51 75.10 40.65 54.12 1.98 2.63 16.70 22.24 17.75 23.64
208
+ iapb 17.33 64.86 56.80 87.58 3.19 4.91 6.69 10.31 1.37 2.11
209
+ iapc 48.16 44.33 36.83 83.08 13.85 31.24 4.72 10.65 2.78 6.27
210
+ iapg 53.44 61.14 29.99 49.05 1.52 2.48 17.57 28.73 13.59 22.22
211
+ iapj 26.02 54.77 48.12 87.86 7.60 13.88 5.18 9.46 1.47 2.68
212
+ iapl 61.45 65.58 35.60 54.29 10.32 15.74 10.53 16.05 19.45 29.66
213
+ iapq 29.69 112.62 90.62 80.46 11.43 10.15 7.90 7.02 14.10 12.52
214
+ iapt 30.20 120.35 86.05 71.50 2.04 1.70 12.91 10.73 21.39 17.77
215
+ iaqb 49.33 100.33 73.48 73.24 22.64 22.57 9.27 9.24 17.58 17.52
216
+ iaqd 35.48 107.02 69.77 65.20 0.72 0.67 24.92 23.28 12.33 11.52
217
+ iaqo 46.76 149.00 79.92 53.64 0.59 0.40 45.93 30.82 23.15 15.54
218
+ iaqp 26.22 66.56 53.03 79.68 3.93 5.90 7.10 10.67 6.42 9.65
219
+ iaqq 30.95 54.92 41.90 76.30 3.98 7.25 6.17 11.23 6.85 12.47
220
+ iaqr 15.99 71.79 63.41 88.33 3.10 4.32 7.81 10.89 0.56 0.79
221
+ iaqt 23.60 78.57 62.81 79.94 2.78 3.54 6.00 7.64 9.76 12.42
222
+ iaqv 34.24 80.44 55.03 68.42 2.14 2.66 11.45 14.24 13.96 17.35
223
+ iaqw 22.52 523.30 416.12 79.52 10.65 2.04 44.68 8.54 62.51 11.95
224
+ iaqy 55.97 56.61 33.23 58.70 8.31 14.67 10.17 17.97 13.21 23.33
225
+ iaqz 37.07 189.24 126.84 67.03 7.76 4.10 34.02 17.98 28.37 14.99
226
+ iara 12.82 85.36 75.77 88.76 1.35 1.59 7.97 9.34 1.62 1.90
227
+ iarb 58.61 64.96 33.50 51.57 6.61 10.18 9.35 14.40 22.11 34.03
228
+ iarc 29.38 75.15 56.19 74.77 3.12 4.15 12.10 16.11 6.86 9.13
229
+ iare 7.95 78.16 74.76 95.66 2.81 3.60 2.51 3.21 0.89 1.14
230
+ iari 56.38 71.83 32.17 44.79 0.84 1.17 10.59 14.74 29.07 40.47
231
+ iarj 29.94 80.83 60.34 74.65 3.71 4.59 12.18 15.07 8.31 10.28
232
+ iarm 24.12 130.15 103.17 79.27 4.40 3.38 15.84 12.17 11.15 8.56
233
+ iarn 21.26 75.98 66.75 87.85 6.92 9.11 7.14 9.39 2.09 2.75
234
+ iarp 42.49 73.62 44.26 60.11 1.92 2.61 14.59 19.81 14.78 20.07
235
+ iarq 46.79 128.41 74.96 58.38 6.64 5.17 20.40 15.88 33.05 25.74
236
+ iart 40.03 110.02 66.84 60.75 0.86 0.79 42.03 38.21 1.15 1.04
237
+ iarw 17.94 71.95 64.45 89.57 5.41 7.51 4.17 5.79 3.34 4.64
238
+ iarx 19.73 75.51 62.02 82.14 1.41 1.87 11.80 15.63 1.69 2.23
239
+ iary 34.26 92.82 62.04 66.84 1.02 1.10 10.04 10.82 20.74 22.34
240
+ iarz 52.34 78.08 38.87 49.78 1.66 2.13 10.47 13.41 28.74 36.81
241
+ iasa 23.05 57.47 49.56 86.24 5.34 9.29 7.54 13.13 0.37 0.64
242
+ iasb 22.24 79.10 70.83 89.55 9.33 11.79 3.41 4.31 4.86 6.14
243
+ iasf 47.94 85.51 46.64 54.55 2.13 2.49 14.27 16.69 24.60 28.77
244
+ iash 43.22 236.98 147.95 62.43 13.41 5.66 28.25 11.92 60.78 25.65
245
+ iasl 28.30 72.28 56.04 77.53 4.21 5.83 4.00 5.53 12.24 16.94
246
+ iasn 19.96 86.26 73.60 85.32 4.56 5.29 5.60 6.49 7.06 8.18
247
+ iass 63.97 110.58 62.47 56.49 22.63 20.46 14.41 13.03 33.71 30.48
248
+ iasv 45.57 50.19 33.32 66.39 6.00 11.95 5.13 10.21 11.75 23.40
249
+ iasx 23.80 92.06 73.62 79.97 3.47 3.77 14.07 15.29 4.37 4.75
250
+ iasy 51.12 89.42 44.48 49.74 0.77 0.86 26.50 29.64 18.44 20.62
251
+ iata 27.79 59.21 46.61 78.71 3.85 6.51 5.89 9.95 6.71 11.34
252
+ iatd 23.47 72.05 66.12 91.77 10.98 15.24 2.77 3.85 3.15 4.37
253
+ iatf 44.12 63.81 37.19 58.29 1.53 2.41 11.36 17.81 15.25 23.91
254
+ TOTAL 32.37 32224.95 23822.82 73.93 2030.28 6.30 4422.78 13.72 3979.35 12.35
reproducible_research/2.1/CALLHOME.test.rttm ADDED
The diff for this file is too large to render. See raw diff
 
reproducible_research/2.1/DIHARD.test.eval ADDED
@@ -0,0 +1,263 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ diarization error rate total correct correct false alarm false alarm missed detection missed detection confusion confusion
2
+ % % % % %
3
+ item
4
+ DH_EVAL_0001 20.41 485.12 437.95 90.28 51.83 10.68 8.23 1.70 38.94 8.03
5
+ DH_EVAL_0002 41.82 57.09 35.38 61.96 2.16 3.79 10.79 18.90 10.93 19.14
6
+ DH_EVAL_0003 17.19 620.30 566.95 91.40 53.29 8.59 37.96 6.12 15.39 2.48
7
+ DH_EVAL_0004 22.76 332.41 294.37 88.56 37.62 11.32 16.82 5.06 21.22 6.38
8
+ DH_EVAL_0005 16.89 573.48 519.83 90.64 43.22 7.54 43.49 7.58 10.16 1.77
9
+ DH_EVAL_0006 12.86 636.34 608.66 95.65 54.17 8.51 21.35 3.36 6.33 0.99
10
+ DH_EVAL_0007 19.87 589.92 538.27 91.24 65.56 11.11 31.45 5.33 20.20 3.42
11
+ DH_EVAL_0008 13.84 602.91 574.07 95.22 54.63 9.06 19.10 3.17 9.73 1.61
12
+ DH_EVAL_0009 48.58 755.88 425.04 56.23 36.34 4.81 211.05 27.92 119.80 15.85
13
+ DH_EVAL_0010 14.02 291.89 282.21 96.68 31.23 10.70 8.03 2.75 1.65 0.56
14
+ DH_EVAL_0011 13.77 607.06 574.81 94.69 51.34 8.46 27.24 4.49 5.01 0.82
15
+ DH_EVAL_0012 22.74 592.15 507.74 85.74 50.26 8.49 31.09 5.25 53.32 9.00
16
+ DH_EVAL_0013 17.33 477.50 449.66 94.17 54.90 11.50 6.38 1.34 21.45 4.49
17
+ DH_EVAL_0014 34.76 477.45 420.34 88.04 108.85 22.80 32.74 6.86 24.36 5.10
18
+ DH_EVAL_0015 57.73 762.02 392.00 51.44 69.86 9.17 137.77 18.08 232.24 30.48
19
+ DH_EVAL_0016 20.93 540.07 494.00 91.47 66.98 12.40 37.55 6.95 8.51 1.58
20
+ DH_EVAL_0017 68.66 35.76 16.49 46.10 5.28 14.76 9.63 26.94 9.64 26.95
21
+ DH_EVAL_0018 97.63 43.45 22.42 51.60 21.39 49.24 6.52 15.00 14.51 33.39
22
+ DH_EVAL_0019 59.77 126.36 52.49 41.54 1.65 1.30 50.30 39.81 23.57 18.66
23
+ DH_EVAL_0020 75.65 37.74 26.32 69.74 17.13 45.39 2.52 6.68 8.90 23.58
24
+ DH_EVAL_0021 33.94 184.91 152.82 82.65 30.68 16.59 6.35 3.43 25.74 13.92
25
+ DH_EVAL_0022 21.66 568.52 502.28 88.35 56.90 10.01 35.57 6.26 30.67 5.40
26
+ DH_EVAL_0023 20.50 160.43 148.55 92.60 21.01 13.10 3.91 2.44 7.97 4.97
27
+ DH_EVAL_0024 30.21 199.68 172.74 86.51 33.38 16.72 9.26 4.64 17.68 8.85
28
+ DH_EVAL_0025 60.55 455.93 225.12 49.38 45.27 9.93 120.90 26.52 109.90 24.11
29
+ DH_EVAL_0026 15.56 654.77 598.15 91.35 45.27 6.91 42.69 6.52 13.92 2.13
30
+ DH_EVAL_0027 13.36 518.95 505.16 97.34 55.53 10.70 9.27 1.79 4.52 0.87
31
+ DH_EVAL_0028 22.05 583.60 518.53 88.85 63.59 10.90 38.80 6.65 26.28 4.50
32
+ DH_EVAL_0029 17.44 590.53 547.34 92.69 59.78 10.12 32.48 5.50 10.71 1.81
33
+ DH_EVAL_0030 20.75 566.56 513.89 90.70 64.89 11.45 44.10 7.78 8.57 1.51
34
+ DH_EVAL_0031 86.65 71.66 32.75 45.70 23.18 32.35 15.92 22.21 22.99 32.08
35
+ DH_EVAL_0032 11.68 657.21 618.94 94.18 38.48 5.85 29.02 4.42 9.24 1.41
36
+ DH_EVAL_0033 17.23 591.01 545.15 92.24 55.96 9.47 15.54 2.63 30.32 5.13
37
+ DH_EVAL_0034 63.82 69.69 25.68 36.84 0.46 0.66 29.70 42.62 14.31 20.54
38
+ DH_EVAL_0035 15.51 706.42 643.83 91.14 47.00 6.65 51.07 7.23 11.52 1.63
39
+ DH_EVAL_0036 18.95 580.54 530.43 91.37 59.87 10.31 33.42 5.76 16.69 2.88
40
+ DH_EVAL_0037 42.51 680.00 431.92 63.52 41.00 6.03 119.75 17.61 128.34 18.87
41
+ DH_EVAL_0038 15.39 494.15 490.83 99.33 72.74 14.72 3.32 0.67 0.00 0.00
42
+ DH_EVAL_0039 22.28 298.43 280.07 93.85 48.14 16.13 4.85 1.63 13.50 4.52
43
+ DH_EVAL_0040 13.73 457.68 453.51 99.09 58.65 12.81 4.17 0.91 0.00 0.00
44
+ DH_EVAL_0041 14.71 292.41 268.48 91.81 19.08 6.53 22.90 7.83 1.04 0.35
45
+ DH_EVAL_0042 22.37 191.80 181.40 94.58 32.51 16.95 3.59 1.87 6.81 3.55
46
+ DH_EVAL_0043 14.27 499.03 489.60 98.11 61.78 12.38 8.54 1.71 0.89 0.18
47
+ DH_EVAL_0044 58.07 815.76 396.34 48.59 54.33 6.66 226.41 27.75 193.01 23.66
48
+ DH_EVAL_0045 64.47 172.29 82.77 48.05 21.56 12.51 8.63 5.01 80.88 46.95
49
+ DH_EVAL_0046 21.71 328.89 298.82 90.86 41.33 12.57 9.39 2.86 20.67 6.29
50
+ DH_EVAL_0047 55.24 339.21 173.04 51.01 21.21 6.25 29.83 8.79 136.34 40.19
51
+ DH_EVAL_0048 22.23 567.22 500.48 88.23 59.34 10.46 27.38 4.83 39.36 6.94
52
+ DH_EVAL_0049 24.05 188.96 171.38 90.70 27.87 14.75 7.83 4.15 9.74 5.16
53
+ DH_EVAL_0050 16.37 270.79 251.98 93.05 25.50 9.42 6.68 2.47 12.13 4.48
54
+ DH_EVAL_0051 23.92 165.04 141.35 85.64 15.78 9.56 8.79 5.33 14.90 9.03
55
+ DH_EVAL_0052 16.57 313.46 287.65 91.77 26.13 8.33 5.49 1.75 20.32 6.48
56
+ DH_EVAL_0053 49.51 26.88 17.36 64.57 3.79 14.09 1.98 7.37 7.54 28.06
57
+ DH_EVAL_0054 14.13 182.73 172.67 94.49 15.77 8.63 3.83 2.10 6.23 3.41
58
+ DH_EVAL_0055 27.12 175.70 150.88 85.87 22.83 13.00 10.57 6.01 14.26 8.11
59
+ DH_EVAL_0056 45.83 635.51 436.50 68.68 92.21 14.51 141.94 22.33 57.07 8.98
60
+ DH_EVAL_0057 51.19 221.64 129.87 58.59 21.68 9.78 27.30 12.32 64.47 29.09
61
+ DH_EVAL_0058 33.49 199.27 164.15 82.38 31.61 15.86 3.45 1.73 31.68 15.90
62
+ DH_EVAL_0059 55.29 207.01 119.85 57.90 27.30 13.19 14.25 6.89 72.90 35.22
63
+ DH_EVAL_0060 63.70 187.39 100.21 53.48 32.20 17.18 5.32 2.84 81.86 43.69
64
+ DH_EVAL_0061 59.67 131.91 54.15 41.05 0.95 0.72 56.46 42.81 21.30 16.14
65
+ DH_EVAL_0062 14.63 628.11 583.86 92.96 47.61 7.58 39.45 6.28 4.80 0.76
66
+ DH_EVAL_0063 71.74 61.40 34.84 56.75 17.49 28.48 4.10 6.67 22.46 36.58
67
+ DH_EVAL_0064 25.91 281.16 238.64 84.88 30.34 10.79 22.63 8.05 19.88 7.07
68
+ DH_EVAL_0065 17.77 538.86 512.25 95.06 69.13 12.83 21.35 3.96 5.27 0.98
69
+ DH_EVAL_0066 10.38 513.98 466.34 90.73 5.71 1.11 36.08 7.02 11.56 2.25
70
+ DH_EVAL_0067 88.68 89.93 30.61 34.04 20.43 22.72 16.03 17.82 43.29 48.14
71
+ DH_EVAL_0068 14.67 602.26 576.80 95.77 62.89 10.44 16.95 2.81 8.52 1.41
72
+ DH_EVAL_0069 21.25 210.09 189.00 89.96 23.55 11.21 9.44 4.49 11.65 5.54
73
+ DH_EVAL_0070 27.51 222.35 192.06 86.38 30.88 13.89 2.37 1.06 27.93 12.56
74
+ DH_EVAL_0071 13.96 556.11 530.09 95.32 51.61 9.28 9.21 1.66 16.81 3.02
75
+ DH_EVAL_0072 17.52 449.80 421.20 93.64 50.22 11.16 17.18 3.82 11.43 2.54
76
+ DH_EVAL_0073 22.39 174.24 148.74 85.36 13.50 7.75 10.35 5.94 15.16 8.70
77
+ DH_EVAL_0074 23.38 209.73 177.47 84.62 16.77 8.00 23.20 11.06 9.06 4.32
78
+ DH_EVAL_0075 19.73 158.31 145.48 91.90 18.40 11.63 3.83 2.42 9.00 5.68
79
+ DH_EVAL_0076 18.80 574.21 513.23 89.38 46.97 8.18 52.10 9.07 8.88 1.55
80
+ DH_EVAL_0077 16.58 434.09 431.90 99.50 69.79 16.08 2.19 0.50 0.00 0.00
81
+ DH_EVAL_0078 43.91 286.43 164.87 57.56 4.20 1.47 88.33 30.84 33.23 11.60
82
+ DH_EVAL_0079 20.60 579.85 527.87 91.04 67.45 11.63 30.25 5.22 21.73 3.75
83
+ DH_EVAL_0080 15.24 626.21 579.00 92.46 48.22 7.70 39.50 6.31 7.70 1.23
84
+ DH_EVAL_0081 10.76 506.63 505.17 99.71 53.06 10.47 1.46 0.29 0.00 0.00
85
+ DH_EVAL_0082 24.00 483.43 450.56 93.20 83.17 17.20 4.94 1.02 27.93 5.78
86
+ DH_EVAL_0083 40.08 187.11 140.74 75.22 28.62 15.30 9.47 5.06 36.90 19.72
87
+ DH_EVAL_0084 17.64 441.20 431.33 97.76 67.95 15.40 5.57 1.26 4.31 0.98
88
+ DH_EVAL_0085 61.66 443.64 230.18 51.89 60.09 13.55 86.30 19.45 127.16 28.66
89
+ DH_EVAL_0086 133.36 73.04 34.33 47.00 58.69 80.36 4.61 6.31 34.10 46.69
90
+ DH_EVAL_0087 21.20 603.48 541.46 89.72 65.90 10.92 40.45 6.70 21.57 3.57
91
+ DH_EVAL_0088 20.06 625.73 565.71 90.41 65.48 10.46 52.98 8.47 7.04 1.13
92
+ DH_EVAL_0089 14.66 598.85 563.09 94.03 52.01 8.69 25.78 4.30 9.98 1.67
93
+ DH_EVAL_0090 44.78 577.35 365.47 63.30 46.68 8.08 24.81 4.30 187.07 32.40
94
+ DH_EVAL_0091 16.78 605.49 552.92 91.32 49.04 8.10 36.10 5.96 16.47 2.72
95
+ DH_EVAL_0092 21.78 430.60 409.85 95.18 73.04 16.96 10.81 2.51 9.93 2.31
96
+ DH_EVAL_0093 12.89 606.31 572.88 94.49 44.74 7.38 28.35 4.68 5.08 0.84
97
+ DH_EVAL_0094 22.40 309.12 273.46 88.46 33.58 10.86 25.06 8.11 10.59 3.43
98
+ DH_EVAL_0095 66.52 109.27 46.37 42.44 9.79 8.96 35.01 32.04 27.89 25.52
99
+ DH_EVAL_0096 16.18 263.16 243.66 92.59 23.08 8.77 17.86 6.79 1.64 0.62
100
+ DH_EVAL_0097 32.83 171.83 139.95 81.44 24.53 14.27 11.13 6.48 20.76 12.08
101
+ DH_EVAL_0098 22.49 331.49 293.98 88.68 37.03 11.17 27.50 8.29 10.02 3.02
102
+ DH_EVAL_0099 13.74 519.35 510.85 98.36 62.84 12.10 2.92 0.56 5.58 1.07
103
+ DH_EVAL_0100 57.06 730.43 403.10 55.19 89.43 12.24 175.00 23.96 152.33 20.86
104
+ DH_EVAL_0101 17.15 321.80 317.53 98.67 50.92 15.82 3.82 1.19 0.45 0.14
105
+ DH_EVAL_0102 31.55 180.18 158.32 87.87 34.99 19.42 8.51 4.72 13.36 7.41
106
+ DH_EVAL_0103 15.92 259.55 245.58 94.62 27.34 10.53 11.68 4.50 2.29 0.88
107
+ DH_EVAL_0104 54.50 153.47 86.90 56.62 17.08 11.13 10.40 6.78 56.17 36.60
108
+ DH_EVAL_0105 77.80 186.93 87.60 46.86 46.11 24.66 29.44 15.75 69.89 37.39
109
+ DH_EVAL_0106 15.22 596.35 551.43 92.47 45.85 7.69 28.20 4.73 16.72 2.80
110
+ DH_EVAL_0107 17.23 406.62 392.02 96.41 55.47 13.64 10.89 2.68 3.71 0.91
111
+ DH_EVAL_0108 15.70 519.95 489.66 94.17 51.36 9.88 22.51 4.33 7.78 1.50
112
+ DH_EVAL_0109 15.96 625.42 579.43 92.65 53.86 8.61 34.01 5.44 11.98 1.92
113
+ DH_EVAL_0110 17.32 593.70 536.11 90.30 45.22 7.62 44.77 7.54 12.82 2.16
114
+ DH_EVAL_0111 40.78 809.82 531.35 65.61 51.77 6.39 189.80 23.44 88.67 10.95
115
+ DH_EVAL_0112 70.08 106.94 59.48 55.62 27.48 25.70 17.55 16.41 29.91 27.97
116
+ DH_EVAL_0113 15.25 224.39 212.92 94.89 22.74 10.14 9.08 4.05 2.39 1.07
117
+ DH_EVAL_0114 17.08 593.40 541.83 91.31 49.79 8.39 40.15 6.77 11.42 1.92
118
+ DH_EVAL_0115 29.15 545.53 467.65 85.72 81.15 14.87 60.17 11.03 17.72 3.25
119
+ DH_EVAL_0116 71.10 145.80 47.06 32.28 4.92 3.37 71.00 48.70 27.73 19.02
120
+ DH_EVAL_0117 44.43 239.98 167.17 69.66 33.82 14.09 13.40 5.58 59.41 24.76
121
+ DH_EVAL_0118 21.85 488.21 440.96 90.32 59.43 12.17 31.23 6.40 16.01 3.28
122
+ DH_EVAL_0119 16.62 584.97 547.13 93.53 59.38 10.15 33.57 5.74 4.27 0.73
123
+ DH_EVAL_0120 21.04 295.03 271.98 92.19 39.03 13.23 14.24 4.83 8.82 2.99
124
+ DH_EVAL_0121 47.36 170.72 106.48 62.37 16.62 9.73 9.92 5.81 54.31 31.81
125
+ DH_EVAL_0122 15.02 468.03 461.54 98.61 63.80 13.63 6.49 1.39 0.00 0.00
126
+ DH_EVAL_0123 18.27 588.14 556.68 94.65 76.02 12.93 22.46 3.82 9.00 1.53
127
+ DH_EVAL_0124 18.56 170.28 160.64 94.34 21.97 12.90 1.97 1.16 7.67 4.50
128
+ DH_EVAL_0125 55.60 141.01 85.42 60.58 22.81 16.18 12.56 8.91 43.03 30.51
129
+ DH_EVAL_0126 15.51 596.15 559.65 93.88 55.99 9.39 30.38 5.10 6.12 1.03
130
+ DH_EVAL_0127 26.73 173.47 154.91 89.30 27.79 16.02 6.71 3.87 11.85 6.83
131
+ DH_EVAL_0128 12.81 323.75 298.49 92.20 16.21 5.01 21.90 6.76 3.36 1.04
132
+ DH_EVAL_0129 16.86 665.67 613.27 92.13 59.83 8.99 38.39 5.77 14.02 2.11
133
+ DH_EVAL_0130 20.25 319.60 285.40 89.30 30.54 9.55 21.02 6.58 13.17 4.12
134
+ DH_EVAL_0131 38.69 203.24 147.76 72.70 23.16 11.39 11.90 5.85 43.58 21.44
135
+ DH_EVAL_0132 41.98 230.82 158.04 68.47 24.11 10.45 9.94 4.31 62.85 27.23
136
+ DH_EVAL_0133 23.71 338.47 286.65 84.69 28.43 8.40 35.85 10.59 15.97 4.72
137
+ DH_EVAL_0134 15.67 564.46 535.20 94.82 59.18 10.48 23.26 4.12 6.00 1.06
138
+ DH_EVAL_0135 19.82 220.01 198.45 90.20 22.05 10.02 13.59 6.18 7.97 3.62
139
+ DH_EVAL_0136 18.49 576.15 545.26 94.64 75.66 13.13 24.50 4.25 6.39 1.11
140
+ DH_EVAL_0137 11.31 515.14 501.13 97.28 44.26 8.59 10.20 1.98 3.81 0.74
141
+ DH_EVAL_0138 45.96 287.62 221.02 76.84 65.58 22.80 11.14 3.87 55.46 19.28
142
+ DH_EVAL_0139 49.14 761.06 435.64 57.24 48.57 6.38 186.76 24.54 138.67 18.22
143
+ DH_EVAL_0140 10.59 519.01 507.40 97.76 43.34 8.35 9.00 1.73 2.62 0.50
144
+ DH_EVAL_0141 16.23 611.96 553.88 90.51 41.27 6.74 54.12 8.84 3.96 0.65
145
+ DH_EVAL_0142 20.04 469.91 452.26 96.24 76.50 16.28 5.29 1.12 12.36 2.63
146
+ DH_EVAL_0143 40.68 33.03 23.80 72.05 4.21 12.73 2.71 8.21 6.52 19.74
147
+ DH_EVAL_0144 19.58 324.19 302.50 93.31 41.78 12.89 4.51 1.39 17.18 5.30
148
+ DH_EVAL_0145 36.85 239.68 177.16 73.92 25.81 10.77 31.69 13.22 30.83 12.86
149
+ DH_EVAL_0146 23.20 497.90 460.91 92.57 78.53 15.77 7.71 1.55 29.28 5.88
150
+ DH_EVAL_0147 21.42 278.78 253.22 90.83 34.15 12.25 6.72 2.41 18.84 6.76
151
+ DH_EVAL_0148 18.44 564.73 524.93 92.95 64.32 11.39 18.51 3.28 21.29 3.77
152
+ DH_EVAL_0149 14.23 368.16 353.06 95.90 37.28 10.12 6.90 1.87 8.21 2.23
153
+ DH_EVAL_0150 15.46 499.76 498.54 99.76 76.03 15.21 1.22 0.24 0.00 0.00
154
+ DH_EVAL_0151 12.77 475.17 469.65 98.84 55.14 11.61 5.52 1.16 0.00 0.00
155
+ DH_EVAL_0152 73.15 749.20 299.03 39.91 97.85 13.06 193.84 25.87 256.33 34.21
156
+ DH_EVAL_0153 44.10 155.63 109.85 70.58 22.86 14.69 11.05 7.10 34.73 22.32
157
+ DH_EVAL_0154 25.90 196.22 165.36 84.27 19.96 10.17 19.76 10.07 11.10 5.66
158
+ DH_EVAL_0155 54.68 230.32 133.75 58.07 29.37 12.75 12.89 5.60 83.68 36.33
159
+ DH_EVAL_0156 38.87 105.83 77.70 73.42 13.01 12.29 4.96 4.69 23.17 21.90
160
+ DH_EVAL_0157 21.70 172.68 154.75 89.62 19.54 11.31 10.19 5.90 7.74 4.48
161
+ DH_EVAL_0158 17.19 194.45 175.61 90.31 14.58 7.50 12.58 6.47 6.26 3.22
162
+ DH_EVAL_0159 18.71 491.46 436.29 88.77 36.80 7.49 28.24 5.75 26.93 5.48
163
+ DH_EVAL_0160 70.24 731.94 280.87 38.37 63.07 8.62 196.66 26.87 254.41 34.76
164
+ DH_EVAL_0161 65.71 705.51 303.22 42.98 61.28 8.69 160.25 22.71 242.05 34.31
165
+ DH_EVAL_0162 11.28 638.54 613.48 96.08 46.99 7.36 19.71 3.09 5.35 0.84
166
+ DH_EVAL_0163 21.01 177.17 155.83 87.95 15.88 8.96 16.07 9.07 5.27 2.98
167
+ DH_EVAL_0164 34.56 731.27 504.39 68.98 25.88 3.54 146.49 20.03 80.38 10.99
168
+ DH_EVAL_0165 19.53 122.42 121.79 99.48 23.27 19.01 0.64 0.52 0.00 0.00
169
+ DH_EVAL_0166 48.06 424.52 229.35 54.03 8.87 2.09 119.19 28.08 75.98 17.90
170
+ DH_EVAL_0167 31.36 205.49 170.88 83.16 29.83 14.52 9.62 4.68 25.00 12.16
171
+ DH_EVAL_0168 22.44 596.56 534.76 89.64 72.06 12.08 19.53 3.27 42.27 7.09
172
+ DH_EVAL_0169 14.55 418.61 400.65 95.71 42.95 10.26 14.87 3.55 3.09 0.74
173
+ DH_EVAL_0170 21.13 508.38 449.14 88.35 48.16 9.47 37.82 7.44 21.42 4.21
174
+ DH_EVAL_0171 33.15 604.31 459.33 76.01 55.38 9.16 98.14 16.24 46.84 7.75
175
+ DH_EVAL_0172 23.00 178.97 164.81 92.09 27.00 15.09 2.76 1.54 11.40 6.37
176
+ DH_EVAL_0173 55.92 830.20 426.07 51.32 60.13 7.24 213.63 25.73 190.50 22.95
177
+ DH_EVAL_0174 19.06 479.38 439.03 91.58 51.03 10.65 31.50 6.57 8.85 1.85
178
+ DH_EVAL_0175 12.58 525.46 511.41 97.33 52.07 9.91 4.94 0.94 9.11 1.73
179
+ DH_EVAL_0176 13.30 537.43 526.19 97.91 60.23 11.21 8.32 1.55 2.92 0.54
180
+ DH_EVAL_0177 17.70 237.60 225.04 94.72 29.50 12.42 10.01 4.21 2.54 1.07
181
+ DH_EVAL_0178 67.66 162.67 58.79 36.14 6.17 3.79 72.05 44.29 31.83 19.57
182
+ DH_EVAL_0179 16.51 605.47 574.71 94.92 69.20 11.43 25.46 4.20 5.31 0.88
183
+ DH_EVAL_0180 17.10 301.07 282.91 93.97 33.34 11.07 5.40 1.79 12.76 4.24
184
+ DH_EVAL_0181 31.67 511.65 426.63 83.38 77.00 15.05 60.24 11.77 24.77 4.84
185
+ DH_EVAL_0182 17.53 592.58 554.37 93.55 65.65 11.08 22.72 3.83 15.48 2.61
186
+ DH_EVAL_0183 27.61 270.22 233.44 86.39 37.83 14.00 16.90 6.25 19.88 7.36
187
+ DH_EVAL_0184 25.13 549.14 479.19 87.26 68.07 12.40 40.54 7.38 29.41 5.36
188
+ DH_EVAL_0185 18.06 609.03 557.48 91.54 58.44 9.60 41.78 6.86 9.77 1.60
189
+ DH_EVAL_0186 37.98 548.87 389.15 70.90 48.75 8.88 96.36 17.56 63.36 11.54
190
+ DH_EVAL_0187 13.16 509.80 488.30 95.78 45.57 8.94 2.92 0.57 18.59 3.65
191
+ DH_EVAL_0188 11.38 531.07 520.62 98.03 49.99 9.41 3.85 0.72 6.60 1.24
192
+ DH_EVAL_0189 57.89 154.29 88.88 57.60 23.91 15.50 5.12 3.32 60.30 39.08
193
+ DH_EVAL_0190 28.79 232.43 194.12 83.52 28.62 12.31 15.41 6.63 22.90 9.85
194
+ DH_EVAL_0191 37.86 296.83 232.78 78.42 48.33 16.28 22.27 7.50 41.78 14.08
195
+ DH_EVAL_0192 21.45 225.96 200.16 88.58 22.68 10.04 11.27 4.99 14.52 6.43
196
+ DH_EVAL_0193 11.62 602.41 586.24 97.31 53.85 8.94 14.81 2.46 1.37 0.23
197
+ DH_EVAL_0194 80.48 770.60 200.75 26.05 50.36 6.54 260.49 33.80 309.35 40.14
198
+ DH_EVAL_0195 9.53 447.84 441.63 98.61 36.48 8.15 6.21 1.39 0.00 0.00
199
+ DH_EVAL_0196 17.52 519.28 495.18 95.36 66.89 12.88 9.27 1.79 14.82 2.85
200
+ DH_EVAL_0197 32.92 227.84 186.59 81.89 33.76 14.82 12.48 5.48 28.77 12.63
201
+ DH_EVAL_0198 16.96 599.96 541.21 90.21 42.99 7.17 53.81 8.97 4.95 0.82
202
+ DH_EVAL_0199 73.48 199.17 67.57 33.92 14.74 7.40 38.36 19.26 93.24 46.82
203
+ DH_EVAL_0200 13.38 465.13 459.78 98.85 56.87 12.23 5.35 1.15 0.00 0.00
204
+ DH_EVAL_0201 20.44 535.14 489.36 91.44 63.61 11.89 19.66 3.67 26.13 4.88
205
+ DH_EVAL_0202 11.17 468.81 463.83 98.94 47.40 10.11 4.98 1.06 0.00 0.00
206
+ DH_EVAL_0203 16.07 594.55 564.06 94.87 65.05 10.94 18.29 3.08 12.19 2.05
207
+ DH_EVAL_0204 61.57 211.18 106.12 50.25 24.98 11.83 10.29 4.87 94.76 44.87
208
+ DH_EVAL_0205 15.75 166.38 154.45 92.83 14.28 8.58 6.36 3.82 5.57 3.35
209
+ DH_EVAL_0206 43.36 682.78 463.34 67.86 76.62 11.22 134.39 19.68 85.05 12.46
210
+ DH_EVAL_0207 16.79 229.13 215.81 94.19 25.15 10.98 7.11 3.10 6.21 2.71
211
+ DH_EVAL_0208 41.04 239.26 200.15 83.65 59.08 24.69 10.99 4.59 28.12 11.75
212
+ DH_EVAL_0209 39.07 156.36 119.59 76.49 24.33 15.56 21.03 13.45 15.73 10.06
213
+ DH_EVAL_0210 223.35 31.39 16.57 52.80 55.28 176.15 2.82 8.98 12.00 38.22
214
+ DH_EVAL_0211 17.18 530.28 486.27 91.70 47.12 8.89 27.52 5.19 16.48 3.11
215
+ DH_EVAL_0212 41.38 205.84 149.84 72.79 29.18 14.17 13.68 6.64 42.33 20.56
216
+ DH_EVAL_0213 15.11 599.20 543.05 90.63 34.41 5.74 50.21 8.38 5.94 0.99
217
+ DH_EVAL_0214 36.05 739.59 513.09 69.37 40.14 5.43 174.44 23.59 52.06 7.04
218
+ DH_EVAL_0215 15.74 450.21 427.10 94.87 47.74 10.60 13.82 3.07 9.29 2.06
219
+ DH_EVAL_0216 18.62 225.19 215.10 95.52 31.83 14.14 5.01 2.23 5.08 2.25
220
+ DH_EVAL_0217 18.34 301.29 268.06 88.97 22.02 7.31 14.87 4.93 18.36 6.09
221
+ DH_EVAL_0218 14.33 523.22 504.81 96.48 56.55 10.81 11.49 2.20 6.92 1.32
222
+ DH_EVAL_0219 20.04 447.56 413.10 92.30 55.25 12.35 19.45 4.34 15.01 3.35
223
+ DH_EVAL_0220 17.44 155.02 143.84 92.79 15.86 10.23 9.28 5.98 1.90 1.23
224
+ DH_EVAL_0221 15.95 592.71 549.96 92.79 51.79 8.74 37.12 6.26 5.63 0.95
225
+ DH_EVAL_0222 47.63 200.19 127.39 63.63 22.55 11.26 11.27 5.63 61.53 30.74
226
+ DH_EVAL_0223 53.00 169.70 97.30 57.34 17.55 10.34 12.33 7.27 60.06 35.39
227
+ DH_EVAL_0224 18.81 409.88 387.17 94.46 54.40 13.27 18.71 4.56 3.99 0.97
228
+ DH_EVAL_0225 53.64 43.12 29.34 68.03 9.35 21.67 3.62 8.38 10.17 23.58
229
+ DH_EVAL_0226 56.78 188.03 105.60 56.16 24.34 12.95 14.36 7.64 68.07 36.20
230
+ DH_EVAL_0227 28.67 266.67 225.26 84.47 35.06 13.15 22.52 8.44 18.89 7.08
231
+ DH_EVAL_0228 11.88 508.17 506.57 99.69 58.79 11.57 1.60 0.31 0.00 0.00
232
+ DH_EVAL_0229 21.02 166.63 150.08 90.07 18.48 11.09 12.19 7.31 4.37 2.62
233
+ DH_EVAL_0230 15.84 618.19 573.96 92.85 53.68 8.68 41.00 6.63 3.24 0.52
234
+ DH_EVAL_0231 21.90 261.19 230.36 88.20 26.37 10.10 13.88 5.31 16.95 6.49
235
+ DH_EVAL_0232 25.79 574.66 489.52 85.19 63.06 10.97 41.58 7.23 43.56 7.58
236
+ DH_EVAL_0233 23.35 463.54 454.39 98.02 99.09 21.38 5.37 1.16 3.78 0.82
237
+ DH_EVAL_0234 26.35 578.23 495.35 85.67 69.47 12.01 29.45 5.09 53.43 9.24
238
+ DH_EVAL_0235 19.09 387.37 320.92 82.85 7.48 1.93 52.27 13.49 14.17 3.66
239
+ DH_EVAL_0236 42.17 715.19 458.78 64.15 45.21 6.32 155.96 21.81 100.45 14.05
240
+ DH_EVAL_0237 22.05 37.60 31.04 82.56 1.73 4.61 0.80 2.13 5.75 15.31
241
+ DH_EVAL_0238 61.56 960.48 386.91 40.28 17.66 1.84 389.45 40.55 184.11 19.17
242
+ DH_EVAL_0239 8.33 496.98 492.65 99.13 37.08 7.46 3.47 0.70 0.85 0.17
243
+ DH_EVAL_0240 47.57 107.01 80.99 75.69 24.89 23.26 6.73 6.28 19.29 18.03
244
+ DH_EVAL_0241 17.98 530.54 502.67 94.75 67.51 12.73 17.08 3.22 10.79 2.03
245
+ DH_EVAL_0242 19.74 559.54 497.91 88.99 48.84 8.73 33.43 5.97 28.20 5.04
246
+ DH_EVAL_0243 15.37 350.62 330.50 94.26 33.75 9.63 4.99 1.42 15.13 4.32
247
+ DH_EVAL_0244 21.31 203.14 188.81 92.95 28.96 14.25 4.95 2.44 9.37 4.61
248
+ DH_EVAL_0245 28.83 291.88 242.49 83.08 34.78 11.91 16.59 5.68 32.79 11.23
249
+ DH_EVAL_0246 21.55 538.67 478.02 88.74 55.45 10.29 36.93 6.85 23.73 4.40
250
+ DH_EVAL_0247 17.38 524.59 494.43 94.25 60.99 11.63 22.81 4.35 7.35 1.40
251
+ DH_EVAL_0248 18.87 636.58 577.34 90.69 60.86 9.56 30.15 4.74 29.08 4.57
252
+ DH_EVAL_0249 23.35 618.25 511.02 82.66 37.12 6.00 78.97 12.77 28.26 4.57
253
+ DH_EVAL_0250 26.38 590.11 493.26 83.59 58.79 9.96 51.73 8.77 45.12 7.65
254
+ DH_EVAL_0251 30.05 218.83 175.29 80.10 22.22 10.15 12.57 5.74 30.97 14.15
255
+ DH_EVAL_0252 41.50 124.22 90.57 72.91 17.91 14.42 3.67 2.95 29.99 24.14
256
+ DH_EVAL_0253 17.38 492.02 479.41 97.44 72.89 14.81 5.10 1.04 7.51 1.53
257
+ DH_EVAL_0254 72.87 610.19 249.89 40.95 84.33 13.82 172.82 28.32 187.49 30.73
258
+ DH_EVAL_0255 18.91 635.93 574.76 90.38 59.06 9.29 31.74 4.99 29.43 4.63
259
+ DH_EVAL_0256 66.23 187.90 92.54 49.25 29.08 15.48 13.29 7.07 82.07 43.68
260
+ DH_EVAL_0257 17.64 530.20 498.41 94.00 61.74 11.64 7.78 1.47 24.01 4.53
261
+ DH_EVAL_0258 62.32 162.26 77.62 47.83 16.48 10.16 10.15 6.25 74.50 45.91
262
+ DH_EVAL_0259 60.66 93.87 39.50 42.08 2.58 2.75 37.59 40.04 16.78 17.87
263
+ TOTAL 26.94 103757.36 86700.58 83.56 10891.07 10.50 8726.99 8.41 8329.78 8.03
reproducible_research/2.1/DIHARD.test.rttm ADDED
The diff for this file is too large to render. See raw diff
 
reproducible_research/2.1/Ego4D.development.eval ADDED
@@ -0,0 +1,54 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ diarization error rate total correct correct false alarm false alarm missed detection missed detection confusion confusion
2
+ % % % % %
3
+ item
4
+ c2413391-7c1b-4fd6-8b1d-98ee7888b9f8 57.48 49.53 21.90 44.21 0.84 1.70 22.74 45.92 4.89 9.87
5
+ fe69a78e-7773-45d1-9e0f-bacee52dac83 61.08 58.08 30.10 51.83 7.50 12.91 26.00 44.77 1.97 3.40
6
+ 3b79017c-4d42-40fc-a1bb-4a20bc8ebca7 48.44 158.21 84.01 53.10 2.44 1.54 58.11 36.73 16.08 10.16
7
+ 6dbfc053-7899-40d8-9827-0ccd21f3ee0a 85.32 117.44 19.37 16.49 2.13 1.81 85.60 72.89 12.48 10.62
8
+ 7e6dfd31-8544-4fad-9e49-0f05516cf8cf 41.90 188.92 122.47 64.82 12.70 6.72 36.20 19.16 30.25 16.01
9
+ 56c5af79-f9d4-478d-96ef-6d71e0bbbdfe 71.59 131.97 39.73 30.10 2.24 1.70 74.18 56.21 18.06 13.68
10
+ 3aea2d62-0340-4c6a-8019-3cce9117a65a 88.70 113.17 13.37 11.81 0.59 0.52 87.35 77.18 12.45 11.00
11
+ d97bedc8-72df-43be-a55b-4da1ae42dfd1 49.35 117.14 62.10 53.02 2.78 2.37 47.01 40.13 8.02 6.85
12
+ f0cb79ef-c081-4049-85ef-2623e02c9589 35.98 255.35 173.32 67.88 9.85 3.86 54.53 21.35 27.50 10.77
13
+ 08b0935e-6260-4bd6-86ca-f6fc54e388be 68.70 153.10 50.48 32.97 2.56 1.67 75.17 49.09 27.46 17.94
14
+ 6f80f9ae-c276-413f-accc-fad74efe8a95 61.33 35.38 17.94 50.70 4.26 12.03 11.80 33.34 5.65 15.96
15
+ b95bd349-11bb-4ade-9cc6-3be8dcea06dd 40.77 232.69 167.71 72.07 29.88 12.84 34.34 14.76 30.64 13.17
16
+ e7086057-b5f7-4286-87c6-ab110072c5b0 38.28 179.22 116.03 64.74 5.41 3.02 43.25 24.13 19.94 11.13
17
+ 8324c0ba-7a10-42e1-90fd-afb4d3afa789 82.63 74.90 21.75 29.04 8.74 11.67 35.77 47.75 17.38 23.21
18
+ 2b90b963-e829-4787-8fcd-1a1a434ffdfd 59.23 80.40 42.33 52.66 9.55 11.88 24.32 30.25 13.74 17.09
19
+ 66ddb7ae-90d6-4a58-9f3c-7f1d2604ecb0 87.47 143.73 24.90 17.32 6.89 4.80 101.03 70.29 17.80 12.38
20
+ ad1a9ea9-d1ab-474a-b715-1a42d892ef5d 75.98 238.03 64.42 27.07 7.26 3.05 122.52 51.47 51.08 21.46
21
+ 4ca3d9cf-4972-4e1d-aca3-28b036d6bdc5 77.34 220.66 56.36 25.54 6.36 2.88 123.44 55.94 40.86 18.52
22
+ 2360312c-4347-476a-990f-2633b489fa7a 77.72 222.45 57.20 25.71 7.63 3.43 118.29 53.17 46.96 21.11
23
+ 0fe736da-48f1-4961-bd7a-b75ce13c91b4 78.45 240.55 57.53 23.92 5.69 2.37 144.23 59.96 38.79 16.12
24
+ 1c5c0b52-1287-4df3-aa75-8ccc916b1c10 69.07 162.45 55.82 34.36 5.57 3.43 58.98 36.31 47.65 29.33
25
+ 07f1486c-44a7-4c69-9532-720c81c99eb0 65.59 202.76 82.11 40.50 12.34 6.09 65.93 32.51 54.72 26.99
26
+ 80ee109f-b097-4755-8a39-9f0b33adb170 63.61 217.64 80.28 36.89 1.08 0.50 108.28 49.75 29.08 13.36
27
+ 88260ff4-be0b-4544-98ef-78b6a0d61ebc 71.37 207.59 67.86 32.69 8.43 4.06 68.59 33.04 71.14 34.27
28
+ aabeb7f9-5ada-425a-9545-c98dc443887a 62.47 189.28 79.00 41.73 7.96 4.20 58.87 31.10 51.42 27.17
29
+ 65229ac2-9033-4002-af6c-492fe49bc563 70.44 222.41 70.69 31.78 4.95 2.23 96.57 43.42 55.14 24.79
30
+ 7f566780-4ed2-41c5-9faa-06759495faab 63.08 186.48 72.26 38.75 3.41 1.83 40.53 21.73 73.70 39.52
31
+ 4ea88cb9-bff8-49e0-a855-cc1902db9a99 72.62 79.50 32.42 40.78 10.65 13.40 36.10 45.41 10.98 13.81
32
+ bb050b8a-195a-4b50-b5d0-1ed535226a39 80.67 140.21 31.45 22.43 4.35 3.10 80.64 57.51 28.13 20.06
33
+ b4f650b4-53d6-4069-a55f-43f2de7ff47b 75.21 195.76 50.14 25.61 1.61 0.82 112.50 57.47 33.11 16.91
34
+ 8a409551-657a-48c0-8beb-056c228ebca5 79.61 210.54 46.47 22.07 3.55 1.68 131.20 62.31 32.87 15.61
35
+ 6f3f70b4-8428-4e5f-b1dd-86cd55d8e63f 60.72 170.87 75.53 44.20 8.41 4.92 70.00 40.97 25.34 14.83
36
+ 0511dce9-c126-4a11-92ba-8082a4ec89bd 65.20 302.44 106.13 35.09 0.90 0.30 182.76 60.43 13.54 4.48
37
+ 33365c93-7f1d-4a7d-a9bc-b33010aeafbd 44.28 201.26 114.44 56.86 2.29 1.14 71.67 35.61 15.15 7.53
38
+ ea9d85e7-6a9a-451a-b019-972a6891c11b 73.40 219.97 61.07 27.76 2.56 1.16 131.95 59.98 26.95 12.25
39
+ cd3092e1-6022-4a11-bfc3-a4bb80487ece 68.40 195.79 68.62 35.05 6.74 3.44 88.01 44.95 39.17 20.01
40
+ 5682f9aa-bdfb-409c-b4c2-c0105b35ee78 73.34 250.69 69.77 27.83 2.93 1.17 139.31 55.57 41.61 16.60
41
+ b87c3e0f-a5af-4663-a87d-d0689d73343b 76.27 138.68 41.00 29.57 8.10 5.84 58.29 42.03 39.39 28.40
42
+ 6edb7036-3369-4c03-8e3a-439ffbeb4724 52.64 77.61 37.93 48.87 1.18 1.51 30.83 39.72 8.85 11.41
43
+ 0d4efcc9-a336-46f9-a1db-0623b5be2869 54.28 77.12 36.79 47.71 1.53 1.99 28.12 36.45 12.21 15.84
44
+ 7a6576d8-007c-4ee9-b7cc-8cc2d020e1bf 68.80 98.27 33.24 33.82 2.58 2.62 56.03 57.01 9.01 9.17
45
+ f0445727-2729-4a76-9434-fb081a14cd9d 32.90 186.81 155.42 83.19 30.06 16.09 27.16 14.54 4.23 2.27
46
+ 73c1ac5a-80a0-4e55-b143-52df5697c9ea 52.87 94.58 54.04 57.13 9.46 10.00 31.35 33.14 9.20 9.73
47
+ 224d8b17-7eaf-4529-9b75-c6ce3078d640 50.28 231.51 115.30 49.80 0.18 0.08 114.97 49.66 1.24 0.54
48
+ a22beaf0-377c-4b95-b472-867280a525ae 36.51 120.87 83.63 69.19 6.90 5.71 35.34 29.24 1.90 1.57
49
+ 5a5b8c37-e3f6-48f2-96d3-289a043eaee4 71.99 57.08 18.38 32.21 2.40 4.20 29.98 52.52 8.72 15.27
50
+ dab038d7-9e08-4edf-8d03-ee7e2af5a10e 60.62 39.24 18.24 46.47 2.78 7.09 13.72 34.97 7.28 18.55
51
+ 08742cb7-bb6d-47ae-af5e-3f1f306ccda6 68.12 148.94 50.59 33.97 3.11 2.09 82.86 55.64 15.48 10.40
52
+ 5e965191-bcd1-491a-a9ce-e014e970020b 68.81 193.11 66.79 34.58 6.55 3.39 101.65 52.64 24.67 12.78
53
+ 076bdb81-5c75-4282-9f3a-a387624575f3 65.15 50.98 27.79 54.50 10.02 19.65 22.48 44.09 0.72 1.41
54
+ TOTAL 63.99 7881.38 3146.20 39.92 307.87 3.91 3500.53 44.42 1234.65 15.67
reproducible_research/2.1/Ego4D.development.rttm ADDED
The diff for this file is too large to render. See raw diff
 
reproducible_research/2.1/REPERE.test.eval ADDED
@@ -0,0 +1,65 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ diarization error rate total correct correct false alarm false alarm missed detection missed detection confusion confusion
2
+ % % % % %
3
+ item
4
+ BFMTV_BFMStory_2012-07-24_175800 10.61 3373.81 3078.56 91.25 62.66 1.86 116.06 3.44 179.19 5.31
5
+ BFMTV_BFMStory_2012-07-26_175800 5.37 2931.58 2807.08 95.75 32.83 1.12 66.18 2.26 58.32 1.99
6
+ BFMTV_BFMStory_2012-07-27_175800 6.16 2721.21 2604.48 95.71 50.98 1.87 65.18 2.40 51.55 1.89
7
+ BFMTV_BFMStory_2012-08-24_175800 6.11 2817.69 2670.67 94.78 25.07 0.89 75.54 2.68 71.48 2.54
8
+ BFMTV_BFMStory_2012-11-09_175800 3.71 954.20 924.04 96.84 5.25 0.55 18.82 1.97 11.34 1.19
9
+ BFMTV_BFMStory_2012-11-14_175800 7.73 976.95 911.02 93.25 9.55 0.98 47.90 4.90 18.03 1.85
10
+ BFMTV_BFMStory_2012-11-15_175800 2.85 895.79 879.60 98.19 9.35 1.04 8.12 0.91 8.08 0.90
11
+ BFMTV_CultureEtVous_2012-02-20_065040 17.44 120.17 100.74 83.83 1.52 1.27 14.68 12.22 4.75 3.95
12
+ BFMTV_CultureEtVous_2012-02-24_065040 28.64 250.92 188.97 75.31 9.92 3.95 24.52 9.77 37.43 14.92
13
+ BFMTV_CultureEtVous_2012-04-05_065040 17.13 110.28 96.11 87.16 4.73 4.29 9.79 8.88 4.37 3.97
14
+ BFMTV_CultureEtVous_2012-05-14_065040 22.39 101.81 83.51 82.03 4.50 4.42 9.07 8.91 9.23 9.06
15
+ BFMTV_CultureEtVous_2012-07-18_065040 32.14 97.30 75.25 77.34 9.23 9.48 5.57 5.73 16.48 16.93
16
+ BFMTV_CultureEtVous_2012-07-23_065040 17.76 94.13 83.53 88.74 6.12 6.50 7.02 7.46 3.58 3.80
17
+ BFMTV_CultureEtVous_2012-10-05_064700 6.93 99.40 93.98 94.54 1.46 1.47 0.19 0.19 5.24 5.27
18
+ BFMTV_CultureEtVous_2012-10-08_064700 25.48 86.06 76.16 88.50 12.03 13.98 4.39 5.11 5.50 6.39
19
+ BFMTV_CultureEtVous_2012-10-09_064700 16.16 92.33 87.90 95.20 10.49 11.36 1.08 1.17 3.35 3.63
20
+ BFMTV_CultureEtVous_2012-10-12_064700 26.96 125.20 93.87 74.98 2.42 1.93 10.29 8.22 21.04 16.81
21
+ BFMTV_CultureEtVous_2012-10-16_064700 32.88 123.41 86.65 70.22 3.83 3.10 12.72 10.31 24.03 19.47
22
+ BFMTV_CultureEtVous_2012-10-17_064700 20.44 91.76 80.66 87.90 7.66 8.35 4.02 4.38 7.08 7.72
23
+ BFMTV_CultureEtVous_2012-10-18_064700 7.71 94.62 91.50 96.70 4.17 4.40 0.12 0.13 3.00 3.18
24
+ BFMTV_CultureEtVous_2012-10-22_064700 25.02 118.20 92.44 78.21 3.82 3.23 19.43 16.44 6.33 5.35
25
+ BFMTV_CultureEtVous_2012-10-23_064700 18.01 84.44 76.75 90.89 7.51 8.90 0.00 0.00 7.69 9.10
26
+ BFMTV_CultureEtVous_2012-10-24_064700 20.10 111.54 91.08 81.65 1.96 1.76 7.38 6.61 13.09 11.73
27
+ BFMTV_CultureEtVous_2012-10-26_064700 32.36 98.27 68.31 69.51 1.83 1.87 11.09 11.29 18.87 19.20
28
+ BFMTV_CultureEtVous_2012-11-09_064700 18.12 112.10 94.82 84.59 3.03 2.71 8.10 7.22 9.18 8.19
29
+ BFMTV_CultureEtVous_2012-12-10_064700 18.97 89.69 80.52 89.78 7.84 8.75 0.75 0.83 8.42 9.39
30
+ BFMTV_CultureEtVous_2012-12-11_064700 17.83 98.45 87.24 88.61 6.35 6.45 2.07 2.10 9.14 9.29
31
+ BFMTV_CultureEtVous_2012-12-12_065040 17.03 109.94 92.72 84.33 1.49 1.36 10.56 9.61 6.67 6.07
32
+ BFMTV_CultureEtVous_2012-12-13_064700 34.16 98.62 72.11 73.12 7.18 7.28 11.21 11.37 15.29 15.51
33
+ BFMTV_CultureEtVous_2012-12-17_064700 17.31 120.19 113.61 94.52 14.22 11.83 1.51 1.26 5.07 4.22
34
+ BFMTV_CultureEtVous_2012-12-21_064700 9.77 107.58 99.12 92.14 2.05 1.91 8.08 7.51 0.38 0.36
35
+ BFMTV_CultureEtVous_2013-01-03_064700 4.15 98.49 96.05 97.52 1.65 1.67 0.60 0.60 1.85 1.88
36
+ BFMTV_RuthElkrief_2012-09-18_190340 13.90 316.64 281.60 88.93 8.99 2.84 21.21 6.70 13.82 4.37
37
+ BFMTV_RuthElkrief_2012-09-19_190040 2.61 284.33 278.62 97.99 1.71 0.60 3.78 1.33 1.93 0.68
38
+ BFMTV_RuthElkrief_2012-09-20_190040 3.90 374.71 361.53 96.48 1.44 0.38 6.95 1.86 6.22 1.66
39
+ BFMTV_RuthElkrief_2012-09-21_190040 6.28 299.02 286.27 95.74 6.04 2.02 6.92 2.32 5.82 1.95
40
+ LCP_CaVousRegarde_2012-09-19_002500 5.57 288.42 274.82 95.29 2.47 0.86 2.38 0.83 11.21 3.89
41
+ LCP_CaVousRegarde_2012-09-20_002500 20.67 367.72 302.11 82.16 10.41 2.83 11.98 3.26 53.62 14.58
42
+ LCP_CaVousRegarde_2012-09-25_202500 8.00 331.51 313.33 94.52 8.34 2.52 4.35 1.31 13.83 4.17
43
+ LCP_EntreLesLignes_2012-10-19_212000 7.98 1694.95 1616.53 95.37 56.79 3.35 20.51 1.21 57.91 3.42
44
+ LCP_EntreLesLignes_2012-12-08_032500 19.38 335.68 276.18 82.28 5.56 1.66 7.68 2.29 51.82 15.44
45
+ LCP_EntreLesLignes_2013-01-19_212400 6.15 327.27 312.09 95.36 4.95 1.51 6.68 2.04 8.50 2.60
46
+ LCP_EntreLesLignes_2013-03-02_212400 24.79 364.59 280.63 76.97 6.44 1.77 11.18 3.07 72.78 19.96
47
+ LCP_EntreLesLignes_2013-03-16_212400 5.65 1013.49 993.03 97.98 36.80 3.63 3.75 0.37 16.71 1.65
48
+ LCP_LCPActu14h_2012-11-26_135500 2.67 580.20 565.90 97.54 1.20 0.21 9.48 1.63 4.82 0.83
49
+ LCP_LCPActu14h_2013-01-08_135400 4.47 588.88 572.88 97.28 10.30 1.75 12.66 2.15 3.34 0.57
50
+ LCP_LCPActu14h_2013-01-09_135400 1.79 602.77 596.14 98.90 4.13 0.69 4.23 0.70 2.40 0.40
51
+ LCP_LCPInfo13h30_2012-04-11_132700 5.24 889.32 876.10 98.51 33.37 3.75 8.72 0.98 4.50 0.51
52
+ LCP_LCPInfo13h30_2012-04-12_132700 5.27 911.62 886.17 97.21 22.58 2.48 8.30 0.91 17.15 1.88
53
+ LCP_LCPInfo13h30_2012-04-13_132700 7.63 837.16 787.15 94.03 13.88 1.66 16.86 2.01 33.15 3.96
54
+ LCP_LCPInfo13h30_2012-04-19_132700 9.87 861.63 783.78 90.96 7.21 0.84 39.80 4.62 38.05 4.42
55
+ LCP_LCPInfo13h30_2012-05-03_132700 10.91 962.86 879.10 91.30 21.33 2.22 28.73 2.98 55.03 5.71
56
+ LCP_PileEtFace_2012-07-05_192700 6.66 904.26 871.14 96.34 27.11 3.00 8.84 0.98 24.28 2.69
57
+ LCP_PileEtFace_2012-10-04_192200 7.64 1731.16 1670.00 96.47 71.12 4.11 19.51 1.13 41.64 2.41
58
+ LCP_PileEtFace_2012-10-15_142500 5.43 1584.62 1548.17 97.70 49.53 3.13 26.95 1.70 9.51 0.60
59
+ LCP_PileEtFace_2012-10-26_012500 2.43 186.30 182.46 97.94 0.69 0.37 3.19 1.71 0.65 0.35
60
+ LCP_PileEtFace_2012-11-30_012500 12.31 184.46 165.83 89.90 4.07 2.21 4.33 2.35 14.30 7.75
61
+ LCP_PileEtFace_2012-12-08_012500 15.32 192.02 168.45 87.73 5.85 3.04 1.95 1.01 21.62 11.26
62
+ LCP_TopQuestions_2012-11-28_232500 5.37 724.12 714.77 98.71 29.56 4.08 5.68 0.78 3.67 0.51
63
+ LCP_TopQuestions_2013-01-30_232600 3.54 584.85 566.48 96.86 2.36 0.40 7.87 1.35 10.51 1.80
64
+ LCP_TopQuestions_2013-04-24_232600 6.29 342.38 339.34 99.11 18.50 5.40 2.88 0.84 0.16 0.05
65
+ TOTAL 8.17 36073.06 33929.67 94.06 805.43 2.23 899.38 2.49 1244.01 3.45
reproducible_research/2.1/REPERE.test.rttm ADDED
The diff for this file is too large to render. See raw diff
 
reproducible_research/2.1/ThisAmericanLife.test.eval ADDED
@@ -0,0 +1,40 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ diarization error rate total correct correct false alarm false alarm missed detection missed detection confusion confusion
2
+ % % % % %
3
+ item
4
+ 11 21.15 3594.78 2906.44 80.85 71.81 2.00 399.18 11.10 289.16 8.04
5
+ 113 18.12 3470.62 2901.34 83.60 59.71 1.72 417.27 12.02 152.00 4.38
6
+ 120 26.25 3457.86 2651.52 76.68 101.34 2.93 530.74 15.35 275.60 7.97
7
+ 164 25.24 3476.68 2643.94 76.05 44.93 1.29 687.06 19.76 145.68 4.19
8
+ 171 17.15 3496.56 2943.63 84.19 46.59 1.33 412.30 11.79 140.63 4.02
9
+ 177 25.30 3507.94 2663.06 75.92 42.67 1.22 671.07 19.13 173.81 4.95
10
+ 195 21.88 3499.32 2786.39 79.63 52.70 1.51 579.36 16.56 133.58 3.82
11
+ 219 20.85 3521.58 2803.51 79.61 16.07 0.46 547.69 15.55 170.38 4.84
12
+ 242 17.22 3458.39 2904.43 83.98 41.70 1.21 397.78 11.50 156.17 4.52
13
+ 258 20.79 3450.44 2803.14 81.24 69.93 2.03 377.70 10.95 269.59 7.81
14
+ 270 19.00 3439.30 2879.15 83.71 93.20 2.71 424.47 12.34 135.67 3.94
15
+ 279 18.73 3509.64 2887.51 82.27 35.34 1.01 373.58 10.64 248.55 7.08
16
+ 343 21.88 3510.08 2777.55 79.13 35.57 1.01 490.52 13.97 242.01 6.89
17
+ 355 14.20 3465.32 3007.39 86.79 34.09 0.98 270.40 7.80 187.53 5.41
18
+ 382 14.20 3441.34 2999.81 87.17 47.06 1.37 306.38 8.90 135.15 3.93
19
+ 403 15.41 3584.17 3110.78 86.79 79.06 2.21 299.64 8.36 173.75 4.85
20
+ 416 23.60 3335.59 2734.18 81.97 185.75 5.57 270.66 8.11 330.75 9.92
21
+ 432 18.29 3297.18 2868.61 87.00 174.49 5.29 328.24 9.96 100.32 3.04
22
+ 437 12.87 3412.68 3013.35 88.30 39.85 1.17 302.65 8.87 96.68 2.83
23
+ 456 20.34 3387.66 2742.02 80.94 43.46 1.28 466.75 13.78 178.90 5.28
24
+ 475 18.62 3316.09 2785.34 83.99 86.72 2.62 368.45 11.11 162.30 4.89
25
+ 489 49.98 3311.54 1831.64 55.31 175.28 5.29 420.20 12.69 1059.70 32.00
26
+ 493 14.58 3284.69 2887.55 87.91 81.83 2.49 284.18 8.65 112.96 3.44
27
+ 516 17.16 3220.66 2748.66 85.34 80.67 2.50 306.91 9.53 165.09 5.13
28
+ 522 14.79 3419.01 2958.15 86.52 44.84 1.31 404.77 11.84 56.09 1.64
29
+ 524 18.62 3352.69 2812.43 83.89 84.12 2.51 356.87 10.64 183.39 5.47
30
+ 527 18.73 3418.70 2847.25 83.28 68.77 2.01 400.66 11.72 170.80 5.00
31
+ 548 14.24 3736.65 3228.86 86.41 24.42 0.65 308.54 8.26 199.24 5.33
32
+ 558 14.78 3374.92 2943.14 87.21 67.06 1.99 359.39 10.65 72.39 2.14
33
+ 619 43.73 3299.21 2021.25 61.26 164.74 4.99 380.77 11.54 897.19 27.19
34
+ 635 31.92 3924.40 2743.63 69.91 71.96 1.83 550.00 14.01 630.77 16.07
35
+ 648 17.17 3497.65 2960.34 84.64 63.15 1.81 290.31 8.30 247.00 7.06
36
+ 665 14.04 3644.34 3165.17 86.85 32.61 0.89 387.24 10.63 91.93 2.52
37
+ 682 22.98 3488.40 2746.63 78.74 59.82 1.71 469.07 13.45 272.70 7.82
38
+ 683 16.84 3912.26 3297.62 84.29 44.06 1.13 386.13 9.87 228.51 5.84
39
+ 78 29.94 3461.14 2499.92 72.23 75.16 2.17 627.12 18.12 334.10 9.65
40
+ TOTAL 20.82 124979.48 101505.35 81.22 2540.52 2.03 14854.05 11.89 8620.09 6.90
reproducible_research/2.1/ThisAmericanLife.test.rttm ADDED
The diff for this file is too large to render. See raw diff
 
reproducible_research/2.1/VoxConverse.test.eval ADDED
@@ -0,0 +1,236 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ diarization error rate total correct correct false alarm false alarm missed detection missed detection confusion confusion
2
+ % % % % %
3
+ item
4
+ aepyx 9.94 148.29 143.39 96.70 9.83 6.63 4.43 2.98 0.47 0.32
5
+ aggyz 12.08 249.56 227.27 91.07 7.87 3.15 2.53 1.01 19.76 7.92
6
+ aiqwk 22.19 177.68 154.90 87.18 16.65 9.37 2.52 1.42 20.26 11.40
7
+ aorju 6.28 1071.67 1042.19 97.25 37.77 3.52 14.26 1.33 15.22 1.42
8
+ auzru 2.87 508.70 503.92 99.06 9.83 1.93 3.02 0.59 1.75 0.34
9
+ bgvvt 10.87 1004.29 955.28 95.12 60.19 5.99 27.04 2.69 21.97 2.19
10
+ bidnq 18.96 1135.54 978.59 86.18 58.40 5.14 84.61 7.45 72.34 6.37
11
+ bjruf 17.33 372.33 327.32 87.91 19.52 5.24 36.85 9.90 8.16 2.19
12
+ bmsyn 34.45 602.19 489.29 81.25 94.55 15.70 63.67 10.57 49.23 8.18
13
+ bpzsc 7.94 1039.34 984.00 94.68 27.15 2.61 28.24 2.72 27.10 2.61
14
+ bvqnu 12.07 554.47 507.41 91.51 19.86 3.58 9.14 1.65 37.92 6.84
15
+ bvyvm 6.40 105.16 102.03 97.02 3.60 3.42 3.13 2.98 0.00 0.00
16
+ bxcfq 3.50 201.38 195.36 97.01 1.04 0.52 4.36 2.17 1.66 0.82
17
+ byapz 12.24 417.79 377.17 90.28 10.50 2.51 6.67 1.60 33.94 8.12
18
+ cadba 20.03 178.78 147.44 82.47 4.46 2.49 6.04 3.38 25.30 14.15
19
+ cawnd 5.15 1144.16 1108.88 96.92 23.64 2.07 11.84 1.04 23.44 2.05
20
+ clfcg 12.66 274.25 256.84 93.65 17.32 6.31 4.29 1.56 13.12 4.78
21
+ cpebh 0.42 647.66 647.65 100.00 2.69 0.42 0.01 0.00 0.00 0.00
22
+ cqfmj 8.73 108.64 100.63 92.63 1.48 1.37 7.95 7.31 0.06 0.05
23
+ crorm 2.18 871.86 865.83 99.31 12.99 1.49 6.00 0.69 0.03 0.00
24
+ crylr 42.04 155.86 100.44 64.44 10.10 6.48 7.00 4.49 48.42 31.07
25
+ cvofp 6.86 1096.36 1083.01 98.78 61.81 5.64 6.60 0.60 6.75 0.62
26
+ cwbvu 27.45 144.13 106.82 74.11 2.25 1.56 25.23 17.51 12.08 8.38
27
+ dgvwu 8.75 775.26 737.70 95.16 30.27 3.90 23.46 3.03 14.10 1.82
28
+ diysk 31.23 1133.48 950.53 83.86 171.07 15.09 67.79 5.98 115.15 10.16
29
+ dkabn 11.04 1087.22 994.35 91.46 27.21 2.50 76.60 7.05 16.27 1.50
30
+ dlast 2.77 1128.57 1106.52 98.05 9.20 0.82 13.98 1.24 8.07 0.72
31
+ dohag 2.78 39.62 39.47 99.61 0.95 2.40 0.15 0.39 0.00 0.00
32
+ duvox 5.20 907.07 884.28 97.49 24.37 2.69 14.43 1.59 8.36 0.92
33
+ dxbbt 4.91 661.02 647.14 97.90 18.55 2.81 10.72 1.62 3.16 0.48
34
+ dxokr 6.39 176.48 169.63 96.12 4.43 2.51 0.19 0.11 6.66 3.77
35
+ dzsef 0.51 161.68 160.94 99.54 0.08 0.05 0.74 0.46 0.00 0.00
36
+ dzxut 33.87 161.50 134.60 83.34 27.80 17.22 1.25 0.77 25.65 15.88
37
+ eauve 15.03 1258.51 1142.12 90.75 72.81 5.79 69.19 5.50 47.20 3.75
38
+ eazeq 8.70 100.34 96.55 96.23 4.94 4.92 2.85 2.84 0.94 0.94
39
+ eddje 14.58 489.46 430.72 88.00 12.61 2.58 39.09 7.99 19.66 4.02
40
+ eguui 9.24 125.49 116.87 93.13 2.99 2.38 6.23 4.97 2.38 1.90
41
+ eoyaz 10.67 211.25 192.68 91.21 3.96 1.88 6.83 3.23 11.74 5.56
42
+ epygx 11.53 1036.95 996.34 96.08 78.99 7.62 19.96 1.92 20.65 1.99
43
+ eqsta 33.41 954.10 704.97 73.89 69.66 7.30 83.08 8.71 166.05 17.40
44
+ erslt 24.72 114.21 92.92 81.36 6.95 6.08 7.15 6.26 14.14 12.38
45
+ eucfa 16.02 79.02 68.59 86.80 2.23 2.82 0.84 1.06 9.60 12.14
46
+ euqef 46.90 25.25 13.74 54.40 0.33 1.30 0.59 2.33 10.93 43.27
47
+ ezxso 7.50 257.95 248.52 96.35 9.93 3.85 1.02 0.39 8.41 3.26
48
+ fijfi 9.80 826.55 792.32 95.86 46.81 5.66 16.39 1.98 17.84 2.16
49
+ fowhl 10.75 822.80 783.05 95.17 48.72 5.92 25.11 3.05 14.64 1.78
50
+ fpfvy 46.77 115.58 65.92 57.03 4.40 3.81 2.82 2.44 46.85 40.53
51
+ fqrnu 21.25 171.37 139.61 81.47 4.67 2.72 8.55 4.99 23.20 13.54
52
+ fuzfh 16.04 25.42 22.45 88.32 1.11 4.37 2.38 9.38 0.58 2.30
53
+ fvhrk 3.69 1125.74 1116.97 99.22 32.82 2.92 8.14 0.72 0.63 0.06
54
+ fxnwf 28.32 335.39 271.18 80.86 30.78 9.18 29.31 8.74 34.90 10.41
55
+ fyqoe 27.02 356.85 273.82 76.73 13.38 3.75 51.51 14.44 31.52 8.83
56
+ fzwtp 56.51 212.46 116.95 55.05 24.56 11.56 14.29 6.72 81.22 38.23
57
+ gcfwp 34.30 256.61 211.10 82.26 42.50 16.56 3.89 1.51 41.63 16.22
58
+ gcvrb 11.35 1110.57 1064.90 95.89 80.36 7.24 20.50 1.85 25.17 2.27
59
+ gfneh 8.71 158.76 149.71 94.30 4.77 3.01 5.16 3.25 3.89 2.45
60
+ gkiki 22.16 109.18 85.94 78.72 0.95 0.87 1.49 1.37 21.74 19.92
61
+ gmmwm 8.27 277.06 271.91 98.14 17.76 6.41 2.92 1.05 2.23 0.81
62
+ gtjow 2.52 1144.20 1134.16 99.12 18.81 1.64 9.29 0.81 0.76 0.07
63
+ gtnjb 4.30 1200.72 1162.22 96.79 13.07 1.09 9.24 0.77 29.27 2.44
64
+ gukoa 12.70 240.23 214.41 89.25 4.69 1.95 9.35 3.89 16.47 6.86
65
+ guvqf 26.71 927.64 757.87 81.70 78.01 8.41 77.96 8.40 91.81 9.90
66
+ gwloo 9.01 767.47 746.30 97.24 47.96 6.25 1.70 0.22 19.47 2.54
67
+ gylzn 2.80 350.72 348.39 99.33 7.49 2.14 1.69 0.48 0.64 0.18
68
+ gyomp 15.02 56.85 49.53 87.12 1.21 2.13 0.96 1.69 6.37 11.20
69
+ gzhwb 20.72 864.60 728.23 84.23 42.79 4.95 51.41 5.95 84.97 9.83
70
+ hcyak 11.11 301.65 274.35 90.95 6.20 2.06 7.82 2.59 19.48 6.46
71
+ heolf 7.45 1109.96 1073.82 96.74 46.51 4.19 20.43 1.84 15.71 1.42
72
+ hhepf 8.36 1112.72 1076.67 96.76 57.01 5.12 21.36 1.92 14.70 1.32
73
+ hqhrb 10.94 1077.24 1021.88 94.86 62.51 5.80 32.63 3.03 22.73 2.11
74
+ iabca 20.57 164.98 141.39 85.70 10.34 6.27 13.83 8.38 9.76 5.92
75
+ iacod 8.71 1002.13 988.65 98.66 73.86 7.37 6.54 0.65 6.94 0.69
76
+ ibrnm 6.36 1118.27 1090.20 97.49 43.04 3.85 6.60 0.59 21.46 1.92
77
+ ifwki 9.28 372.98 358.28 96.06 19.91 5.34 9.95 2.67 4.75 1.27
78
+ iiprr 10.40 1085.50 1056.25 97.31 83.66 7.71 7.69 0.71 21.55 1.99
79
+ ikhje 11.52 868.30 788.87 90.85 20.64 2.38 50.51 5.82 28.92 3.33
80
+ iowob 5.70 1126.39 1084.23 96.26 22.06 1.96 26.14 2.32 16.02 1.42
81
+ isrps 10.13 176.50 160.95 91.19 2.34 1.32 12.04 6.82 3.50 1.99
82
+ isxwc 13.78 126.25 112.87 89.41 4.02 3.18 3.18 2.52 10.19 8.07
83
+ jbowg 4.73 1134.35 1103.33 97.27 22.64 2.00 11.78 1.04 19.23 1.70
84
+ jdrwl 3.21 1220.98 1202.20 98.46 20.40 1.67 13.79 1.13 4.99 0.41
85
+ jeymh 18.27 1124.55 934.02 83.06 14.95 1.33 5.48 0.49 185.05 16.46
86
+ jgiyq 9.26 1080.79 1021.06 94.47 40.35 3.73 22.85 2.11 36.88 3.41
87
+ jjkrt 12.54 995.64 912.54 91.65 41.72 4.19 39.56 3.97 43.55 4.37
88
+ jjvkx 3.85 182.91 180.55 98.71 4.69 2.56 0.32 0.17 2.04 1.12
89
+ jrfaz 8.03 1255.98 1172.67 93.37 17.57 1.40 53.05 4.22 30.26 2.41
90
+ jsbdo 13.77 869.61 793.45 91.24 43.59 5.01 45.80 5.27 30.36 3.49
91
+ jsymf 9.81 979.92 921.92 94.08 38.14 3.89 37.34 3.81 20.66 2.11
92
+ jttar 4.98 615.76 599.35 97.34 14.27 2.32 1.00 0.16 15.41 2.50
93
+ jwggf 9.74 1088.75 1007.12 92.50 24.45 2.25 70.52 6.48 11.10 1.02
94
+ jxpom 44.85 486.50 301.99 62.07 33.70 6.93 43.65 8.97 140.86 28.95
95
+ jxydp 1.12 85.92 84.97 98.88 0.00 0.00 0.96 1.12 0.00 0.00
96
+ jzkzt 31.82 1166.32 971.90 83.33 176.71 15.15 44.86 3.85 149.56 12.82
97
+ kajfh 21.13 779.21 685.94 88.03 71.36 9.16 7.92 1.02 85.36 10.95
98
+ kgjaa 6.32 1118.07 1071.74 95.86 24.34 2.18 14.04 1.26 32.29 2.89
99
+ kmjvh 25.73 366.07 336.07 91.81 64.19 17.53 0.65 0.18 29.35 8.02
100
+ kmunk 4.98 389.06 378.33 97.24 8.66 2.23 6.35 1.63 4.38 1.13
101
+ kpjud 20.88 146.90 120.55 82.06 4.33 2.94 5.27 3.59 21.08 14.35
102
+ ktvto 18.27 800.04 715.18 89.39 61.30 7.66 29.86 3.73 55.00 6.87
103
+ kvkje 8.68 858.70 843.34 98.21 59.20 6.89 14.15 1.65 1.22 0.14
104
+ kzmyi 5.24 639.17 630.55 98.65 24.86 3.89 2.48 0.39 6.14 0.96
105
+ laoyl 10.90 295.59 274.07 92.72 10.69 3.62 14.95 5.06 6.58 2.23
106
+ lbfnx 6.88 1122.22 1088.70 97.01 43.68 3.89 19.66 1.75 13.86 1.23
107
+ ledhe 3.73 397.87 389.83 97.98 6.81 1.71 4.47 1.12 3.57 0.90
108
+ leneg 7.82 348.21 340.17 97.69 19.19 5.51 5.66 1.63 2.38 0.68
109
+ lhuly 6.15 1125.06 1077.10 95.74 21.18 1.88 17.86 1.59 30.10 2.68
110
+ lilfy 4.12 173.26 172.05 99.30 5.93 3.42 0.88 0.51 0.33 0.19
111
+ ljpes 4.39 183.76 183.29 99.75 7.60 4.14 0.42 0.23 0.05 0.02
112
+ lkikz 3.40 1135.67 1118.98 98.53 21.87 1.93 10.93 0.96 5.76 0.51
113
+ lpola 20.91 811.02 671.79 82.83 30.33 3.74 97.08 11.97 42.15 5.20
114
+ lscfc 16.07 775.64 703.08 90.65 52.06 6.71 37.49 4.83 35.07 4.52
115
+ ltgmz 8.35 171.04 159.92 93.50 3.17 1.85 10.69 6.25 0.42 0.25
116
+ lubpm 2.24 54.37 53.74 98.83 0.58 1.08 0.63 1.17 0.00 0.00
117
+ luobn 6.14 83.48 80.49 96.42 2.13 2.56 2.83 3.39 0.16 0.20
118
+ mbzht 13.46 129.07 114.84 88.98 3.14 2.43 3.25 2.52 10.97 8.50
119
+ mclsr 28.23 275.60 203.68 73.90 5.89 2.14 3.81 1.38 68.11 24.71
120
+ mhwyr 16.81 1081.84 982.80 90.85 82.77 7.65 47.20 4.36 51.84 4.79
121
+ mjmgr 11.69 269.02 243.80 90.62 6.23 2.32 3.07 1.14 22.15 8.23
122
+ mkhie 6.74 1086.01 1040.81 95.84 28.04 2.58 18.34 1.69 26.86 2.47
123
+ mqtep 7.88 133.23 125.42 94.14 2.68 2.01 1.35 1.01 6.46 4.85
124
+ msbyq 7.02 37.45 35.42 94.59 0.60 1.61 0.98 2.61 1.05 2.80
125
+ mupzb 20.41 384.97 375.84 97.63 69.42 18.03 8.43 2.19 0.70 0.18
126
+ mxdpo 5.50 98.58 95.29 96.67 2.13 2.16 2.26 2.30 1.02 1.04
127
+ mxduo 11.81 1018.12 960.33 94.32 62.41 6.13 16.14 1.59 41.65 4.09
128
+ myjoe 15.66 527.42 484.11 91.79 39.27 7.45 28.06 5.32 15.25 2.89
129
+ neiye 3.03 47.14 46.59 98.83 0.88 1.87 0.55 1.17 0.00 0.00
130
+ nitgx 14.52 1167.69 1071.60 91.77 73.45 6.29 27.39 2.35 68.70 5.88
131
+ nkqzr 20.61 1068.36 900.65 84.30 52.44 4.91 99.42 9.31 68.29 6.39
132
+ nlvdr 9.95 1039.75 1015.49 97.67 79.24 7.62 10.58 1.02 13.67 1.32
133
+ nprxc 21.56 368.57 327.95 88.98 38.83 10.54 24.36 6.61 16.26 4.41
134
+ nqcpi 21.55 94.50 75.13 79.51 1.00 1.05 0.32 0.34 19.04 20.15
135
+ nqyqm 6.04 978.34 941.03 96.19 21.79 2.23 9.77 1.00 27.54 2.81
136
+ ocfop 7.43 1358.86 1280.44 94.23 22.53 1.66 72.69 5.35 5.73 0.42
137
+ ofbxh 2.99 1064.28 1048.91 98.56 16.48 1.55 13.65 1.28 1.72 0.16
138
+ olzkb 10.98 210.07 196.36 93.48 9.35 4.45 5.82 2.77 7.89 3.76
139
+ ooxlj 9.56 149.84 148.88 99.36 13.37 8.92 0.96 0.64 0.00 0.00
140
+ optsn 24.38 906.33 756.81 83.50 71.48 7.89 52.92 5.84 96.60 10.66
141
+ oqwpd 6.65 236.89 228.31 96.38 7.18 3.03 4.33 1.83 4.25 1.79
142
+ otmpf 4.06 413.09 403.66 97.72 7.35 1.78 0.37 0.09 9.06 2.19
143
+ oubab 17.85 555.22 477.44 85.99 21.35 3.85 38.26 6.89 39.52 7.12
144
+ ouvtt 19.01 708.66 620.61 87.58 46.67 6.59 53.28 7.52 34.77 4.91
145
+ pccww 3.80 132.14 127.57 96.54 0.45 0.34 2.99 2.26 1.58 1.19
146
+ pgtkk 9.39 220.42 208.43 94.56 8.72 3.96 4.21 1.91 7.77 3.53
147
+ pkwrt 7.69 180.54 167.70 92.89 1.04 0.58 2.37 1.31 10.47 5.80
148
+ poucc 20.48 944.19 804.49 85.20 53.68 5.69 69.76 7.39 69.94 7.41
149
+ ppexo 11.79 113.76 112.18 98.61 11.83 10.40 1.58 1.39 0.00 0.00
150
+ ptses 47.10 608.70 436.05 71.64 114.06 18.74 62.72 10.30 109.93 18.06
151
+ pwnsw 11.19 1012.76 934.61 92.28 35.21 3.48 52.48 5.18 25.67 2.53
152
+ pxqme 15.49 371.17 319.92 86.19 6.26 1.69 0.34 0.09 50.91 13.72
153
+ pzxit 6.63 606.32 582.43 96.06 16.28 2.69 18.59 3.07 5.30 0.87
154
+ qadia 19.71 260.39 223.28 85.75 14.21 5.46 8.41 3.23 28.70 11.02
155
+ qajyo 15.66 969.19 840.23 86.69 22.83 2.36 58.47 6.03 70.49 7.27
156
+ qeejz 19.36 268.38 238.77 88.97 22.36 8.33 5.26 1.96 24.35 9.07
157
+ qlrry 32.82 311.33 267.86 86.04 58.71 18.86 18.35 5.89 25.12 8.07
158
+ qoarn 7.95 1061.31 1019.73 96.08 42.82 4.03 9.13 0.86 32.45 3.06
159
+ qwepo 7.21 502.57 473.54 94.22 7.21 1.43 17.65 3.51 11.38 2.26
160
+ qxana 6.89 1118.90 1060.47 94.78 18.68 1.67 11.79 1.05 46.64 4.17
161
+ ralnu 40.33 171.30 110.38 64.44 8.17 4.77 30.36 17.72 30.56 17.84
162
+ rarij 11.71 1124.42 1016.09 90.37 23.31 2.07 30.16 2.68 78.16 6.95
163
+ rmvsh 2.15 99.43 97.83 98.39 0.54 0.54 1.60 1.61 0.00 0.00
164
+ rpkso 6.07 340.42 330.39 97.05 10.62 3.12 6.10 1.79 3.93 1.15
165
+ rsypp 9.77 1082.77 1005.18 92.83 28.16 2.60 13.72 1.27 63.87 5.90
166
+ rxulz 10.77 1100.26 1051.54 95.57 69.79 6.34 4.19 0.38 44.52 4.05
167
+ ryken 2.50 1177.41 1161.80 98.67 13.86 1.18 11.00 0.93 4.61 0.39
168
+ sbrmv 40.24 231.46 151.61 65.50 13.29 5.74 34.38 14.85 45.47 19.64
169
+ sebyw 8.91 1169.04 1071.69 91.67 6.77 0.58 13.78 1.18 83.57 7.15
170
+ sexgc 11.47 837.94 781.98 93.32 40.17 4.79 34.45 4.11 21.52 2.57
171
+ sfdvy 0.84 321.54 320.00 99.52 1.16 0.36 1.54 0.48 0.00 0.00
172
+ svxzm 1.67 940.85 940.52 99.97 15.41 1.64 0.33 0.03 0.00 0.00
173
+ swbnm 6.07 1088.72 1083.40 99.51 60.77 5.58 1.30 0.12 4.02 0.37
174
+ sxqvt 13.86 226.65 211.00 93.10 15.76 6.95 9.80 4.33 5.84 2.58
175
+ tbjqx 15.70 825.47 715.46 86.67 19.58 2.37 78.86 9.55 31.15 3.77
176
+ thnuq 9.82 928.62 893.63 96.23 56.18 6.05 24.13 2.60 10.86 1.17
177
+ tiido 22.06 316.28 285.86 90.38 39.36 12.44 17.80 5.63 12.62 3.99
178
+ tkhgs 3.16 250.57 246.00 98.18 3.36 1.34 4.49 1.79 0.08 0.03
179
+ tkybe 5.99 1132.08 1109.90 98.04 45.58 4.03 3.19 0.28 18.98 1.68
180
+ tnjoh 34.19 75.78 51.33 67.73 1.45 1.92 4.75 6.27 19.70 25.99
181
+ tpnyf 5.55 1065.66 1051.98 98.72 45.47 4.27 8.23 0.77 5.45 0.51
182
+ tpslg 7.29 426.72 414.43 97.12 18.82 4.41 11.37 2.66 0.92 0.22
183
+ tvtoe 1.04 699.28 695.90 99.52 3.92 0.56 1.11 0.16 2.27 0.32
184
+ uedkc 6.19 1117.37 1070.69 95.82 22.53 2.02 17.25 1.54 29.43 2.63
185
+ uevxo 6.14 225.56 215.69 95.62 3.98 1.76 1.67 0.74 8.20 3.64
186
+ uhfrw 15.37 850.63 765.96 90.05 46.08 5.42 37.68 4.43 46.99 5.52
187
+ uicid 9.24 902.74 852.59 94.44 33.25 3.68 50.15 5.56 0.00 0.00
188
+ upshw 3.26 570.92 556.83 97.53 4.50 0.79 3.77 0.66 10.32 1.81
189
+ uqxlg 15.27 279.21 243.44 87.19 6.86 2.46 3.74 1.34 32.04 11.47
190
+ usqam 14.87 585.60 536.18 91.56 37.67 6.43 17.12 2.92 32.30 5.52
191
+ utial 8.79 1203.09 1125.10 93.52 27.76 2.31 40.06 3.33 37.93 3.15
192
+ vdlvr 4.33 1179.41 1165.04 98.78 36.69 3.11 7.92 0.67 6.44 0.55
193
+ vgaez 43.26 137.03 94.36 68.86 16.61 12.12 8.04 5.87 34.63 25.27
194
+ vgevv 26.87 942.35 752.32 79.83 63.15 6.70 50.70 5.38 139.33 14.79
195
+ vncid 5.85 1101.00 1057.92 96.09 21.34 1.94 14.36 1.30 28.72 2.61
196
+ vtzqw 29.62 501.12 390.55 77.94 37.88 7.56 15.96 3.19 94.61 18.88
197
+ vuewy 8.27 1243.64 1176.32 94.59 35.54 2.86 22.19 1.78 45.13 3.63
198
+ vylyk 99.03 91.89 1.22 1.33 0.33 0.36 90.65 98.65 0.02 0.02
199
+ vzuru 7.03 1171.50 1101.22 94.00 12.09 1.03 14.65 1.25 55.63 4.75
200
+ wcxfk 16.44 220.44 187.11 84.88 2.91 1.32 24.18 10.97 9.15 4.15
201
+ wdvva 11.22 75.80 72.58 95.75 5.28 6.97 3.12 4.11 0.11 0.14
202
+ wemos 17.20 971.81 889.26 91.50 84.55 8.70 31.54 3.25 51.02 5.25
203
+ wibky 10.15 239.48 223.91 93.50 8.73 3.65 1.09 0.46 14.48 6.05
204
+ wlfsf 6.78 497.53 475.13 95.50 11.35 2.28 8.81 1.77 13.60 2.73
205
+ wprog 27.15 835.45 735.79 88.07 127.12 15.22 29.17 3.49 70.50 8.44
206
+ wwvcs 7.90 981.21 954.89 97.32 51.15 5.21 22.60 2.30 3.72 0.38
207
+ wwzsk 2.52 645.51 634.72 98.33 5.50 0.85 8.14 1.26 2.65 0.41
208
+ xffsa 7.73 1016.59 960.68 94.50 22.63 2.23 33.00 3.25 22.92 2.25
209
+ xggbk 8.46 1135.78 1071.41 94.33 31.75 2.80 9.84 0.87 54.53 4.80
210
+ xkgos 7.52 997.02 965.57 96.85 43.54 4.37 18.58 1.86 12.87 1.29
211
+ xkmqx 17.04 51.55 43.50 84.39 0.74 1.43 4.23 8.20 3.82 7.41
212
+ xlsme 10.50 997.11 974.71 97.75 82.34 8.26 6.37 0.64 16.02 1.61
213
+ xlyov 1.25 632.43 631.59 99.87 7.05 1.11 0.84 0.13 0.00 0.00
214
+ xmyyy 17.57 242.42 211.53 87.26 11.69 4.82 15.30 6.31 15.59 6.43
215
+ xqxkt 3.16 1117.95 1101.35 98.52 18.73 1.67 9.61 0.86 6.99 0.63
216
+ xtdcl 14.30 157.37 149.58 95.05 14.71 9.35 7.25 4.61 0.54 0.34
217
+ xtzoq 46.26 179.23 104.92 58.54 8.61 4.80 21.72 12.12 52.58 29.34
218
+ xvxwv 6.01 273.43 259.09 94.75 2.08 0.76 5.96 2.18 8.38 3.06
219
+ ybhwz 5.35 496.82 478.86 96.39 8.62 1.73 5.81 1.17 12.15 2.45
220
+ ygrip 10.66 283.48 259.81 91.65 6.54 2.31 1.95 0.69 21.72 7.66
221
+ ylgug 4.51 1082.20 1067.35 98.63 34.01 3.14 6.21 0.57 8.64 0.80
222
+ ylzez 6.50 1094.31 1086.98 99.33 63.78 5.83 6.51 0.59 0.82 0.07
223
+ ytmef 2.75 484.05 483.32 99.85 12.57 2.60 0.73 0.15 0.00 0.00
224
+ ytula 3.46 993.81 986.58 99.27 27.13 2.73 6.98 0.70 0.25 0.03
225
+ yukhy 11.37 706.15 637.16 90.23 11.28 1.60 37.61 5.33 31.38 4.44
226
+ yzvon 7.81 781.25 755.76 96.74 35.50 4.54 18.90 2.42 6.60 0.84
227
+ zedtj 5.61 1076.85 1061.41 98.57 44.92 4.17 5.53 0.51 9.91 0.92
228
+ zehzu 6.35 160.91 153.73 95.54 3.04 1.89 1.43 0.89 5.75 3.57
229
+ zfzlc 3.84 1178.99 1155.40 98.00 21.73 1.84 18.53 1.57 5.06 0.43
230
+ zowse 9.93 1037.54 1000.97 96.48 66.49 6.41 12.82 1.24 23.75 2.29
231
+ zqidv 12.58 723.78 672.53 92.92 39.80 5.50 23.27 3.22 27.98 3.87
232
+ zsgto 7.76 1086.64 1048.96 96.53 46.64 4.29 11.73 1.08 25.95 2.39
233
+ zzsba 10.94 1075.02 1009.28 93.88 51.85 4.82 12.90 1.20 52.84 4.92
234
+ zztbo 5.44 54.72 53.77 98.27 2.03 3.71 0.95 1.73 0.00 0.00
235
+ zzyyo 11.21 1120.70 1055.89 94.22 60.84 5.43 29.95 2.67 34.85 3.11
236
+ TOTAL 11.24 144788.60 134910.06 93.18 6394.55 4.42 4176.97 2.88 5701.57 3.94
reproducible_research/2.1/VoxConverse.test.rttm ADDED
The diff for this file is too large to render. See raw diff
 
technical_report_2.1.pdf ADDED
Binary file (372 kB). View file