Update README.md
Browse files
README.md
CHANGED
@@ -48,18 +48,20 @@ The performance of the model in full context mode (no streaming) is the followin
|
|
48 |
|
49 |
| Release | Test WER | GPUs |
|
50 |
|:-------------:|:--------------:|:--------:|
|
51 |
-
| 24-02-26 |
|
52 |
-
|
53 |
-
|
54 |
-
|
55 |
-
|
56 |
-
|
57 |
-
| full
|
58 |
-
|
59 |
-
|
|
60 |
-
|
|
61 |
-
|
|
62 |
-
|
|
|
|
|
|
63 |
|
64 |
## Pipeline description
|
65 |
|
|
|
48 |
|
49 |
| Release | Test WER | GPUs |
|
50 |
|:-------------:|:--------------:|:--------:|
|
51 |
+
| 24-02-26 | 11.00% | 4xA100 40GB |
|
52 |
+
|
53 |
+
TODO: validate the results
|
54 |
+
|
55 |
+
With streaming, the results with different chunk sizes on the test split are the following:
|
56 |
+
|
57 |
+
| | full | cs=32 (1280ms) | 24 (960ms) | 16 (640ms) | 12 (480ms) | 8 (320ms) |
|
58 |
+
|:-----:|:------:|:------:|:------:|:------:|:------:|:------:|
|
59 |
+
| full | 11.00% | - | - | - | - | - |
|
60 |
+
| lc=32 | - | - | TBD | TBD | TBD | TBD |
|
61 |
+
| 16 | - | - | TBD | TBD | TBD | TBD |
|
62 |
+
| 8 | - | - | 11.50% | TBD | TBD | TBD |
|
63 |
+
| 4 | - | 11.40% | TBD | TBD | TBD | TBD |
|
64 |
+
| 2 | - | 11.46% | TBD | TBD | TBD | TBD |
|
65 |
|
66 |
## Pipeline description
|
67 |
|