ai-forever
commited on
Commit
•
3a95713
1
Parent(s):
d2a9583
Update README.md
Browse files
README.md
CHANGED
@@ -15,12 +15,13 @@ tags:
|
|
15 |
### Summary
|
16 |
The model corrects spelling errors and typos by bringing all words in the text to the standard English language.
|
17 |
The proofreader was trained based on the [T5-large](https://huggingface.co/t5-large) model.
|
18 |
-
An extensive dataset with “artificial” errors was taken as a training corpus: the corpus was assembled on the basis of the English-language Wikipedia and News blogs, then typos and spelling errors were automatically introduced into it using the functionality of the [SAGE
|
19 |
|
20 |
-
###
|
21 |
-
- [
|
22 |
-
- [
|
23 |
-
- [
|
|
|
24 |
|
25 |
### Examples
|
26 |
| Input | Output |
|
@@ -78,7 +79,7 @@ print(answer)
|
|
78 |
```
|
79 |
|
80 |
## Resources
|
81 |
-
- [SAGE library
|
82 |
- [ruM2M100-1.2B](https://huggingface.co/ai-forever/RuM2M100-1.2B), HuggingFace
|
83 |
- [ruM2M100-418M](https://huggingface.co/ai-forever/RuM2M100-420M), HuggingFace
|
84 |
- [FredT5-large-spell](https://huggingface.co/ai-forever/FRED-T5-large-spell), HuggingFace
|
@@ -86,7 +87,7 @@ print(answer)
|
|
86 |
|
87 |
## License
|
88 |
The [T5-large](https://huggingface.co/t5-large) model, on which our solution is based, and its source code are supplied under the APACHE-2.0 license.
|
89 |
-
Our solution is supplied under
|
90 |
|
91 |
## Specifications
|
92 |
- File size: 3 Gb;
|
@@ -96,4 +97,4 @@ Our solution is supplied under the MIT license.
|
|
96 |
- Developer: SberDevices, AGI NLP
|
97 |
|
98 |
## Contacts
|
99 |
-
|
|
|
15 |
### Summary
|
16 |
The model corrects spelling errors and typos by bringing all words in the text to the standard English language.
|
17 |
The proofreader was trained based on the [T5-large](https://huggingface.co/t5-large) model.
|
18 |
+
An extensive dataset with “artificial” errors was taken as a training corpus: the corpus was assembled on the basis of the English-language Wikipedia and News blogs, then typos and spelling errors were automatically introduced into it using the functionality of the [SAGE library](https://github.com/orgs/ai-forever/sage).
|
19 |
|
20 |
+
### Public references
|
21 |
+
- [SAGE library announcement](https://youtu.be/yFfkV0Qjuu0), DataFest 2023
|
22 |
+
- [Paper about synthetic error generation methods](https://www.dialog-21.ru/media/5914/martynovnplusetal056.pdf), Dialogue 2023
|
23 |
+
- [Paper about SAGE and our best solution](https://arxiv.org/abs/2308.09435), Review EACL 2024
|
24 |
+
- [Path_to_model](https://huggingface.co/ai-forever/T5-large-spell)
|
25 |
|
26 |
### Examples
|
27 |
| Input | Output |
|
|
|
79 |
```
|
80 |
|
81 |
## Resources
|
82 |
+
- [SAGE library](https://github.com/orgs/ai-forever/sage), GitHub
|
83 |
- [ruM2M100-1.2B](https://huggingface.co/ai-forever/RuM2M100-1.2B), HuggingFace
|
84 |
- [ruM2M100-418M](https://huggingface.co/ai-forever/RuM2M100-420M), HuggingFace
|
85 |
- [FredT5-large-spell](https://huggingface.co/ai-forever/FRED-T5-large-spell), HuggingFace
|
|
|
87 |
|
88 |
## License
|
89 |
The [T5-large](https://huggingface.co/t5-large) model, on which our solution is based, and its source code are supplied under the APACHE-2.0 license.
|
90 |
+
Our solution is supplied under MIT license.
|
91 |
|
92 |
## Specifications
|
93 |
- File size: 3 Gb;
|
|
|
97 |
- Developer: SberDevices, AGI NLP
|
98 |
|
99 |
## Contacts
|
100 |
+
nikita.martynov.98@list.ru
|