Create README.md
Browse files
README.md
ADDED
@@ -0,0 +1,19 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
datasets:
|
3 |
+
- jhu-clsp/jfleg
|
4 |
+
language:
|
5 |
+
- en
|
6 |
+
base_model:
|
7 |
+
- google/flan-t5-large
|
8 |
+
pipeline_tag: text2text-generation
|
9 |
+
tags:
|
10 |
+
- text-generation-inference
|
11 |
+
- grammar
|
12 |
+
---
|
13 |
+
|
14 |
+
This model is part of the [GrammarCorrector](https://github.com/akhmat-s/GrammarCorrector) tool.
|
15 |
+
|
16 |
+
Fine-tuning for the FlanT5 model uses a dataset called [JFLEG](https://arxiv.org/abs/1702.04066). The primary objective of the experiment was to develop a highly effective tool using a minimal dataset.
|
17 |
+
|
18 |
+
To accomplish this goal, we implement the key strategy:
|
19 |
+
- [Perplexity-Based Data](https://arxiv.org/abs/2405.20541) Pruning With Small Reference Models.
|