akhmat-s commited on
Commit
9ba14c1
1 Parent(s): 877dda8

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +6 -1
README.md CHANGED
@@ -13,4 +13,9 @@ tags:
13
 
14
  This model is part of the [GrammarCorrector](https://github.com/akhmat-s/GrammarCorrector) tool.
15
 
16
- "[FlanT5 from scratch for the grammar correction tool](https://medium.com/@akhmat-s/flant5-from-scratch-for-the-grammar-correction-tool-deadba9a6778)" article about how this model was trained.
 
 
 
 
 
 
13
 
14
  This model is part of the [GrammarCorrector](https://github.com/akhmat-s/GrammarCorrector) tool.
15
 
16
+ "[FlanT5 from scratch for the grammar correction tool](https://medium.com/@akhmat-s/flant5-from-scratch-for-the-grammar-correction-tool-deadba9a6778)" article about how this models was trained:
17
+ >FlanT5 was trained using [JFLEG](https://arxiv.org/abs/1702.04066) dataset. The primary objective of the experiment was to develop a highly effective tool using relatively small models, minimal datasets, and constrained computational resources.
18
+ >
19
+ >To accomplish this goal, we implemented two key strategies:
20
+ >- [Perplexity-Based Data](https://arxiv.org/abs/2405.20541) Pruning With Small Reference Models.
21
+ >- A simple sampling and voting method for [multiple LLM agents](https://arxiv.org/abs/2402.05120). model was trained.