jrc commited on
Commit
608fa9b
1 Parent(s): 42f4cfa

Update README.md

Browse files

### Llama3 CoEdit

This is a Llama3 8B model trained using [torchtune](https://pytorch.org/torchtune) on the `grammarly/coedit` dataset.

### Training details

See `8B_lora.yaml` file for all configuration. In order to use the `grammarly/coedit` dataset, I added this line to the config:

```
dataset:
_component_: torchtune.datasets.instruct_dataset
source: grammarly/coedit
template: GrammarErrorCorrectionTemplate
column_map: {"sentence": "src", "output": "tgt"}
train_on_input: False
split: train
```

### Evaluation

Files changed (1) hide show
  1. README.md +2 -0
README.md CHANGED
@@ -6,4 +6,6 @@ language:
6
  - en
7
  metrics:
8
  - accuracy
 
 
9
  ---
 
6
  - en
7
  metrics:
8
  - accuracy
9
+ tags:
10
+ - torchtune
11
  ---