Update README.md
Browse files
README.md
CHANGED
@@ -7,17 +7,17 @@ language:
|
|
7 |
- en
|
8 |
---
|
9 |
|
10 |
-
# Llama3-8B Fine-Tuned for Galician language
|
11 |
|
12 |
-
This repository contains a
|
13 |
|
14 |
## Model Description
|
15 |
|
16 |
-
This
|
17 |
|
18 |
### Technical Details
|
19 |
|
20 |
-
- **Base Model**: Meta's LLaMA 3 8B Instruct
|
21 |
- **Fine-Tuning Platform**: LLaMA Factory
|
22 |
- **Infrastructure**: Finisterrae III, CESGA
|
23 |
- **Dataset**: [irlab-udc/alpaca_data_galician](https://huggingface.co/datasets/irlab-udc/alpaca_data_galician) (with modifications)
|
|
|
7 |
- en
|
8 |
---
|
9 |
|
10 |
+
# Llama3-8B Adapter Fine-Tuned for Galician language
|
11 |
|
12 |
+
This repository contains a Lora adapter to finetune Meta's LLaMA 3-8B Instruct LLM to Galician language.
|
13 |
|
14 |
## Model Description
|
15 |
|
16 |
+
This Lora adapter has been specifically fine-tuned to understand and generate text in Galician. It was refined using a modified version of the [irlab-udc/alpaca_data_galician](https://huggingface.co/datasets/irlab-udc/alpaca_data_galician) dataset, enriched with synthetic data to enhance its text generation and comprehension capabilities in specific contexts.
|
17 |
|
18 |
### Technical Details
|
19 |
|
20 |
+
- **Base Model**: Unsloth Meta's LLaMA 3 8B Instruct (https://huggingface.co/unsloth/llama-3-8b-Instruct-bnb-4bit)
|
21 |
- **Fine-Tuning Platform**: LLaMA Factory
|
22 |
- **Infrastructure**: Finisterrae III, CESGA
|
23 |
- **Dataset**: [irlab-udc/alpaca_data_galician](https://huggingface.co/datasets/irlab-udc/alpaca_data_galician) (with modifications)
|