Update README.md
Browse files
README.md
CHANGED
@@ -1,3 +1,31 @@
|
|
1 |
-
---
|
2 |
-
license: mit
|
3 |
-
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
license: mit
|
3 |
+
---
|
4 |
+
# PaliGemma-3B-MalayaLLM
|
5 |
+
|
6 |
+
<img src="https://github.com/user-attachments/assets/8e8937a7-fd47-482c-acaf-48efc3c04597" alt="Baby MalayaLLM" width="300" height="auto">
|
7 |
+
|
8 |
+
# Introducing the Developer:
|
9 |
+
Discover the mind behind this model and stay updated on their contributions to the field
|
10 |
+
https://www.linkedin.com/in/vishnu-prasad-j/
|
11 |
+
|
12 |
+
# Model description
|
13 |
+
This is a PaliGemma-3B based model for Malayalam captioning and Visual Question Answering.
|
14 |
+
|
15 |
+
- **Model type:** A 3B PaliGemma-2 finetuned model on Malayalam captions and queries.
|
16 |
+
- **Language(s):** Malayalam and English
|
17 |
+
- **Datasets:**
|
18 |
+
* [VishnuPJ/SAM-LLAVA-20k-Malayalam-Caption-Pretrain](https://huggingface.co/datasets/VishnuPJ/SAM-LLAVA-20k-Malayalam-Caption-Pretrain)
|
19 |
+
* [VishnuPJ/laion-14k-GPT4V-LIVIS-Captions_Malayalam](https://huggingface.co/datasets/VishnuPJ/laion-14k-GPT4V-LIVIS-Captions_Malayalam)
|
20 |
+
* [VishnuPJ/Malayalam-VQA](https://huggingface.co/datasets/VishnuPJ/Malayalam-VQA)
|
21 |
+
- **Caption Model-Full Precisoin:** [VishnuPJ/MalayaLLM-Paligemma-Caption-3B-Full-Precision](https://huggingface.co/VishnuPJ/MalayaLLM-Paligemma-Caption-3B-Full-Precision)
|
22 |
+
- **Caption 4bit Quant:** [VishnuPJ/MalayaLLM-Paligemma-Caption-3B-4bitQuant](https://huggingface.co/VishnuPJ/MalayaLLM-Paligemma-Caption-3B-4bitQuant)
|
23 |
+
- **VQA Model-Full Precison:** [VishnuPJ/MalayaLLM-Paligemma-VQA-3B-Full-Precision](https://huggingface.co/VishnuPJ/MalayaLLM-Paligemma-VQA-3B-Full-Precision)
|
24 |
+
- **VQA 4bit Quant:** [VishnuPJ/MalayaLLM-Paligemma-VQA-3B-4bitQuant](https://huggingface.co/VishnuPJ/MalayaLLM-Paligemma-VQA-3B-4bitQuant)
|
25 |
+
- **VQA LORA Adapters:** [VishnuPJ/MalayaLLM-Paligemma-VQA-3B-Adapters](https://huggingface.co/VishnuPJ/MalayaLLM-Paligemma-VQA-3B-Adapters)
|
26 |
+
- **Training Precision:** `float16`,`4bit`
|
27 |
+
|
28 |
+
# Dataset Creation
|
29 |
+
I have used [indictrans2](https://huggingface.co/ai4bharat/indictrans2-en-indic-1B) for translating English datasets to Malayalam.
|
30 |
+
|
31 |
+
# 🌟Happy coding💻🌟
|