Hugging Face's logo

GenVRadmin
/
llama38bGenZ_Vikas-Merged

Text Generation
Transformers
Safetensors
llama
conversational
text-generation-inference
Inference Endpoints
Model card Files Community

llama3 variant for 22 Indian languages:-

  1. Tamil
  2. Telugu
  3. Assamese
  4. Kashmiri
  5. Punjabi
  6. Bengali
  7. Sanskrit
  8. Malyalam
  9. Sindhi
  10. Marathi
  11. Gujarati
  12. Kannada
  13. Odia
  14. Maithili
  15. Urdu
  16. Nepali
  17. Manipuri
  18. Dogri
  19. English
  20. Arabic
  21. Santali
  22. Bodo

We first pre-trained the model on 100 million plus Indic language tokens. Then, it was finetuned on close sourced GenZ_Vikas datasets consisting 7.5 million SFT pairs, including 5.5 million Hindi SFT pairs. Finally it underwent DPO training to align it with human preferences.

The model has been benchmarked on Indic LLM leaderboard where it outperforms our AryaBhatta series on Hindi evals. And llama3 base model on all Indian languages.

Training happened on 2*A100 for 24 days.

Link: https://huggingface.co/spaces/Cognitive-Lab/indic_llm_leaderboard

Release link: https://www.linkedin.com/feed/update/urn:li:activity:7199506579828662272

Downloads last month
30
Safetensors
Model size
8.03B params
Tensor type
FP16
·
Inference Examples
Text Generation
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.