Ashutosh Zade's picture
3 20

Ashutosh Zade

ashutoshzade

AI & ML interests

Natural Intelligence

Recent Activity

updated a Space about 1 month ago
ashutoshzade/TestGemma2
liked a Space about 2 months ago
ashutoshzade/HelloWorldRAG
updated a Space about 2 months ago
ashutoshzade/HelloWorldRAG
View all activity

Organizations

ashutoshzade's activity

updated a Space about 1 month ago
Reacted to louisbrulenaudet's post with ๐Ÿ”ฅ 3 months ago
view post
Post
2587
The Romulus model series has been released on Hugging Face, continually pre-trained on 34,864,949 tokens of French laws and intended to serve as a foundation for fine-tuning on labeled data ๐Ÿค—

The training code, dataset and model weights are open and available free on HF and the training was based on H100 provided by Microsoft for Startups using Unsloth AI by @danielhanchen and @shimmyshimmer ๐Ÿฆฅ

Link to the base model: louisbrulenaudet/Romulus-cpt-Llama-3.1-8B-v0.1

Link to the instruct model: louisbrulenaudet/Romulus-cpt-Llama-3.1-8B-v0.1-Instruct

Link to the dataset: louisbrulenaudet/Romulus-cpt-fr

Please note that these models have not been aligned for the production of usable texts as they stand, and will certainly need to be refined for the desired tasks in order to produce satisfactory results.
  • 1 reply
ยท
upvoted an article 4 months ago