Jamba Notebook
#1
by
Severian
- opened
Hey @mlabonne ! Awesome work, thanks for sharing. I have been trying to train Jamba myself with my normal fine-tuning code/approach and have been having mixed results. Would you be willing to share the LazyAxolotl notebook? I oddly enough have never tried the Axolotl framework but think this might be the best way to train Jamba effectively after various set-ups.
Thanks for all your great work and insights!
Thanks @Severian ! Sure, here's the Colab notebook: https://colab.research.google.com/drive/1alsgwZFvLPPAwIgkAxeMKHQSJYfW7DeZ?usp=sharing
Many thanks! Excited to try it out
Severian
changed discussion status to
closed