Why using Xquad For Fine-tuning?
https://arxiv.org/pdf/2311.05741.pdf
I have read your paper and found that you used Xquad for fine tuning and use Xquad for evaluation. In Xquad dataset , they dont have training set but only Validation set for evaluate model. This is Data leak or not ?
Hi @Rasu23 thanks for your comment!
Please note that this paper was exploratory work we did last year before SambaLingo, so the linked paper is not the recipe we used for SambaLingo models. To see the samba lingo recipe please check out our blog post https://sambanova.ai/blog/sambalingo-open-source-language-experts - and we have an upcoming paper.
But regards to your comment, in our previous paper (https://arxiv.org/pdf/2311.05741.pdf), we were not aware of training on xquad, but it is possible our Instruction tuning datasets got contaminated with it.