Try this with a better model?
Why dont you do this with a more prominent and popular model? Like mistral ai models (id recommend openchat-3.5-0106), or maybe one of the deepseekcoder-base models. The solar10b models would be a good option also. Im just saying, llama 2 is old news at this point
If you want a larger model i have released a base coding model myself that needs fine tuned on coding instruct bellow:
Please train for PHP also.
Hello
@rombodawg
, I plan to release ffts using both base models mistral & mixtral. Solar 10b I am yet to test it. I am not the fastest bit of slow but steady. Despite using old models (llama-2) my coding related models are in top 25 models on Can Ai Code .
Thank you for sharing your base model. I will test it. Also if you have access to 8xA100/H100 then kindly share it which will help me release more powerful models. Thanks
Hello @vampires I think there shouldn't be any problem with php.