Taking some time to generate results
The model is taking around 10 mins. to generate results (using original sample schema provided).
Does it support multiple tables ?
Hi
It does support multiple tables. I have updated the prompt in the model card.
Yes, speed might be slow if you are on CPU. You should have GPU to run this model in seconds as this model is in full-precision and not quantized.
If you are looking for more powerful model and want to run in CPU, use my this model "https://huggingface.co/ByteForge/Defog_llama-3-sqlcoder-8b-ct2-int8_float16". Its more powerful and usually takes 20-30 Seconds on CPU
Hit me up if you face any issues
Thanks
Hey! Thanks buddy, the model link you provided is now taking around 1.5mins to generate.
I am using a virtual machine with 12 CPUs & 64Gb ram. Can you provided hardware requirements(that you are using) for both the models.
If possible can we have a session, for better understanding whenever you are available.
Hi Following Up....