Great job! And how did you quantize the jais to 4-bit?
Using bitsandbytes
· Sign up or log in to comment