I found that the newest version of optimum is 1.21.2, which requires transformers<=4.43.0.
optimum
transformers<=4.43.0
But llama3.1-405b requires transformers>=4.43.3
transformers>=4.43.3
If i ignore the requirement of optimum, using 4.43.3, I met this warning:
· Sign up or log in to comment