Endpoint encountered an error
2
#5 opened 12 months ago
by
vanokio
You are using a model of type mixtral_aqlm to instantiate a model of type mixtral. This is not supported for all configurations of models and can yield errors.
3
#3 opened 12 months ago
by
Tejasram
Loading Model on AWS G5.4xlarge Instance Results in 'killed' Message
1
#2 opened 12 months ago
by
Tejasram