This is a pruned version of the LLaMA2-7b model based on hyperboloid method where similarity was calculated based on hyperbolic distance. 9 layers have been pruned. The alpaca dataset was used as calibration data here.
Downloads last month
2
Safetensors
Model size
4.92B params
Tensor type
FP16
·
Inference API
Unable to determine this model's library. Check the
docs
.
