Hugging Face's logo

v000000
/
L3.1-Niitorm-8B-LATCOSx2-Version-GGUFs-IMATRIX

GGUF
llama
Merge
llama-cpp
Inference Endpoints
conversational
Model card Files Community
L3.1-Niitorm-8B-LATCOSx2-Version-GGUFs-IMATRIX / README.md
v000000's picture
v000000
Update README.md
35080b6 verified
preview code
|
raw
history blame
832 Bytes
metadata
base_model: v000000/L3.1-Niitorm-8B-LATCOSx2
tags:
  - llama
  - merge
  - llama-cpp

Llama-3.1-Niitorm-8B-LATCOSx2

d48ca23f-9063-4a66-a6b8-0abcbfe26dc5.jpg

This is a test, "v000000/L3.1-Niitorm-8B-t0.0001" but merged one extra time with "akjindal53244/Llama-3.1-Storm-8B". Using a new merging algorithm I wrote "LATCOS", which is non linear interpolation and cosine vector similarity between tensors in both magnitude and direction. This attempts to find the smoothest possible interpolation and make them work more seamlessly together by taking into account the vector direction where both models agree. Seems a lot smarter, but also more compliant which could be a negative since it's less dynamic.