kromcomp
/

Llama-3.1-Instruct-fp32-8B

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Llama-3.1-Instruct-fp32-8B

File size: 159 Bytes

34467dc

dtype: float32
merge_method: passthrough
parameters:
  int8_mask: 1.0
slices:
- sources:
  - layer_range: [0, 32]
    model: unsloth/Meta-Llama-3.1-8B-Instruct