Hugging Face's logo

ssmits
/
Qwen2-7B-embed-base

Feature Extraction
Transformers
Safetensors
English
qwen2
embeddings
base-model
qwen
text-generation-inference
text-embeddings-inference
Inference Endpoints
Model card Files Community
1
Edit model card

Qwen2-7B-embed-base

This is a base model derived from Qwen2.5-7B-Instruct with the language modeling head removed. It's intended to be used as a base for embedding tasks and further fine-tuning.

Model Details

  • Base model: Qwen2.5-7B-Instruct
  • The 'lm_head' layer has been removed
  • Maintains the original model's norm layers
  • Suitable for embedding tasks and custom head additions
Downloads last month
13
Safetensors
Model size
7.07B params
Tensor type
FP16
·
Inference Examples
Feature Extraction
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.