File size: 1,003 Bytes
ed980e5 53d674b ed980e5 53d674b 2573c5e 57ddfde 9594be2 e3f9266 ed980e5 53d674b ed980e5 57ddfde 4defe05 d981a81 53d674b 4defe05 2ec0205 4defe05 2ec0205 4defe05 2ec0205 d981a81 4defe05 d981a81 4defe05 d981a81 4defe05 53d674b |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 |
# Cognitivess Model
## Usage
To use this model, first install the custom package:
```bash
# Install required packages
!pip install git+https://huggingface.co/CognitivessAI/cognitivess
```
Then, you can use the model like this:
```python
from transformers import AutoTokenizer, AutoModelForCausalLM
import torch
model_id = "CognitivessAI/cognitivess"
# Load the tokenizer
tokenizer = AutoTokenizer.from_pretrained(model_id)
# Load the model
model = AutoModelForCausalLM.from_pretrained(
model_id,
torch_dtype=torch.float32,
device_map="auto"
)
messages = [
{"role": "user", "content": "Explain how large language models work in detail."},
]
input_ids = tokenizer.apply_chat_template(messages, add_generation_prompt=True, return_tensors="pt").to(model.device)
outputs = model.generate(
input_ids,
do_sample=True,
temperature=0.5,
max_new_tokens=1024
)
response = outputs[0][input_ids.shape[-1]:]
print(tokenizer.decode(response, skip_special_tokens=True))
```
|