File size: 536 Bytes
d9732fa 5be9acc d9732fa 5be9acc d9732fa 5be9acc d9732fa 5be9acc d9732fa 5be9acc |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 |
---
library_name: transformers
tags: []
---
# OFT model for PEFT testing purposes
Use PEFT version 0.12.0.
```python
from transformers import AutoModelForCausalLM
from peft import OFTConfig, get_peft_model
model_id = "hf-internal-testing/tiny-random-OPTForCausalLM"
model = AutoModelForCausalLM.from_pretrained(model_id)
config = OFTConfig(init_weights=False, target_modules="all-linear")
model = get_peft_model(model, config)
hub_id = "peft-internal-testing/OFT-tiny-random-OPTForCausalLM"
model.push_to_hub(hub_id, token=...)
``` |