File size: 809 Bytes
95c2c7d
 
 
069b892
95c2c7d
 
 
 
 
069b892
95c2c7d
069b892
 
95c2c7d
 
069b892
95c2c7d
 
069b892
 
 
95c2c7d
069b892
95c2c7d
069b892
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
---
language:
- en
license: cc-by-nc-4.0
tags:
- text-generation-inference
- transformers
- unsloth
- mistral
- GEB
base_model: cgato/Thespis-CurtainCall-7b-v0.3
datasets:
- maldv/crabcanon
---

# SHRDFU-7b β

- **Developed by:** maldv
- **License:** cc-by-nc-4.0
- **Finetuned from model:** cgato/Thespis-CurtainCall-7b-v0.3
- **Methodology:** Targeting attention layers with peft to condition; then small full layer tuning; extending intelligence and problem solving w/ crabcanon

As I work on understanding how to layer information in to the model, I'm having a tough time with this one without making it crazy.  Maybe crazy was the way to go?

[<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="50"/>](https://github.com/unslothai/unsloth)