Model Card for Model-Demo-35M
This model is used for a demo task
Task type
Protein-level Regression
Model input type
SA Sequence
LoRA config
- r: 8
- lora_dropout: 0.0
- lora_alpha: 16
- target_modules: ['value', 'output.dense', 'query', 'intermediate.dense', 'key']
- modules_to_save: ['classifier']
Training config
- optimizer:
- class: AdamW
- betas: (0.9, 0.98)
- weight_decay: 0.01
- learning rate: 0.0005
- epoch: 5
- batch size: 1
- precision: 16-mixed
Framework versions
- PEFT 0.10.0
- Downloads last month
- 0
Inference Providers
NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API:
The model has no pipeline_tag.
Model tree for Adam-Fan/model-demo2
Base model
westlake-repl/SaProt_35M_AF2