Model Card for Model-demo-35M

This model is used for a demo classification task

Task type

Protein-level Classification

Model input type

SA Sequence

Label meanings

0: A

1: B

2: C

3: D

LoRA config

  • r: 8
  • lora_dropout: 0.0
  • lora_alpha: 16
  • target_modules: ['query', 'intermediate.dense', 'key', 'value', 'output.dense']
  • modules_to_save: ['classifier']

Training config

  • optimizer:
    • class: AdamW
    • betas: (0.9, 0.98)
    • weight_decay: 0.01
  • learning rate: 0.001
  • epoch: 1
  • batch size: 2
  • precision: 16-mixed
Downloads last month
4
Inference API
Unable to determine this model’s pipeline type. Check the docs .

Model tree for CluelessNovice/demo_cls

Adapter
(60)
this model