Model Card for Model-Demo-35M

This model is used for a demo task

Task type

Protein-level Classification

Model input type

SA Sequence

LoRA config

  • r: 8
  • lora_dropout: 0.0
  • lora_alpha: 16
  • target_modules: ['query', 'key', 'intermediate.dense', 'value', 'output.dense']
  • modules_to_save: ['classifier']

Training config

  • optimizer:
    • class: AdamW
    • betas: (0.9, 0.98)
    • weight_decay: 0.01
  • learning rate: 0.0005
  • epoch: 5
  • batch size: 1
  • precision: 16-mixed
Downloads last month
6
Inference API
Unable to determine this model’s pipeline type. Check the docs .

Model tree for LTEnjoy-test/te

Adapter
(60)
this model