Hugging Face's logo

UKPLab
/
dara-llama-2-13b

Text Generation
Transformers
Safetensors
llama
text-generation-inference
Inference Endpoints
Model card Files Community
dara-llama-2-13b / README.md
Haixx's picture
Haixx
Update README.md
6b07cce verified
preview code
|
raw
history blame contribute delete
825 Bytes
metadata
library_name: transformers
license: apache-2.0
datasets:
  - UKPLab/dara

DARA: Decomposition-Alignment-Reasoning Autonomous Language Agent for Question Answering over Knowledge Graphs

Model Information

This model is a fine-tuned semantic parsing LLM agent for KGQA. We fine-tune the llama-2-13B on our curated reasoning trajectory https://huggingface.co/datasets/UKPLab/dara.

Model Usage from transformers import AutoModelForCausalLM

model = AutoModelForCausalLM.from_pretrained( "UKPLab/dara-llama-2-13b", torch_dtype=torch.float16, device_map="auto", cache_dir = "cache" ) For more information, please check the repository https://github.com/UKPLab/acl2024-DARA

Hyperparameters Learning rate: 2e-5 Batch size: 4 Training epochs: 10