Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
Honkware
/
Manticore-13b-Landmark
like
8
Text Generation
Transformers
PyTorch
llama
custom_code
text-generation-inference
Inference Endpoints
arxiv:
2305.16300
License:
other
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
Edit model card
Manticore-13b-Landmark
Key Features
Composition
Using Oobabooga
Landmark Training Code
Manticore-13b-Landmark
Key Features
Landmark Attention
Large Context Size (~18k)
Composition
Manticore-13b-Landmark is a blend of:
Manticore-13B
Manticore-13B-Landmark-QLoRA
Using
Oobabooga
Trust Remote Code -
(Enabled)
Add the bos_token to the beginning of prompts -
(Disabled)
Truncate the prompt up to this length -
(Increased)
Landmark Training Code
See
GitHub
for the training code.
Downloads last month
7
Inference Examples
Text Generation
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to
Inference Endpoints (dedicated)
instead.
