metadata

license: llama2
datasets:
  - OpenAssistant/oasst1
  - shahules786/orca-best
language:
  - en

Open-Assistant CodeLlama 13B SFT v10

This model is an Open-Assistant fine-tuning of Meta's CodeLlama 13B LLM.

Model Details

Finetuned from: codellama via epfLLM/Megatron-LLM
Model type: Causal decoder-only transformer language model
Language: English
Weights & Biases training logs: 6123 steps run56_oa_llamacode
Demo: Continuations for 250 random prompts (without system message)
License: LLAMA 2 COMMUNITY LICENSE AGREEMENT
Contact: Open-Assistant Discord

Prompting / Prompt Template

Due to public demand (see survey) we changed the prompt-template for this model from custom prompter/assistant tokens to OpenAI's chatml standard prompt format. We hope that this leads to greater compatibility with chat inference/frontend applications.

Prompt dialogue template:

"""
<|im_start|>system
{system_message}<|im_end|>
<|im_start|>user
{prompt}<|im_end|>
<|im_start|>assistant
"""

The model input can contain multiple conversation turns between user and assistant, e.g.

<|im_start|>user
{prompt 1}<|im_end|>
<|im_start|>assistant
{reply 1}<|im_end|>
<|im_start|>user
{prompt 2}<|im_end|>
<|im_start|>assistant
(...)

The model was partly trained with orca system messages.
For inference we recommend to use the official Llama2 system message:

<|im_start|>system
You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature.

If a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.
<|im_end|>