README.md

metadata

license: apache-2.0
datasets:
  - timdettmers/openassistant-guanaco

This model is a test using Intel Gaudi Habana 2 chips using DDP training. Trained over 8xGaudi-2 Chips using DDP and Deepspeed using the openassistant dataset.

Prompt Format

This model uses ChatML as the prompt format.

<|im_start|>system
You are a helpful assistant for Python which outputs in Markdown format.<|im_end|>
<|im_start|>user
Write a function to calculate the Fibonacci sequence<|im_end|>
<|im_start|>assistant