|
<!doctype html> |
|
<html lang="en"> |
|
<head> |
|
|
|
<script async src="https://www.googletagmanager.com/gtag/js?id=G-LENBCEYH86"></script> |
|
<script> |
|
window.dataLayer = window.dataLayer || []; |
|
function gtag(){dataLayer.push(arguments);} |
|
gtag('js', new Date()); |
|
|
|
gtag('config', 'G-LENBCEYH86'); |
|
</script> |
|
|
|
<meta charset="utf-8"> |
|
<meta name="viewport" content="width=device-width, initial-scale=1"> |
|
<link rel="icon" class="js-site-favicon" type="image/png" href="./static/logo.svg"> |
|
<title>Petals – Decentralized platform for running large language models</title> |
|
<link href="./static/bootstrap.min.css" rel="stylesheet"> |
|
<link href="./static/style.css" rel="stylesheet"> |
|
</head> |
|
<body> |
|
|
|
<main> |
|
<div class="position-relative overflow-hidden px-5 pt-1 m-md-4 text-center"> |
|
<div class="col-lg-6 col-md-8 p-md-3 mx-auto my-3" style="max-width: 700px;"> |
|
<div class="mb-4"> |
|
<div class="d-md-inline-block pe-md-4"> |
|
<a target="_blank" href="https://petals.dev"><img src="./static/logo.svg" height="100" class="rot-image"></a> |
|
</div> |
|
<h1 class="display-4 fw-bold d-md-inline-block justify-content-center" style="font-size: 40pt; vertical-align: middle;"> |
|
Petals |
|
<span style="font-size: 25pt; color: #aaa;">Chat</span> |
|
</h1> |
|
</div> |
|
<div class="welcome mb-4"> |
|
<div> |
|
<b>Welcome!</b> This is a demo app running |
|
<a target="_blank" class="model-name" href="https://huggingface.co/meta-llama/Llama-2-70b-chat-hf">LLaMA 2 (70B-chat)</a> |
|
over the <a target="_blank" href="https://petals.dev">Petals</a> network. |
|
Please follow the model's |
|
<a target="_blank" class="license-link" href="https://bit.ly/llama2-license">terms of use</a> |
|
and do not enter sensitive data. |
|
The chat history is recorded. |
|
</div> |
|
<form id="settings"> |
|
<div class="mt-2"> |
|
<label class="group-label">Family:</label> |
|
<div class="btn-group family-selector" role="group"> |
|
<input type="radio" class="btn-check" name="family" value="llama-2" id="family-llama-2" checked> |
|
<label class="btn btn-outline-primary" for="family-llama-2">LLaMA 2</label> |
|
<input type="radio" class="btn-check" name="family" value="llama" id="family-llama"> |
|
<label class="btn btn-outline-primary" for="family-llama">LLaMA</label> |
|
<input type="radio" class="btn-check" name="family" value="bloom" id="family-bloom"> |
|
<label class="btn btn-outline-primary" for="family-bloom">BLOOM</label> |
|
</div> |
|
</div> |
|
<div class="mt-2"> |
|
<label class="group-label">Model:</label> |
|
<div class="model-selector btn-group" role="group" data-family="llama-2"> |
|
<input type="radio" class="btn-check" name="model" value="meta-llama/Llama-2-70b-chat-hf" id="meta-llama-2-70b-chat-hf" checked> |
|
<label class="btn btn-outline-primary" for="meta-llama-2-70b-chat-hf">LLaMA 2 (70B-chat)</label> |
|
<input type="radio" class="btn-check" name="model" value="meta-llama/Llama-2-70b-hf" id="meta-llama-2-70b-hf"> |
|
<label class="btn btn-outline-primary" for="meta-llama-2-70b-hf">LLaMA 2 (70B)</label> |
|
</div> |
|
<div class="model-selector btn-group" role="group" data-family="llama" style="display: none;"> |
|
<input type="radio" class="btn-check" name="model" value="timdettmers/guanaco-65b" id="model-guanaco-65b"> |
|
<label class="btn btn-outline-primary" for="model-guanaco-65b">Guanaco-65B</label> |
|
<input type="radio" class="btn-check" name="model" value="enoch/llama-65b-hf" id="model-llama-65b-hf"> |
|
<label class="btn btn-outline-primary" for="model-llama-65b-hf">LLaMA-65B</label> |
|
</div> |
|
<div class="model-selector btn-group" role="group" data-family="bloom" style="display: none;"> |
|
|
|
|
|
<input type="radio" class="btn-check" name="model" value="bigscience/bloomz" id="model-bloomz"> |
|
<label class="btn btn-outline-primary" for="model-bloomz">BLOOMZ-176B</label> |
|
</div> |
|
</div> |
|
</form> |
|
</div> |
|
<div class="dialogue"> |
|
<p class="human-replica">A chat between a curious human and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the user's questions.</p> |
|
<p class="ai-replica"><span class="text">Assistant: Hi! How can I help you?</span></p> |
|
<p class="human-replica"><textarea class="form-control" id="exampleTextarea" rows="2">Human: </textarea></p> |
|
</div> |
|
<p class="error-box" style="display: none;"> |
|
Request failed. <a class="retry-link" href="#">Retry</a><br> |
|
<span class="error-message"></span> |
|
<span class="out-of-capacity"><br> |
|
<b>We're out of capacity</b> — attention caches of existing servers are full. |
|
Please come back later, or |
|
<a target="_blank" href="https://github.com/bigscience-workshop/petals#connect-your-gpu-and-increase-petals-capacity">connect your GPU</a> |
|
to increase Petals capacity now! |
|
</span> |
|
</p> |
|
|
|
<p class="acknowledgements mt-5 pt-3"> |
|
|
|
<b>Shift+Enter</b> inserts newlines.<br> |
|
See source code and API docs on <a target="_blank" href="https://github.com/petals-infra/chat.petals.dev">GitHub</a>. |
|
</p> |
|
</div> |
|
</div> |
|
</main> |
|
<script src="https://code.jquery.com/jquery-3.3.1.min.js" crossorigin="anonymous"></script> |
|
<script src="./static/autosize.min.js"></script> |
|
<script src="./static/chat.js"></script> |
|
</body> |
|
</html> |
|
|
