Not-For-All-Audiences

Model card Files Files and versions Community

File size: 5,926 Bytes

---
license: llama3
tags:
- not-for-all-audiences
---
<!DOCTYPE html>
<style>

body {

font-family: 'Quicksand', sans-serif;

background: linear-gradient(135deg, #2E3440 0%, #1A202C 100%);

color: #D8DEE9;

margin: 0;

padding: 0;

font-size: 16px;

}

.container {

width: 80% auto;

max-width: 1080px auto;

margin: 20px auto;

background-color: rgba(255, 255, 255, 0.02);

padding: 20px;

border-radius: 12px;

box-shadow: 0 4px 10px rgba(0, 0, 0, 0.2);

backdrop-filter: blur(10px);

border: 1px solid rgba(255, 255, 255, 0.1);

}

.header h1 {

font-size: 28px;

color: #ECEFF4;

margin: 0 0 20px 0;

text-shadow: 2px 2px 4px rgba(0, 0, 0, 0.3);

}

.update-section {

margin-top: 30px;

}

.update-section h2 {

font-size: 24px;

color: #88C0D0;

}

.update-section p {

font-size: 16px;

line-height: 1.6;

color: #ECEFF4;

}

.info img {

width: 100%;

border-radius: 10px;

margin-bottom: 15px;

}

a {

color: #88C0D0;

text-decoration: none;

}

a:hover {

color: #A3BE8C;

}

.button {

display: inline-block;

background-color: #5E81AC;

color: #E5E9F0;

padding: 10px 20px;

border-radius: 5px;

cursor: pointer;

text-decoration: none;

}

.button:hover {

background-color: #81A1C1;

}

pre {

background-color: #2E3440;

padding: 10px;

border-radius: 5px;

overflow-x: auto;

}

code {

font-family: 'Courier New', monospace;

color: #D8DEE9;

}

</style>
<html lang="en">
<head>
<meta charset="UTF-8">
<meta name="viewport" content="width=device-width, initial-scale=1.0">
<title>L3-Arcania-4x8b Data Card</title>
<link href="https://fonts.googleapis.com/css2?family=Quicksand:wght@400;500;600&display=swap" rel="stylesheet">
</head>
<body>
<div class="container">
<div class="header">
<h1>L3-Arcania-4x8b</h1>
</div>
<div class="info">
<img src="https://cdn-uploads.huggingface.co/production/uploads/64545af5ec40bbbd01242ca6/HfdZs1XAXZ8vfd8ZFLq8H.png">
<p>Now that the cute anime girl has your attention.</p>
<p><strong>Creator:</strong> <a href="https://huggingface.co/Steelskull" target="_blank">SteelSkull</a></p>
<p><strong>About L3-Arcania-4x8b:</strong> A Mixture of Experts model designed for general assistance, storytelling, roleplay, and ERP.</p>
    <li>Integrates models from notable sources for enhanced performance in diverse tasks.</p>
<p>This model is based off of the work ive done on Umbra v1-v3 basically the gates are trained off of Keywords that direct the gates but not limit as much as a full prompt would. My goal is Quality not quantity</p>
<p><strong>Source Models:</strong></p>
  <ul>
    <li><a href="https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct">meta-llama/Meta-Llama-3-8B-Instruct</a></li>
    <li><a href="https://huggingface.co/Sao10K/L3-Solana-8B-v1">Sao10K/L3-Solana-8B-v1</a></li>
    <li><a href="https://huggingface.co/dreamgen-preview/opus-v1.2-llama-3-8b-instruct-run3.5-epoch2.5">dreamgen-preview/opus-v1.2-llama-3-8b-instruct-run3.5-epoch2.5</a></li>
    <li><a href="https://huggingface.co/NeverSleep/Llama-3-Lumimaid-8B-v0.1">NeverSleep/Llama-3-Lumimaid-8B-v0.1</a></li>
    <li><a href="https://huggingface.co/cgato/L3-TheSpice-8b-v0.1.3">cgato/L3-TheSpice-8b-v0.1.3</a></li>
  </ul>
</div>
<div class="update-section">
  <h2>Quants:</h2>
    <p> Recommended: (Thanks to <a href="https://huggingface.co/mradermacher">@Mradermacher!</a>, please send them likes!)</p>
    <p><a href="https://huggingface.co/mradermacher/L3-Arcania-4x8b-GGUF">L3-Arcania-4x8b-GGUF (all GGUFs)</a></p>
    <p><a href="https://huggingface.co/mradermacher/L3-Arcania-4x8b-i1-GGUF">L3-Arcania-4x8b-i1-GGUF (i Quant GGUFs)</a></p>
    <p> My Quants: (they work, just not many choices) </p>
    <p><a href="https://huggingface.co/SteelQuants/L3-Arcania-4x8b-Q4_K_M-GGUF">SteelQuants/L3-Arcania-4x8b-Q4_K_M-GGUF</a></p>
    <p><a href="https://huggingface.co/SteelQuants/L3-Arcania-4x8b-Q5_K_M-GGUF">SteelQuants/L3-Arcania-4x8b-Q5_K_M-GGUF</a></p>
<h3>Config:</h3>
<p>Recommended Prompt Format: [Llama 3] </p>
<pre><code><|begin_of_text|><|start_header_id|>system<|end_header_id|>
{{prompt}}<|eot_id|>{{history}}<|start_header_id|>{{char}}<|end_header_id|>
</code></pre>
<p> Model Config: </p>
<pre><code>MODEL_NAME = "L3-Arcania-4x8b"
base_model: meta-llama/Meta-Llama-3-8B-Instruct
gate_mode: hidden 
dtype: bfloat16
experts:
  - source_model: Sao10K/L3-Solana-8B-v1
  - source_model: dreamgen-preview/opus-v1.2-llama-3-8b-instruct-run3.5-epoch2.5
  - source_model: NeverSleep/Llama-3-Lumimaid-8B-v0.1
  - source_model: cgato/L3-TheSpice-8b-v0.1.3
</code></pre>
<p>L3-Arcania-4x8b combines the strengths of multiple models to deliver a well-rounded, capable assistant. It excels at general tasks, storytelling, roleplay, and even more mature content.</p>
<p>The base model, Meta-Llama-3-8B-Instruct, provides a solid foundation. The expert models then enhance specific capabilities:</p>
  <ul>
    <li>L3-Solana-8B-v1 adds generalist knowledge and the ability to handle a wide range of topics, including NSFW content.</li>
    <li>opus-v1.2-llama-3-8b-instruct-run3.5-epoch2.5 strengthens storytelling, roleplay, and long-form writing abilities.</li>
    <li>Llama-3-Lumimaid-8B-v0.1 introduces expertise in romantic, flirtatious, and explicit interactions.</li> 
    <li>L3-TheSpice-8b-v0.1.3 ensures the model remains focused, tailored, and high-quality.</li>
  </ul>
<p>The positive and negative prompts guide each expert's influence, resulting in a model that is versatile yet refined, capable of both general assistance and more specialized, mature interactions.</p>
</div>
</div>
    <p><strong>I've had a few people ask about donations so here's a link:</strong</p>
    </div>
    <div class="donation-section">
      <a href="https://ko-fi.com/Y8Y0AO2XE" target="_blank">
        <img height="36" style="border:0px;height:36px;" src="https://storage.ko-fi.com/cdn/kofi2.png?v=3" border="0" alt="Buy Me a Coffee at ko-fi.com" />
      </a>
    </div>
</body>
</html>