metadata

library_name: transformers
model_name: SmolLM2-1.7B-FT-SCP-Wiki
tags:
  - generated_from_trainer
  - smol-course
  - module_1
  - trl
  - sft
licence: license

Model Card for SmolLM2-1.7B-FT-SCP-Wiki

This model is a fine-tuned version of HuggingFaceTB/SmolLM2-1.7B. It has been trained using TRL.

Quick start

from transformers import AutoModelForCausalLM, AutoTokenizer

model_name = "PhilSad/SmolLM2-1.7B-FT-SCP-Wiki"
model = AutoModelForCausalLM.from_pretrained(
    pretrained_model_name_or_path=model_name
).to(device)
tokenizer = AutoTokenizer.from_pretrained(pretrained_model_name_or_path=model_name)

prompt = "SCP-10214 is a god who loves making pasta."

messages = [{"role": "user", "content": prompt}]
formatted_prompt = tokenizer.apply_chat_template(messages, tokenize=False)

inputs = tokenizer(formatted_prompt, return_tensors="pt").to(device)

outputs = model.generate(**inputs, max_new_tokens=2048)

print(tokenizer.decode(outputs[0], skip_special_tokens=True))

Click to show output

Item #: SCP-10214 Object Class: Euclid

Special Containment Procedures: SCP-10214 is to be contained in a standard humanoid containment chamber. SCP-10214 is to be provided with all the pasta it desires, as well as any other food it may request. SCP-10214 is to be allowed to perform its rituals as a form of therapy, but must be monitored to ensure that it does not attempt to bring its deity into existence.

Description: SCP-10214 is a human male in its late 30's. SCP-10214 is mentally unstable, suffering from delusions of grandeur and other symptoms of psychosis. SCP-10214 believes itself to be a god named "Pasta God Mario", and behaves in accordance with this delusion. SCP-10214 is not delusional about its ability to make pasta, however; it is a competent cook. SCP-10214's primary compulsion is the creation of pasta dishes, which it bakes in an oven it has set up in its cell. SCP-10214 will often spend hours creating intricate designs on the pasta using various toppings, similar to the marbling patterns present in some types of meat. SCP-10214 will also make various other alterations to the standard shapes and sizes of pasta, such as cutting spaghetti into various lengths and shapes, and creating "lasagna" by layering sheets of pasta together. Pasta that SCP-10214 creates is of generally high quality, with attention to detail that is usually commendable. SCP-10214 will often include small imperfections in the pasta, however, claiming that these "give the dish character". SCP-10214's rituals, which it performs multiple times a day, usually involve kneading and stretching of the dough, as well as various shapes and forms of stretching the dough by hand or with the aid of simple tools. SCP-10214 will often pray to itself before and after it has completed a creation, thanking itself for its existence and other various sentiments. SCP-10214 has also been known to create other baked goods during its containment, including several different types of pizza, all of which are of high quality. SCP-10214 first came to the Foundation's attention after several reports of a god named "Pasta God Mario" appearing in local churches and confessing his sins to the priests. Investigation of the claims revealed SCP-10214 in its current condition, and it was immediately taken into Foundation custody.

Addendum 10214-1: SCP-10214 has been observed to perform the following rituals on several occasions:

Ritual #1: SCP-10214 would knead a large lump of dough, and then create a small ball of dough in the shape of a human head. SCP-10214 would then press the ball into the larger mass, flattening it as it went. After a large amount of kneading and flattening, a face with eyes, mouth, and nose would be formed. SCP-10214 would then take a small amount of the dough and stretch it into a thin line, weaving it in and out through the existing strands of pasta to create a beard. SCP-10214 would then take a large piece of dough, and using both hands, stretch it into a thin sheet. SCP-10214 would then lay the sheet over the formed face, and begin to shape the edges of the sheet to form a collar. SCP-10214 would then take a fork and create several holes in the sheet, and pull the corners of the sheet in opposite directions, stretching it as it went. This would form a collar around the face. SCP-10214 would then take a large lump of dough, and using both hands, flatten it into a large disc. SCP-10214 would then take the disc and place it in the center of the large mass of dough, and begin to pull the edges of the disc towards the center, stretching it as it went. This would form a large "crown" of dough, which SCP-10214 would place on the head of the formed figure. SCP-10214 would then take a knife and cut several thin slits in the large mass of dough, and pull the edges of the slits in opposite directions, creating a large number of spaghetti-like strands of dough. SCP-10214 would then take a plate and a fork, and offer them to the created figure. SCP-10214 would then sit and talk with the figure for several minutes, before offering it a piece of garlic bread.

Ritual #2: SCP-10214 would take a large lump of dough, and using both hands, shape it into a large, rough humanoid figure. SCP-10214 would then take a rolling pin and roll the dough out into a large flat sheet. SCP-10214 would then take a small amount of dough, and using a knife, cut strips of various widths. SCP-10214 would then take the longest of the strips, and tie one end into a knot, then lay the other end over the edge of the large sheet of pasta, stretching it as it went. SCP-10214 would repeat this process with each of the strips, creating a large, rough mannequin-like figure. SCP-10214 would then take a small amount of dough, and using a knife, cut a number of small pieces. SCP-10214 would take one of the pieces, and using both hands, shape it into a small human head. SCP-10214 would then take the head, and using a fork, create a small opening in the top of the head. SCP-10214 would then take a large lump of dough, and using a knife, cut a number of holes in it. SCP-10214 would then take the head, and using both hands, force the holes into the dough, stretching it as it went. SCP-10214 would then take the large figure, and using both hands, pull the mannequin arms through the holes in the dough, stretching it as it went. SCP-10214 would repeat this process with the legs, until the figure was completely mannequinized. SCP-10214 would then take a knife, and make a large incision down the center of the figure's torso, separating the head from the rest of the body. SCP-10214 would then take the head, and place it on the figure's neck, pushing the head into the neck as it forced the head through the dough. SCP-10214 would then take a large lump of dough, and using a knife, cut a number of holes in it. SCP-10214 would then take the head, and force it through the holes in the dough, stretching it as it went. SCP-10214 would continue to do this until the entire body was mannequinized. SCP-10214 would then take a plate and a fork, and offer them to the created figure. SCP-10214 would then sit and talk with the figure for several minutes, before offering it a piece of garlic bread.

Ritual #3: SCP-10214 would take a large lump of dough, and using both hands, shape it into a large, rough humanoid figure. SCP-10214 would then take a rolling pin and roll the dough out into a large flat sheet. SCP-10214 would then take a small amount of dough, and using a knife, cut strips of various widths. SCP-10214 would then take the longest of the strips, and tie one end into a knot, then lay the other end over the edge of the large sheet of pasta, stretching it as it went. SCP-10214 would repeat this process with each of the strips, creating a large, rough mannequin-like figure. SCP-10214 would then take a small amount of dough, and using a knife, cut a number of small pieces. SCP-10214 would take one of the pieces, and using a knife, cut a small incision in it. SCP-10214 would then take a small amount of dough, and using a knife, cut a number of holes in it. SCP-10214 would then take the piece of dough, and force the holes into the mannequin figure as it forced the dough through the holes. SCP-10214 would continue to do this until the figure was completely mannequinized. SCP-10214 would then take a plate and a fork, and offer them to the created figure. SCP-10214 would then sit and talk with the figure for several minutes, before offering it a

Training procedure

This model was finetuned from HuggingFaceTB/SmolLM2-1.7B on 2000 steps with SFT on PhilSad/SCP-Wiki-Dataset

Framework versions

TRL: 0.12.2
Transformers: 4.46.3
Pytorch: 2.4.1+cu124
Datasets: 3.2.0
Tokenizers: 0.20.3

Citations

Cite TRL as:

@misc{vonwerra2022trl,
    title        = {{TRL: Transformer Reinforcement Learning}},
    author       = {Leandro von Werra and Younes Belkada and Lewis Tunstall and Edward Beeching and Tristan Thrush and Nathan Lambert and Shengyi Huang and Kashif Rasul and Quentin Gallouédec},
    year         = 2020,
    journal      = {GitHub repository},
    publisher    = {GitHub},
    howpublished = {\url{https://github.com/huggingface/trl}}
}