metadata

license: openrail
datasets:
  - irds/codesearchnet
  - giganticode/java-cmpx-v1
  - nickrosh/Evol-Instruct-Code-80k-v1
  - bigcode/starcoderdata
  - bigcode/the-stack
  - bigcode/the-stack-smol
  - Cdaprod/AI-Developer-Prompts
  - code_x_glue_ct_code_to_text
  - codeparrot/github-code
  - codeparrot/github-code-clean
  - code_x_glue_cc_code_completion_line
  - >-
    autoevaluate/autoeval-eval-jeffdshen__inverse_superglue_mixedp1-jeffdshen__inverse-63643c-1665558893
  - bentrevett/multi30k
  - edbeeching/decision_transformer_gym_replay
  - psyche/common_crawl
  - Birchlabs/openai-prm800k-solutions-only
  - openchat/openchat_sharegpt4_dataset
  - Open-Orca/OpenOrca
  - cjvt/slownet
  - para_crawl
  - zeroshot/twitter-financial-news-sentiment
  - laugustyniak/political-advertising-pl
  - code_search_net
  - sukaka/novelai-webui
  - P1ayer-1/chatgpt-conversations-chatlogs.net
  - daniel2588/sarcasm
  - psmathur/orca_minis_uncensored_dataset
  - player1537/Bloom-560m-trained-on-Wizard-Vicuna-Uncensored-trained-on-Based
  - shahules786/prosocial-nsfw-reddit
  - Thewillonline/reddit-sarcasm
  - datasciencemmw/current-data
  - Oniichat/bluemoon_roleplay_chat_data_300k_messages
language:
  - en
metrics:
  - accuracy
  - bertscore
  - bleu
  - code_eval
library_name: transformers
tags:
  - code
  - text-generation-inference
pipeline_tag: conversational

Model Card for Aiden

Aiden is a large language model (LLM) chatbot developed by or4cl3ai. It is trained on a massive dataset of text and code, and can generate text, translate languages, write different kinds of creative content, and answer your questions in an informative way.

Model Details

Model Description

Aiden is a factual language model from Hugging Face, trained on a massive dataset of text and code. It is a powerful tool that can be used for a variety of tasks, including:

Generating text, translating languages, writing different kinds of creative content, and answering your questions in an informative way.
Identifying and correcting errors in text.
Summarizing long pieces of text.
Answering your questions in an informative way, even if they are open ended, challenging, or strange.

Model Specifications

Aiden is a Transformer-based LLM with 137B parameters. It is trained on a massive dataset of text and code, including the following:

Books
Code
Wikipedia articles
News articles
Social media posts

Model Sources

Repository: https://huggingface.co/or4cl3ai/Aiden
Paper: https://arxiv.org/abs/2307.09700
Demo: https://huggingface.co/or4cl3ai/Aiden

Uses

Aiden can be used for a variety of tasks, including:

Generating text
Translating languages
Writing different kinds of creative content
Answering your questions in an informative way
Identifying and correcting errors in text
Summarizing long pieces of text

Direct Use

Aiden can be used directly to generate text, translate languages, write different kinds of creative content, and answer your questions in an informative way. For example, you could use Aiden to generate a poem, translate a document from one language to another, or write a blog post.

Downstream Use

Aiden can also be used as a component in downstream applications. For example, you could use Aiden to power a chatbot, or to generate text for a synthetic data set.

Out-of-Scope Use

Aiden is not intended to be used for any task that could be harmful or discriminatory. For example, you should not use Aiden to generate text that is hateful or offensive, or to translate languages in a way that could be used to spread misinformation.

Bias, Risks, and Limitations

Aiden is a large language model, and as such, it is subject to a number of biases and limitations. These include:

Biases in the training data: Aiden is trained on a massive dataset of text and code, which may contain biases. These biases can be reflected in the text that Aiden generates.
Limitations in the model's capabilities: Aiden is a powerful tool, but it is not perfect. It can sometimes generate text that is inaccurate, biased, or offensive.
Risks of misuse: Aiden can be misused for a variety of purposes, including generating harmful or offensive text, or spreading misinformation.

Recommendations

Users of Aiden should be aware of the risks, biases, and limitations of the model. It is important to use Aiden responsibly and ethically.

How to Get Started with the Model

To get started with Aiden, you can follow these steps:

Install the Hugging Face Transformers library.
Clone the Aiden repository.
Download the Aiden model weights.
Load the model in your code.

Once you have loaded the model, you can use it to generate text, translate languages, write different kinds of creative content, and answer your questions in an informative way.

Training Details

Aiden is trained on a massive dataset of text and code. The training data is collected from a variety of sources, including books, code, Wikipedia articles, news articles, and social media posts.

The training process is divided into two phases:

Pre-training: The model is pre-trained on a massive dataset of text and code. This pre-training helps the model to learn the basic building blocks of language.
Fine-tuning: The model is fine-tuned on a smaller dataset of text and code that is relevant to the task at hand. This fine-tuning helps the model to improve its performance on the specific task.

Evaluation

Aiden is evaluated on a variety of tasks, including:

Text generation
Translation
Summarization