[up]: Update README and license

LICENSE

@@ -0,0 +1,24 @@
+SuperAnnotate AI Public License (SAIPL)
+Version 1.0
+This License governs the use, modification, and distribution of AI models provided by SuperAnnotate AI on the Hugging Face platform, ensuring open access and collaboration in the AI community under the principles of the GNU Affero General Public License.
+1. Definitions
+   "This License" refers to version 1.0 of the SuperAnnotate AI Public License.
+   "The Model" refers to the AI model, including scripts, data, documentation, and any associated media provided by SuperAnnotate AI under this License.
+   "Modify" means to adapt or change the Model to create a derivative work.
+   "You" means any individual or entity exercising permissions granted by this License.
+2. Source Code
+   The source code includes all the contents that SuperAnnotate AI provides to modify the Model, including trained models, training scripts, and relevant data sets.
+   You must make all source code of the Model, and of any modifications, available to any user interacting with the Model remotely through a network.
+3. Commercial Use
+   Commercial use of the Model is permitted under this License. You may charge a fee for the physical act of transferring a copy, and you may also offer support or warranty protection for a fee.
+   If you use the Model commercially, you must disclose the source and make the entire source code available to your users, either commercially or freely under the terms of this License.
+4. Copyleft
+   All modified versions of the Model, and any derivative works thereof, must be licensed under this License or a compatible open source license that includes the same conditions, particularly regarding the availability of source code.
+5. Network Use is Distribution
+   If you make the Model or any modified version available to interact with users over a network, you must provide all users with access to the source code of the Model and any modifications, under the terms of this License.
+6. Attribution
+   You must give appropriate credit to SuperAnnotate AI, provide a link to this license, and indicate if changes were made. Such notice may not be removed or altered from any source distribution.
+7. Disclaimer of Warranty and Limitation of Liability
+   There is no warranty for the Model, to the extent permitted by applicable law. Except when otherwise stated in writing, the copyright holders and/or other parties provide the Model "as is" without warranty of any kind, either expressed or implied, including, but not limited to, the implied warranties of merchantability and fitness for a particular purpose. The entire risk as to the quality and performance of the Model is with you. Should the Model prove defective, you assume the cost of all necessary servicing, repair, or correction.
+   In no event unless required by applicable law or agreed to in writing will any copyright holder, or any other party who modifies and/or conveys the Model as permitted above, be liable to you for damages, including any general, special, incidental, or consequential damages arising out of the use or inability to use the Model (including but not limited to loss of data or data being rendered inaccurate or losses sustained by you or third parties or a failure of the Model to operate with any other programs), even if such holder or other party has been advised of the possibility of such damages.
+End of Terms and Conditions

README.md

@@ -2,4 +2,116 @@
 license: other
 license_name: saipl
 license_link: LICENSE
+datasets:
+- wikimedia/wikipedia
+- rexarski/eli5_category
+language:
+- en
+base_model:
+- FacebookAI/roberta-large
+pipeline_tag: text-classification
+library_name: transformers
+tags:
+- genereted_text_detection
+- llm_content_detection
+- AI_detection
 ---
+<p align="center">
+<img src="SA_logo.png" alt="SuperAnnotate Logo" width="100" height="100"/>
+</p>
+
+<h1 align="center">SuperAnnotate</h1>
+<h3 align="center">
+AI Detector<br/>
+Fine-Tuned RoBERTa Large<br/>
+</h3>
+
+## Description
+
+The model designed to detect generated/synthetic text. \
+At the moment, such functionality is critical for determining the author of the text. It's critical for your training data, detecting fraud and cheating in scientific and educational areas. \
+Couple of articles about this problem: [*Problems with Synthetic Data*](https://www.aitude.com/problems-with-synthetic-data/) | [*Risk of LLMs in Education*](https://publish.illinois.edu/teaching-learninghub-byjen/risk-of-llms-in-education/)
+
+## Model Details
+
+### Model Description
+
+- **Model type:** The custom architecture for binary sequence classification based on pre-trained RoBERTa, with a single output label.
+- **Language(s):** Primarily English.
+- **License:** [SAIPL](https://huggingface.co/SuperAnnotate/roberta-large-llm-content-detector-V2/blob/main/LICENSE)
+- **Finetuned from model:** [RoBERTa Large](https://huggingface.co/FacebookAI/roberta-large)
+
+### Model Sources
+
+- **Repository:** [GitHub](https://github.com/superannotateai/generated_text_detector) for HTTP service
+
+### Training Data
+
+The training dataset for this version includes **44k pairs of text-label samples**, split equally between two parts:
+
+1. **Custom Generation**: The first half of the dataset was generated using custom specially designed prompts and human version sourced from three domains:
+   - [**Wikipedia**](https://huggingface.co/datasets/wikimedia/wikipedia)
+   - [**Reddit ELI5 QA**](https://huggingface.co/datasets/rexarski/eli5_category)
+   - [**Scientific Papers**](https://www.tensorflow.org/datasets/catalog/scientific_papers) (extended to include the full text of sections).
+   
+   Texts were generated by 14 different models across four major LLM families (GPT, LLaMA, Anthropic, and Mistral). Each sample consists of a single prompt paired with one human-written and one generated response, though prompts were excluded from training inputs.
+
+2. **RAID Train Data Stratified Subset**: The second half is a carefully selected stratified subset from the RAID train dataset, ensuring equal representation across domains, model types, and attack methods. Each example pairs a human-authored text with a corresponding machine-generated response (produced by a single model with specific parameters and attacks applied).
+
+This balanced dataset structure maintains approximately equal proportions of human and generated text samples, ensuring that each prompt aligns with one authentic and one generated answer.
+
+> [!NOTE]
+> Furthermore, key n-grams (n ranging from 2 to 5) that exhibited the highest correlation with target labels were identified and subsequently removed from the training data utilizing the chi-squared test.
+
+### Peculiarity
+
+In training, a primary objective was to maximize prediction accuracy while specifically minimizing the False Positive Rate (FPR), prioritizing the reduction of misclassifications in class 0 (i.e., reducing instances where human-written text is incorrectly classified as generated by an LLM).
+
+## Usage
+
+**Pre-requirements**: \
+Install *generated_text_detector* \
+Run following command: ```pip install git+https://github.com/superannotateai/generated_text_detector.git@v1.0.0```
+
+```python
+from generated_text_detector.utils.model.roberta_classifier import RobertaClassifier
+from transformers import AutoTokenizer
+import torch.nn.functional as F
+model = RobertaClassifier.from_pretrained("SuperAnnotate/ai-detector")
+tokenizer = AutoTokenizer.from_pretrained("SuperAnnotate/ai-detector")
+text_example = "It's not uncommon for people to develop allergies or intolerances to certain foods as they get older. It's possible that you have always had a sensitivity to lactose (the sugar found in milk and other dairy products), but it only recently became a problem for you. This can happen because our bodies can change over time and become more or less able to tolerate certain things. It's also possible that you have developed an allergy or intolerance to something else that is causing your symptoms, such as a food additive or preservative. In any case, it's important to talk to a doctor if you are experiencing new allergy or intolerance symptoms, so they can help determine the cause and recommend treatment."
+tokens = tokenizer.encode_plus(
+text_example,
+add_special_tokens=True,
+max_length=512,
+padding='longest',
+truncation=True,
+return_token_type_ids=True,
+return_tensors="pt"
+)
+_, logits = model(**tokens)
+proba = F.sigmoid(logits).squeeze(1).item()
+print(proba)
+```
+
+## Training Detailes
+
+A custom architecture was chosen for its ability to perform binary classification while providing a single model output, as well as for its customizable settings for smoothing integrated into the loss function.
+
+**Training Arguments**:
+
+- **Base Model**: [FacebookAI/roberta-large](https://huggingface.co/FacebookAI/roberta-large)
+- **Epochs**: 15
+- **Learning Rate**: 5e-05
+- **Weight Decay**: 0.0033
+- **Label Smoothing**: 0
+- **Pos Weight of Loss**: 0.5
+- **Warmup Epochs**: 2
+- **Optimizer**: SGD
+- **Gradient Clipping**: 3.0
+- **Scheduler**: Cosine with hard restarts
+- **Number Scheduler Cycles**: 1
+
+## Performance
+
+**TODO** RAID Leaderboard results should be here