Update README.md
Browse files
README.md
CHANGED
@@ -18,8 +18,7 @@ tags:
|
|
18 |
|
19 |
# ModernBERT Medical Safety Classifier
|
20 |
|
21 |
-
The ModernBERT Medical Safety Classifier is a transformer-based language model fine-tuned to assess the safety and ethical standards of medical texts,
|
22 |
-
|
23 |
## Model Details
|
24 |
|
25 |
- **Developed by**: TheBlueScrubs
|
|
|
18 |
|
19 |
# ModernBERT Medical Safety Classifier
|
20 |
|
21 |
+
The ModernBERT Medical Safety Classifier is a transformer-based language model fine-tuned to assess the safety and ethical standards of medical texts, particularly in the oncology domain. Built on top of the ModernBERT architecture, it leverages the powerful evaluations of Llama 3.1 (70B) to distill that model’s safety and ethical insights into a significantly smaller and faster classifier. Specifically, it was trained on approximately 9 billion tokens of cancer-related data from The Blue Scrubs dataset, each of which had been annotated by Llama 3.1 (70B) for safety and ethical adherence. By transferring these large-model evaluations into ModernBERT, the resulting classifier retains robust predictive accuracy while remaining lightweight enough for real-time or resource-constrained inference.
|
|
|
22 |
## Model Details
|
23 |
|
24 |
- **Developed by**: TheBlueScrubs
|