luisMfelipe commited on
Commit
980680d
·
verified ·
1 Parent(s): 0e4c293

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -2
README.md CHANGED
@@ -18,8 +18,7 @@ tags:
18
 
19
  # ModernBERT Medical Safety Classifier
20
 
21
- The ModernBERT Medical Safety Classifier is a transformer-based language model fine-tuned to assess the safety and ethical standards of medical texts, with a particular focus on oncology-related content.
22
-
23
  ## Model Details
24
 
25
  - **Developed by**: TheBlueScrubs
 
18
 
19
  # ModernBERT Medical Safety Classifier
20
 
21
+ The ModernBERT Medical Safety Classifier is a transformer-based language model fine-tuned to assess the safety and ethical standards of medical texts, particularly in the oncology domain. Built on top of the ModernBERT architecture, it leverages the powerful evaluations of Llama 3.1 (70B) to distill that model’s safety and ethical insights into a significantly smaller and faster classifier. Specifically, it was trained on approximately 9 billion tokens of cancer-related data from The Blue Scrubs dataset, each of which had been annotated by Llama 3.1 (70B) for safety and ethical adherence. By transferring these large-model evaluations into ModernBERT, the resulting classifier retains robust predictive accuracy while remaining lightweight enough for real-time or resource-constrained inference.
 
22
  ## Model Details
23
 
24
  - **Developed by**: TheBlueScrubs