dflevine13 commited on
Commit
c2ab9c5
1 Parent(s): 929df69

update readme

Browse files
Files changed (1) hide show
  1. README.md +9 -12
README.md CHANGED
@@ -3,7 +3,15 @@ license: cc-by-nc-nd-4.0
3
  ---
4
  # Overview
5
 
6
- This model uses Cell2Sentence fine-tuning on the Pythia-160m model developed by EleutherAI.
 
 
 
 
 
 
 
 
7
 
8
  ## Cell2Sentence Links:
9
  GitHub: <https://github.com/vandijklab/cell2sentence-ft>
@@ -14,17 +22,6 @@ GitHub: <https://github.com/EleutherAI/pythia>
14
  Paper: <https://arxiv.org/abs/2304.01373>
15
  Hugging Face: <https://huggingface.co/EleutherAI/pythia-160m>
16
 
17
- # Model Details
18
-
19
- Cell2Sentence is a novel method for adapting large language models to single-cell transcriptomics.
20
- We transform single-cell RNA sequencing data into sequences of gene names ordered by expression level, termed "cell sentences".
21
- For more details, we refer to the paper linked above.
22
- This model was trained on the immune tissue dataset from [Domínguez et al.](https://www.science.org/doi/10.1126/science.abl5197) using 8 A100 40GB GPUs
23
- on the following tasks:
24
- 1. conditional cell generation
25
- 2. unconditional cell generation
26
- 3. cell type prediction
27
-
28
  # Sample Code
29
 
30
  We provide an example of how to use the model to conditionally generate a cell equipped with a post-processing function to remove duplicate and invalid genes.
 
3
  ---
4
  # Overview
5
 
6
+ This is the the Pythia-160m model developed by EleutherAI fine-tuned using Cell2Sentence on *full* scRNA-seq cells.
7
+ Cell2Sentence is a novel method for adapting large language models to single-cell transcriptomics.
8
+ We transform single-cell RNA sequencing data into sequences of gene names ordered by expression level, termed "cell sentences".
9
+ For more details, we refer to the paper linked below.
10
+ This model was trained on the immune tissue dataset from [Domínguez et al.](https://www.science.org/doi/10.1126/science.abl5197)
11
+ using 8 A100 40GB GPUs for approximately 20 hours on the following tasks:
12
+ 1. conditional cell generation
13
+ 2. unconditional cell generation
14
+ 3. cell type prediction
15
 
16
  ## Cell2Sentence Links:
17
  GitHub: <https://github.com/vandijklab/cell2sentence-ft>
 
22
  Paper: <https://arxiv.org/abs/2304.01373>
23
  Hugging Face: <https://huggingface.co/EleutherAI/pythia-160m>
24
 
 
 
 
 
 
 
 
 
 
 
 
25
  # Sample Code
26
 
27
  We provide an example of how to use the model to conditionally generate a cell equipped with a post-processing function to remove duplicate and invalid genes.