JRosenkranz commited on
Commit
2009ed1
·
verified ·
1 Parent(s): 3893779

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +12 -1
README.md CHANGED
@@ -7,4 +7,15 @@ sdk: static
7
  pinned: false
8
  ---
9
 
10
- Edit this `README.md` markdown file to author your organization card.
 
 
 
 
 
 
 
 
 
 
 
 
7
  pinned: false
8
  ---
9
 
10
+ # Foundation Model Stack
11
+
12
+ Foundation Model Stack (fms) is a collection of components for development, inference, training, and tuning of foundation models leveraging PyTorch native components.
13
+ For inference optimizations we aim to support PyTorch compile, accelerated transformers, and tensor parallelism.
14
+ At training time we aim to support FSDP, accelerated transformers, and PyTorch compile.
15
+
16
+ Foundation Model Stack is split up into a few main repositories:
17
+
18
+ - [foundation-model-stack](https://github.com/foundation-model-stack/foundation-model-stack): Main repository for which all fms models are based. Contains the main building blocks for using foundation-models.
19
+ - [fms-fsdp](https://github.com/foundation-model-stack/fms-fsdp): Pre-Training Examples using FSDP wrapped foundation models
20
+ - [fms-extras](https://github.com/foundation-model-stack/fms-extras): New features staged to be integrated with foundation-model-stack
21
+ - [fms-hf-tuning](https://github.com/foundation-model-stack/fms-hf-tuning): Basic Tuning scripts for fms models leveraging SFTTrainer