Spaces:
Running
Running
File size: 514 Bytes
1089a77 c34077d 1089a77 a905447 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 |
---
title: VRAM Estimator
emoji: 🧮
colorFrom: yellow
colorTo: blue
sdk: gradio
sdk_version: 4.39.0
app_file: app.py
pinned: false
---
Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference
TODO:
- include vocab size as manual parameter
- include finetuning techniques (LoRA/QLoRA/LoftQ)
- include inference (KV cache memory)
- include number of experts for Mixture of Experts (MoE) models
- include DeepSpeed communication memory overhead (`allgather_bucket_size`) |