Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
cerebras
/
btlm-3b-8k-base
like
260
Follow
Cerebras
382
Text Generation
Transformers
PyTorch
cerebras/SlimPajama-627B
English
btlm
causal-lm
Cerebras
BTLM
custom_code
arxiv:
6 papers
License:
apache-2.0
Model card
Files
Files and versions
Community
27
Train
Use this model
refs/pr/5
btlm-3b-8k-base
3 contributors
History:
12 commits
rskuzma
update README, slight revisions and typos
b09d46a
over 1 year ago
.gitattributes
Safe
1.52 kB
initial commit
over 1 year ago
README.md
Safe
11.8 kB
update README, slight revisions and typos
over 1 year ago
config.json
Safe
1.24 kB
change mup param names
over 1 year ago
configuration_btlm.py
Safe
7.58 kB
change mup param names
over 1 year ago
figure_1_memory_footprint.png
Safe
301 kB
fix three images (#4)
over 1 year ago
figure_2_half_the_size_twice_the_speed.png
Safe
342 kB
upload images from blog (#2)
over 1 year ago
figure_3_performance_vs_3b_models.png
Safe
238 kB
upload images from blog (#2)
over 1 year ago
figure_4_performance_vs_7b_models.jpg
Safe
102 kB
upload images from blog (#2)
over 1 year ago
figure_5_xentropy_with_sequence_lengths.png
Safe
52.1 kB
upload images from blog (#2)
over 1 year ago
generation_config.json
Safe
119 Bytes
add bfloat16 checkpoint
over 1 year ago
merges.txt
Safe
456 kB
add the tokenizer
over 1 year ago
modeling_btlm.py
Safe
71.2 kB
change mup param names
over 1 year ago
pytorch_model.bin
Safe
pickle
Detected Pickle imports (3)
"torch._utils._rebuild_tensor_v2"
,
"torch.BFloat16Storage"
,
"collections.OrderedDict"
What is a pickle import?
5.29 GB
LFS
add bfloat16 checkpoint
over 1 year ago
special_tokens_map.json
Safe
99 Bytes
add the tokenizer
over 1 year ago
table_1_downstream_performance_3b.png
Safe
590 kB
fix three images (#4)
over 1 year ago
table_2_downstream_performance_7b.png
Safe
243 kB
upload images from blog (#2)
over 1 year ago
tokenizer_config.json
Safe
234 Bytes
add the tokenizer
over 1 year ago
vocab.json
Safe
1.04 MB
add the tokenizer
over 1 year ago