Distily Project

community

https://github.com/lapp0/distily

AI & ML interests

None defined yet.

Recent Activity

lapp0 updated a model 3 months ago

distily/distily_smollm_dataset_sweep

lapp0 updated a model 3 months ago

distily/distily_tinyBenchmarks

lapp0 updated a model 3 months ago

distily/distily_learning_params

View all activity

models 52

distily/distily_smollm_dataset_sweep

Updated Sep 30, 2024 • 13

distily/distily_tinyBenchmarks

Updated Sep 23, 2024 • 7

distily/distily_learning_params

Updated Sep 22, 2024 • 129

distily/distily_seq_len_batch_size

Updated Sep 17, 2024 • 16

distily/distily_distsmollm_max_length

Updated Sep 14, 2024 • 7

distily/distily_distsmollm_long

Updated Sep 14, 2024 • 10

distily/distily_additional_profiling

Updated Sep 13, 2024

distily/distily_profile_smollm_tritoned

Updated Sep 12, 2024 • 6

distily/distily_profile_smollm

Updated Sep 12, 2024 • 13

distily/distily_verify_new_attns

Updated Sep 12, 2024 • 6

datasets 10

distily/filtered_redpajama_en

Viewer • Updated Sep 7, 2024 • 2.21M • 87

distily/filtered_redpajama_multilingual

Viewer • Updated Sep 7, 2024 • 2.86M • 122 • 1

distily/synth_gpt2_t1_seq_1M

Viewer • Updated Aug 27, 2024 • 1M • 41

distily/synth_gpt2_ted_seq_100

Viewer • Updated Aug 26, 2024 • 1k • 30

distily/synth_gpt2_t1_seq_100K

Updated Aug 26, 2024 • 30

distily/synth_gpt2_ted_seq_100K

Viewer • Updated Aug 26, 2024 • 100k • 30

distily/synth_test

Viewer • Updated Aug 26, 2024 • 1k • 34

distily/synth_tdecay_gpt2_seq_1K

Viewer • Updated Aug 26, 2024 • 1k • 29

distily/synthetic_gpt2_sequences_1K

Viewer • Updated Aug 26, 2024 • 1k • 32

distily/c4_multilingual_1M

Viewer • Updated Aug 19, 2024 • 1M • 60 • 1