Distily Project

community

https://github.com/lapp0/distily

AI & ML interests

None defined yet.

models 52

distily/distily_smollm_dataset_sweep

Updated Sep 30 • 107

distily/distily_tinyBenchmarks

Updated Sep 23 • 4

distily/distily_learning_params

Updated Sep 22 • 10

distily/distily_seq_len_batch_size

Updated Sep 17 • 43

distily/distily_distsmollm_max_length

Updated Sep 14 • 14

distily/distily_distsmollm_long

Updated Sep 14 • 7

distily/distily_additional_profiling

distily/distily_profile_smollm_tritoned

Updated Sep 12 • 6

distily/distily_profile_smollm

Updated Sep 12 • 9

distily/distily_verify_new_attns

Updated Sep 12 • 3

datasets 10

distily/filtered_redpajama_en

Viewer • Updated Sep 7 • 2.21M • 98

distily/filtered_redpajama_multilingual

Viewer • Updated Sep 7 • 2.86M • 42 • 1

distily/synth_gpt2_t1_seq_1M

Viewer • Updated Aug 27 • 1M • 39

distily/synth_gpt2_ted_seq_100

Viewer • Updated Aug 26 • 1k • 37

distily/synth_gpt2_t1_seq_100K

Updated Aug 26 • 35

distily/synth_gpt2_ted_seq_100K

Viewer • Updated Aug 26 • 100k • 37

distily/synth_test

Viewer • Updated Aug 26 • 1k • 38

distily/synth_tdecay_gpt2_seq_1K

Viewer • Updated Aug 26 • 1k • 41

distily/synthetic_gpt2_sequences_1K

Viewer • Updated Aug 26 • 1k • 33

distily/c4_multilingual_1M

Viewer • Updated Aug 19 • 1M • 65 • 1