Bowen Peng

bloc97's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes

New activity in NousResearch/Nous-Capybara-34B 10 months ago

How did you train this without going OOM in RAM & VRAM?

3

#15 opened 10 months ago by

vicplus

New activity in NousResearch/Yarn-Mistral-7b-128k about 1 year ago

VRAM usage for full 128k tokens

7

#5 opened about 1 year ago by

Hypersniper

sliding_window = 131072? Sliding window attention doesn't work for 128?

1

#4 opened about 1 year ago by

keyishen

New activity in NousResearch/Yarn-Llama-2-13b-64k over 1 year ago

Hardware requirements for the model.

2

#1 opened over 1 year ago by

Sc0urge