BenGitter's picture

8 1 4

BenGitter

bigstorm

·

AI & ML interests

digital general contractor, building LLM subs

Recent Activity

liked a model about 1 month ago

Qwen/Qwen2.5-Coder-32B-Instruct

upvoted a collection about 1 month ago

new activity about 2 months ago

bigstorm/Llama-3.1-Nemotron-70B-Instruct-HF-4.3bpw-6hb-exl2:Thanks for quantize this model! could you further quantize it into 3.0bpw?

View all activity

Organizations

bigstorm's activity

liked a model about 1 month ago

Qwen/Qwen2.5-Coder-32B-Instruct

Text Generation • Updated Nov 18 • 379k • • 1.35k

upvoted a collection about 1 month ago

Qwen2.5-Coder

Code-specific model series based on Qwen2.5 • 40 items • Updated 25 days ago • 257

New activity in bigstorm/Llama-3.1-Nemotron-70B-Instruct-HF-4.3bpw-6hb-exl2 about 2 months ago

Thanks for quantize this model! could you further quantize it into 3.0bpw?

#1 opened 2 months ago by

This model's knowledge cutoff is 2021..

#2 opened 2 months ago by

updated a collection 2 months ago

General ExLLamaV2 (exl2) Quants

Higher end quants to preserve model quality. Built for TabbyAPI and other exllamav2 supporting inference engines. Ready to deploy. • 45 items • Updated Oct 18 • 1

updated a model 2 months ago

bigstorm/Llama-3.1-Nemotron-70B-Instruct-HF-3.5bpw-6hb-exl2

Text Generation • Updated Oct 18 • 7

updated a collection 2 months ago

General ExLLamaV2 (exl2) Quants

Higher end quants to preserve model quality. Built for TabbyAPI and other exllamav2 supporting inference engines. Ready to deploy. • 45 items • Updated Oct 18 • 1

updated a model 2 months ago

bigstorm/Llama-3.1-Nemotron-70B-Instruct-HF-3.0bpw-6hb-exl2

Text Generation • Updated Oct 18 • 7

New activity in bigstorm/Llama-3.1-Nemotron-70B-Instruct-HF-7.0bpw-8hb-exl2 2 months ago

3.5 - 4.0 bpw quant request

#1 opened 2 months ago by

SporkySporkness

6bpw quant request

#2 opened 2 months ago by

liked a model 2 months ago

nvidia/Llama-3.1-Nemotron-70B-Instruct-HF

Text Generation • Updated Oct 25 • 165k • 1.93k

updated a collection 2 months ago

General ExLLamaV2 (exl2) Quants

Higher end quants to preserve model quality. Built for TabbyAPI and other exllamav2 supporting inference engines. Ready to deploy. • 45 items • Updated Oct 18 • 1

updated a model 2 months ago

bigstorm/Llama-3.1-Nemotron-70B-Instruct-HF-6.0bpw-8hb-exl2

Text Generation • Updated Oct 16 • 45

updated a collection 2 months ago

General ExLLamaV2 (exl2) Quants

Higher end quants to preserve model quality. Built for TabbyAPI and other exllamav2 supporting inference engines. Ready to deploy. • 45 items • Updated Oct 18 • 1

updated a model 2 months ago

bigstorm/Llama-3.1-Nemotron-70B-Instruct-HF-4.3bpw-6hb-exl2

Text Generation • Updated Oct 16 • 17 • 3

updated a collection 2 months ago

General ExLLamaV2 (exl2) Quants

Higher end quants to preserve model quality. Built for TabbyAPI and other exllamav2 supporting inference engines. Ready to deploy. • 45 items • Updated Oct 18 • 1

updated a model 2 months ago

bigstorm/Llama-3.1-Nemotron-70B-Instruct-HF-7.0bpw-8hb-exl2

Text Generation • Updated Oct 16 • 11 • 1

updated a collection 2 months ago

General ExLLamaV2 (exl2) Quants

Higher end quants to preserve model quality. Built for TabbyAPI and other exllamav2 supporting inference engines. Ready to deploy. • 45 items • Updated Oct 18 • 1

updated a model 2 months ago

bigstorm/Llama-3.1-Nemotron-70B-Instruct-HF-8.0bpw-8hb-exl2

Text Generation • Updated Oct 16 • 29 • 3

updated a collection 3 months ago

General ExLLamaV2 (exl2) Quants

Higher end quants to preserve model quality. Built for TabbyAPI and other exllamav2 supporting inference engines. Ready to deploy. • 45 items • Updated Oct 18 • 1