ct2's picture

12 4

ct2

ct-2

·

AI & ML interests

None yet

Organizations

None yet

ct-2's activity

New activity in ai21labs/AI21-Jamba-1.5-Mini 10 days ago

add example for 4bit inference?

#11 opened 18 days ago by

commented a paper 3 months ago

The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits

Paper • 2402.17764 • Published Feb 27 • 592 •

New activity in Snowflake/snowflake-arctic-instruct 5 months ago

llama.cpp support?

#6 opened 5 months ago by

New activity in alpindale/miquella-120b 8 months ago

layer combinations in gguf

#3 opened 8 months ago by

New activity in xverse/XVERSE-65B 10 months ago

GQA?

#1 opened 10 months ago by

New activity in TheBloke/Llama-2-13B-Chat-fp16 about 1 year ago

Adding `safetensors` variant of this model

#4 opened about 1 year ago by

New activity in migtissera/Synthia-13B about 1 year ago

Adding `safetensors` variant of this model

#4 opened about 1 year ago by

New activity in safetensors/convert_large about 1 year ago

I have much trouble converting 70B models

#1 opened about 1 year ago by

New activity in migtissera/Synthia-70B-v1.2b about 1 year ago

Adding `safetensors` variant of this model

#1 opened about 1 year ago by

New activity in TheBloke/Falcon-180B-Chat-GGUF about 1 year ago

additional non k-quants req

#7 opened about 1 year ago by

New activity in Aryanne/Mamba-gpt-3B-v4-ggml-and-gguf about 1 year ago

q4_1

#1 opened about 1 year ago by

New activity in TheBloke/Falcon-180B-Chat-GGUF about 1 year ago

How to use splits, 7z needed?

#1 opened about 1 year ago by