README.md

metadata

language: en
license: other
tags:
  - tiiuae
  - NF4
  - falcon
base_model: tiiuae/falcon-7b-instruct
model_name: Falcon-7B-instruct-NF4
library:
  - Transformers
  - NF4
model_type: falcon
pipeline_tag: text-generation
qunatized_by: twhoool02

Model Card for Falcon-7B-instruct-NF4

Model Details

This model is a NF4 quantized version of the tiiuae/falcon-7b-instruct model.

• Developed by: Ted Whooley
• Library: Transformers, NF4
• Model type: falcon
• Model name: Falcon-7B-instruct-NF4
• Pipeline tag: text-generation
• Qunatized by: twhoool02
• Language(s) (NLP): en
• License: other