doberst commited on
Commit
9818cf7
1 Parent(s): 06337bb

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +8 -4
README.md CHANGED
@@ -6,9 +6,11 @@ license: apache-2.0
6
 
7
  <!-- Provide a quick summary of what the model is/does. -->
8
 
9
- BLING-1.4b-0.1 is the first model release in the BLING ("Best Little Instruction-following No-GPU-required") model series, designed as custom instruct-following laptop-effective GPT decoder-based models (~1B-2.7B parameters).
10
 
11
- BLING models are fine-tuned with distilled high-quality custom instruct datasets, targeted at a specific subset of instruct tasks with the objective of providing a high-quality Instruct model that can be run entirely without a GPU server, with good quality instruct-following capability that can be loaded and run locally on a laptop even without using any quantization optimizations.
 
 
12
 
13
  ### Model Description
14
 
@@ -29,7 +31,8 @@ The intended use of BLING models is two-fold:
29
  1. Provide a high-quality Instruct models that can run on a laptop for local testing. We have found it extremely useful when building a
30
  proof-of-concept, or working with sensitive enterprise data that must be closely guarded, especially in RAG use cases.
31
 
32
- 2. Push the state of the art for smaller Instruct-following models in the 1B - 7B range through improved fine-tuning datasets and targeted "instruction" tasks.
 
33
 
34
 
35
  ### Direct Use
@@ -42,7 +45,8 @@ legal and regulatory industries with complex information sources. Rather than t
42
  BLING is ideal for rapid prototyping, testing, and the ability to perform an end-to-end workflow locally on a laptop without
43
  having to send sensitive information over an Internet-based API.
44
 
45
- The first BLING models have been trained on question-answering, key-value extraction, and basic summarization as the core instruction types.
 
46
 
47
 
48
  ### Out-of-Scope Use
 
6
 
7
  <!-- Provide a quick summary of what the model is/does. -->
8
 
9
+ BLING-1.4b-0.1 is the first model release in the BLING ("Best Little Instruction-following No-GPU-required") model series.
10
 
11
+ BLING models are fine-tuned with distilled high-quality custom instruct datasets, targeted at a specific subset of instruct tasks with
12
+ the objective of providing a high-quality Instruct model that is 'inference-ready' on a CPU laptop even
13
+ without using any advanced quantization optimizations.
14
 
15
  ### Model Description
16
 
 
31
  1. Provide a high-quality Instruct models that can run on a laptop for local testing. We have found it extremely useful when building a
32
  proof-of-concept, or working with sensitive enterprise data that must be closely guarded, especially in RAG use cases.
33
 
34
+ 2. Push the state of the art for smaller Instruct-following models in the sub-7B parameter range, especially 1B-3B, as single-purpose
35
+ automation tools for specific tasks through targeted fine-tuning datasets and focused "instruction" tasks.
36
 
37
 
38
  ### Direct Use
 
45
  BLING is ideal for rapid prototyping, testing, and the ability to perform an end-to-end workflow locally on a laptop without
46
  having to send sensitive information over an Internet-based API.
47
 
48
+ The first BLING models have been trained for common RAG scenarios, specifically: question-answering, key-value extraction, and basic summarization as the core instruction types
49
+ without the need for a lot of complex instruction verbiage - provide a text passage context, ask questions, and get clear fact-based responses.
50
 
51
 
52
  ### Out-of-Scope Use