Update README.md
Browse files
README.md
CHANGED
@@ -58,12 +58,12 @@ print(decoded)
|
|
58 |
|
59 |
## Custom pipeline
|
60 |
|
61 |
-
|
62 |
```shell
|
63 |
pip install git+https://github.com/ESgarbi/t5-qa-builder
|
64 |
```
|
65 |
|
66 |
-
|
67 |
|
68 |
```python
|
69 |
|
@@ -97,7 +97,7 @@ print(result)
|
|
97 |
```
|
98 |
|
99 |
|
100 |
-
|
101 |
```json
|
102 |
Generating QA pairs: 100%|ββββββββββ| 1/1 [00:13<00:00, 13.66s/it]
|
103 |
{
|
|
|
58 |
|
59 |
## Custom pipeline
|
60 |
|
61 |
+
The easiest way to generate text with more control and without length restrictions is by using a custom pipeline. To reduce the number of similar questions, the similarity_threshold used to increase and decrease the similarity of questions returned. Additionally, the stride argument is used to overlap data in the context parts.
|
62 |
```shell
|
63 |
pip install git+https://github.com/ESgarbi/t5-qa-builder
|
64 |
```
|
65 |
|
66 |
+
Run the custom pipeline. Weights will be downloaded from the HF hub automatically. All special tokens will be handled internally, no need to supply the <qa_builder_context> token to initialise the task.
|
67 |
|
68 |
```python
|
69 |
|
|
|
97 |
```
|
98 |
|
99 |
|
100 |
+
Output:
|
101 |
```json
|
102 |
Generating QA pairs: 100%|ββββββββββ| 1/1 [00:13<00:00, 13.66s/it]
|
103 |
{
|