NuclearAi
/

Hyper-X-Qwen2-1.5B-It-Python

Text Generation

text-generation-inference

4-bit precision

Inference Endpoints

Model card Files Files and versions Community

Nuclear Ai commited on Jun 15

Commit

6497484

•

1 Parent(s): 2f33490

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -30,7 +30,7 @@ We Used : [NuclearAi/Nuke-Python-Verse](https://huggingface.co/datasets/NuclearA
 # Here is the code to run it in 4-bit Quantization method !
-```
 ```python
 from transformers import AutoModelForCausalLM, AutoTokenizer, BitsAndBytesConfig, TextStreamer
 import torch
@@ -93,4 +93,4 @@ while True:
     # The TextStreamer already prints the response token by token, so we just print a newline
     print()  # Ensure to move to the next line after the response is printed
 ```
-```

 # Here is the code to run it in 4-bit Quantization method !
+```python
 ```python
 from transformers import AutoModelForCausalLM, AutoTokenizer, BitsAndBytesConfig, TextStreamer
 import torch
     # The TextStreamer already prints the response token by token, so we just print a newline
     print()  # Ensure to move to the next line after the response is printed
 ```
+```