Akarshan Biswas
qnixsynapse
AI & ML interests
NLP, models, quantization
Organizations
None yet
qnixsynapse's activity
Suggestion: Host Gemma2 using keras_nlp instead of transformers library for the time being
2
#498 opened about 9 hours ago
by
qnixsynapse
![](https://cdn-avatars.huggingface.co/v1/production/uploads/63119cc5af10c9efa1e9b620/HOUcXxq76kaBOA-SKtanE.jpeg)
Add IQ Quantization support with the help of imatrix and GPUs
7
#35 opened 3 months ago
by
qnixsynapse
![](https://cdn-avatars.huggingface.co/v1/production/uploads/63119cc5af10c9efa1e9b620/HOUcXxq76kaBOA-SKtanE.jpeg)
[TOOLS] Community Discussion
19
#455 opened about 1 month ago
by
victor
![](https://cdn-avatars.huggingface.co/v1/production/uploads/1616001397867-5f17f0a0925b9863e28ad517.png)
[FEATURE] Tools
32
#470 opened about 1 month ago
by
victor
![](https://cdn-avatars.huggingface.co/v1/production/uploads/1616001397867-5f17f0a0925b9863e28ad517.png)
The best 8B in the planet right now. PERIOD!
2
#22 opened 2 months ago
by
cyberneticos
![](https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/v_ltoUNwCC5VOoWm8rv4A.png)
How many active parameters does this model have?
3
#6 opened 3 months ago
by
lewtun
![](https://cdn-avatars.huggingface.co/v1/production/uploads/1594651707950-noauth.jpeg)
7B or 8B?
4
#24 opened 4 months ago
by
amgadhasan
Which model is responsible for naming of the thread?
8
#402 opened 3 months ago
by
qnixsynapse
![](https://cdn-avatars.huggingface.co/v1/production/uploads/63119cc5af10c9efa1e9b620/HOUcXxq76kaBOA-SKtanE.jpeg)
Consider adding <start_of_context> and <stop_of_context> or similar special tokens for context ingestion.
#13 opened 3 months ago
by
qnixsynapse
![](https://cdn-avatars.huggingface.co/v1/production/uploads/63119cc5af10c9efa1e9b620/HOUcXxq76kaBOA-SKtanE.jpeg)
Number of parameters
7
#9 opened 3 months ago
by
HugoLaurencon
![](https://cdn-avatars.huggingface.co/v1/production/uploads/1635201569275-noauth.jpeg)
RMSNorm eps value is wrong
#20 opened 5 months ago
by
qnixsynapse
![](https://cdn-avatars.huggingface.co/v1/production/uploads/63119cc5af10c9efa1e9b620/HOUcXxq76kaBOA-SKtanE.jpeg)
RMSNorm eps value is wrong
#19 opened 5 months ago
by
qnixsynapse
![](https://cdn-avatars.huggingface.co/v1/production/uploads/63119cc5af10c9efa1e9b620/HOUcXxq76kaBOA-SKtanE.jpeg)
Loading the model
3
#3 opened 11 months ago
by
PyrroAiakid
Looking for GGUF format for this model
1
#14 opened 10 months ago
by
barha
Help needed to load model
19
#13 opened 11 months ago
by
sanjay-dev-ds-28
Running Llama-2-7B-32K-Instruct-GGML with llama.cpp ?
13
#1 opened 10 months ago
by
gsimard
How to convert model into GGML format?
54
#13 opened 11 months ago
by
zbruceli
![](https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/zjZanVr7LG7UbvuOUfmX_.jpeg)
gguf files
#22 opened 10 months ago
by
qnixsynapse
![](https://cdn-avatars.huggingface.co/v1/production/uploads/63119cc5af10c9efa1e9b620/HOUcXxq76kaBOA-SKtanE.jpeg)
can't load model with llama.cpp commit 519c981f8b65ee6c87c2965539685ced0a17223b
5
#6 opened 10 months ago
by
md2
Fix the markdown formatting.
1
#1 opened 11 months ago
by
qnixsynapse
![](https://cdn-avatars.huggingface.co/v1/production/uploads/63119cc5af10c9efa1e9b620/HOUcXxq76kaBOA-SKtanE.jpeg)