ggerganov reach-vb HF staff commited on
Commit
79d7b8d
1 Parent(s): 637c8d0

Update README.md (#1)

Browse files

- Update README.md (7f71e78466dcda9d3b15d51f25f4b25a015f36fd)


Co-authored-by: Vaibhav Srivastav <reach-vb@users.noreply.huggingface.co>

Files changed (1) hide show
  1. README.md +15 -1
README.md CHANGED
@@ -7,4 +7,18 @@ sdk: static
7
  pinned: false
8
  ---
9
 
10
- Edit this `README.md` markdown file to author your organization card.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
7
  pinned: false
8
  ---
9
 
10
+ # GGML - AI at the edge
11
+
12
+ ggml is a tensor library for machine learning to enable large models and high performance on commodity hardware. It is used by [llama.cpp](https://github.com/ggerganov/llama.cpp) and [whisper.cpp](https://github.com/ggerganov/whisper.cpp)
13
+
14
+ Written in C
15
+ - 16-bit float support
16
+ - Integer quantization support (e.g. 4-bit, 5-bit, 8-bit)
17
+ - Automatic differentiation
18
+ - Built-in optimization algorithms (e.g. ADAM, L-BFGS)
19
+ - Optimized for Apple Silicon
20
+ - On x86 architectures utilizes AVX / AVX2 intrinsics
21
+ - Web support via WebAssembly and WASM SIMD
22
+ - No third-party dependencies
23
+ - Zero memory allocations during runtime
24
+ - Guided language output support