THUdyh commited on
Commit
eebbe2e
·
verified ·
1 Parent(s): 7025fec

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +35 -0
README.md ADDED
@@ -0,0 +1,35 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ base_model:
4
+ - Qwen/Qwen2.5-7B-Instruct
5
+ pipeline_tag: text-generation
6
+ language:
7
+ - en
8
+ - zh
9
+ ---
10
+ # Insight-V-Reason
11
+
12
+ ## Model Summary
13
+
14
+ The Insight-V models are 7B parameter models based on Qwen2.5 language model with a context window of 32K tokens.
15
+
16
+ Oryx offers an on-demand solution to seamlessly and efficiently process visual inputs with arbitrary spatial sizes and temporal lengths.
17
+
18
+ - **Repository:** https://github.com/dongyh20/Insight-V
19
+ - **Languages:** English, Chinese
20
+ - **Paper:** https://arxiv.org/abs/xxxx.xxxx
21
+
22
+
23
+ ### Model Architecture
24
+
25
+ - **Architecture:** Pre-trained [Oryx-ViT](https://huggingface.co/THUdyh/Oryx-ViT) + Qwen2.5-7B
26
+ - **Data:** a mixture of 200k reasoning data
27
+ - **Precision:** BFloat16
28
+
29
+ #### Hardware & Software
30
+
31
+ - **Hardware:** 64 * NVIDIA Tesla A100
32
+ - **Orchestration:** HuggingFace Trainer
33
+ - **Code:** Pytorch
34
+
35
+ ## Citation