File size: 617 Bytes
bc11a63
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
---
license: apache-2.0
tags:
- merge
model-index:
- name: expert-uspto
  results: []
---

# merge-arxiv-50_github-50_avg

This model is a merge between the following models:

- https://huggingface.co/Multi-Domain-Expert-Layers/expert-arxiv
- https://huggingface.co/Multi-Domain-Expert-Layers/expert-github

Using a naive weight averaging strategy at a 50/50 ratio per model.

It has yet to be evaluated.


## Model description

More information needed

## Intended uses & limitations

More information needed

### Framework versions

- Transformers 4.28.1
- Pytorch 2.0.0+cu117
- Datasets 2.11.0
- Tokenizers 0.13.3