Update README.md
Browse files
README.md
CHANGED
|
@@ -11,8 +11,6 @@ language:
|
|
| 11 |
<h2>Delta Model for Large Language Model for Geoscience</h2>
|
| 12 |
</div>
|
| 13 |
|
| 14 |
-
**Tips: Due to the fact that, the network issues, we are undergoing uploading the models🤦🏻**
|
| 15 |
-
|
| 16 |
## Introduction
|
| 17 |
|
| 18 |
We introduce **K2** (7B), an open-source language model trained by firstly further pretraining LLaMA on collected and cleaned geoscience literature, including geoscience open-access papers and Wikipedia pages, and secondly fine-tuning with knowledge-intensive instruction tuning data (GeoSignal). As for preliminary evaluation, we use GeoBenchmark (consisting of NPEE and AP Test on Geology, Geography, and Environmental Science) as the benchmark. K2 outperforms the baselines on objective and subjective tasks compared to several baseline models with similar parameters.
|
|
|
|
| 11 |
<h2>Delta Model for Large Language Model for Geoscience</h2>
|
| 12 |
</div>
|
| 13 |
|
|
|
|
|
|
|
| 14 |
## Introduction
|
| 15 |
|
| 16 |
We introduce **K2** (7B), an open-source language model trained by firstly further pretraining LLaMA on collected and cleaned geoscience literature, including geoscience open-access papers and Wikipedia pages, and secondly fine-tuning with knowledge-intensive instruction tuning data (GeoSignal). As for preliminary evaluation, we use GeoBenchmark (consisting of NPEE and AP Test on Geology, Geography, and Environmental Science) as the benchmark. K2 outperforms the baselines on objective and subjective tasks compared to several baseline models with similar parameters.
|