SmartBERT / README.md
devilyouwei
init model
2810c64
metadata
license: mit
language:
  - en
base_model:
  - FacebookAI/roberta-base
pipeline_tag: sentence-similarity
tags:
  - smart-contract
  - web3
  - software-engineering
  - web3se
  - embedding
  - RoBERTa

SmartBERT V1 RoBERTa (2022)

Overview

This smart contract pre-trained model is used to transfer smart contract function-level code to embeddings.

It is trained by Sen Fang in 2022 on over 40,000 smart contracts.

Initialized with RoBERTa

Please update to SmartBERT V2

Thanks