gpt2 / README.md
martin-gorner's picture
keras hub migration
b878dd8
|
raw
history blame
689 Bytes
metadata
library_name: keras-hub
pipeline_tag: text-generation

** This Model Card has been manually edited **

This is a GPT2 model uploaded using the KerasNLP library. This model is related to a CausalLM task.

Model config:

  • name: gpt2_backbone
  • trainable: True
  • vocabulary_size: 50257
  • num_layers: 12
  • num_heads: 12
  • hidden_dim: 768
  • intermediate_dim: 3072
  • dropout: 0.1
  • max_sequence_length: 1024

This model card has been generated automatically and should be completed by the model author. See Model Cards documentation for more information.