Keras Implementation of Text generation with a miniature GPT

This repo contains the model and the notebook to this Keras example on Text generation with a miniature GPT.

Full credits to: fchollet

Background Information

This example demonstrates how to implement text generation with a miniature GPT model. The model consists of a single Transformer block with causal masking in its attention layer.

Datasets

IMDB sentiment classification dataset for training. The model generates new movie reviews for a given prompt.

Downloads last month
17
Inference Examples
Inference API (serverless) does not yet support tf-keras models for this pipeline type.

Space using keras-io/text-generation-miniature-gpt 1