Valerie is a custom language model and is pre-trained primarily on Cyberpunk content.