| library_name: transformers | |
| tags: [] | |
| Test version of https://huggingface.co/monsoon-nlp/dna-blockdiff using the custom bd3lms EmbeddingLayer instead of the `torch.nn.EmbeddingLayer` | |
| - Does not seem to stop generating | |
| - Does not fix issue with attention on inference | |
| - Does not fix issue with torch.where in training |