How to fill in the middle code?
#24
by
realnex
- opened
Some code model (like starcoder) can fill in the middle code by using some special tokens such as , , ...
I have not seen this feature in the model's README file, so I want to know whether replit-code has feature like this or not.
You are right, replit-code-v1-3b does not support infilling.
That being said, we also trained a version with UL2 fine-tuning which (among the several benefits) does also support infilling. We are currently testing it, and we will make a new release once we confirmed that it works as intended.
Thanks for asking the question, @realnex !
@pirroh Any updates on the infilling model?