tokens
#137
by
mishavee
- opened
Does the system have 2048 tokens? How many words is that approximately?
BLOOM and BLOOMZ use the same tokenizer. Closing as a duplicate of https://huggingface.co/bigscience/bloomz/discussions/16
christopher
changed discussion status to
closed