question about GeneformerPreCollator
There is a bug when i am trying to use your code :
trainer = GeneformerPretrainer(
File "/data/home/ict00/csb/geneformer/geneformer/pretrainer.py", line 607, in init
precollator = GeneformerPreCollator(token_dictionary=token_dictionary)
File "/data/home/ict00/csb/geneformer/geneformer/pretrainer.py", line 117, in init
self.all_special_ids = [
AttributeError: can't set attribute
How can I solve it?
Hi, I encountered the same error as you, did you solve the problem?
Thank you for your interest in Geneformer. This code was developed over two years ago and the manuscript was initially submitted over a year ago, so the Huggingface transformers trainer has had some changes since then that are causing this error. I am currently updating the code to function with a more recent transformers version to resolve this error. Thank you for your patience.
I updated the pretrainer and tested it for Huggingface transformers version 4.28.0. Please pull and test it out. Closing the issue for now but feel free to reopen if there are further issues.