Hi @manu , I noticed that in the adapter_config.json file, the "target_modules" is set to ".(text_model).(down_proj|gate_proj|up_proj|k_proj|q_proj|v_proj|o_proj).*$". Is this the correct configuration to fine-tune the adapter for Colidefics?
adapter_config.json
Thanks in advance!
cc: @tonywu71
· Sign up or log in to comment