Spaces:

zero-gpu-explorers

/

README

like 86

Running

It's not the crux of this issue, but if the durarion designation exceeds 120 seconds, it's basically buggy.

It's not the crux of this issue, but if the durarion designation exceeds 120 seconds, it's basically buggy.

NO, I just do a test to find the quota.
Actually, the duration maybe 5~10s

Actually, the duration maybe 5~10s

Oh. If so, it's definitely a bug. 😅
I'm also using Zero GPU space, and sometimes the login quota doesn't work properly.
However, in my case, for some reason it's a different pattern from yours, and the login status doesn't work properly in the web browser. If I sign in explicitly using the OAuth sign-in button on the space, it works.
I've never used the Gradio Client...

I have exactly the same need as Nerva1228, and thanks John666 but it seems that, sound like a meme but, it's not a bug it's a feature. Not being able to use my PRO user quota programatically is not good, I want to test my own spaces with different combinations from within my code and I'm as limited as a normal user, is this intended to be that way or there is a solution, or maybe a feature for the future.

I got it to work!!!!

• I duplicated the black-forest-labs/FLUX.1-dev (!!!Important!!!! Go to their Model Card Page and get access granted to their gated model first. Then you can duplicate the model)
• Set the environment variables:
  HF_TOKEN =Use your HF_token (I used read and write credentials for this)
  ZEROGPU_V2=true
  ZERO_GPU_PATCH_TORCH_DEVICE=1

Then in your own (duplicated) space:

• Navigate to the Files
• Click on app.py
• Change

@spaces.GPU(duration=75)  # The duration max value can be 120 but this wasn't enough and still didn't work for me

to

@spaces.GPU()

Make sure in your python code that uses the gradio_client python library your HF_TOKEN is set in the environment or you set the parameter hf_token when creating the client
example:

from gradio_client import Client 
 client = CLIENT("your_duplicated_space/FLUX.1-dev", hf_token=os.getenv("HF_TOKEN"))

I got it to work!!!!

• I duplicated the black-forest-labs/FLUX.1-dev (!!!Important!!!! Go to their Model Card Page and get access granted to their gated model first. Then you can duplicate the model)
• Set the environment variables:
  HF_TOKEN =Use your HF_token (I used read and write credentials for this)
  ZEROGPU_V2=true
  ZERO_GPU_PATCH_TORCH_DEVICE=1

Then in your own (duplicated) space:

• Navigate to the Files
• Click on app.py
• Change

@spaces.GPU(duration=75)  # The duration max value can be 120 but this wasn't enough and still didn't work for me

to

@spaces.GPU()

Make sure in your python code that uses the gradio_client python library your HF_TOKEN is set in the environment or you set the parameter hf_token when creating the client
example:

from gradio_client import Client 
 client = CLIENT("your_duplicated_space/FLUX.1-dev", hf_token=os.getenv("HF_TOKEN"))

And what about the usage of the quota, you are able to use your PRO User quota??

I got it to work!!!!

• I duplicated the black-forest-labs/FLUX.1-dev (!!!Important!!!! Go to their Model Card Page and get access granted to their gated model first. Then you can duplicate the model)
• Set the environment variables:
  HF_TOKEN =Use your HF_token (I used read and write credentials for this)
  ZEROGPU_V2=true
  ZERO_GPU_PATCH_TORCH_DEVICE=1

Then in your own (duplicated) space:

• Navigate to the Files
• Click on app.py
• Change

@spaces.GPU(duration=75)  # The duration max value can be 120 but this wasn't enough and still didn't work for me

to

@spaces.GPU()

Make sure in your python code that uses the gradio_client python library your HF_TOKEN is set in the environment or you set the parameter hf_token when creating the client
example:

from gradio_client import Client 
 client = CLIENT("your_duplicated_space/FLUX.1-dev", hf_token=os.getenv("HF_TOKEN"))

And what about the usage of the quota, you are able to use your PRO User quota??

Yes. Try it out and see if it works for you.

I tried it and it doen't work, one thing is ti reduce the duration like this: @spaces.GPU(duration=75), it's ok.

But that doesn't change the fact that we are consuming quota as a normal user and not as a PRO User when we use it programatically.

The problem stated by Nerva1228 and me, it's still there, we want to be able to use our 25 minutes quota via our python code, not only in the hf spaces interface.

Perhaps related:
https://huggingface.co/spaces/BestWishYsh/ConsisID-preview-Space/discussions/1#674969a022b99c122af5d407

I am stacked with the same problem.
Is any way to upvote this issue?

@hysts Is this a problem specific to Zero GPU space?
Is it better to raise the issue with HF or Gradio?

@John6666 There’s no need to create an issue for this. My understanding is that our infra team is aware that ZeroGPU quota does not work with API use case and that there's a request for it, but it simply hasn’t been implemented yet. cc @cbensimon

Thank you! I understand. I will avoid the issue so as not to cause any unnecessary trouble.😅

@John6666 There’s no need to create an issue for this. My understanding is that our infra team is aware that ZeroGPU quota does not work with API use case and that there's a request for it, but it simply hasn’t been implemented yet. cc @cbensimon

If it is indeed a bug recognized internally within HF, will Hugging face compensate the PRO subscribers for not being able to use quota for which they have paid for? @hysts

@asr143r I'm not in a position to answer refund-related questions, so I've forwarded your inquiry internally.

That’s great, the important thing is HF notice and tell us if it’s an error or is the way is has to be.