ttengwang commited on
Commit
03aa843
β€’
1 Parent(s): 10240e0

update readme

Browse files
Files changed (1) hide show
  1. README.md +11 -45
README.md CHANGED
@@ -1,47 +1,13 @@
1
- # Caption-Anything
2
- <!-- ![](./Image/title.svg) -->
3
- **Caption-Anything** is a versatile image processing tool that combines the capabilities of [Segment Anything](https://github.com/facebookresearch/segment-anything), Visual Captioning, and [ChatGPT](https://openai.com/blog/chatgpt). Our solution generates descriptive captions for any object within an image, offering a range of language styles to accommodate diverse user preferences. **Caption-Anything** supports visual controls (mouse click) and language controls (length, sentiment, factuality, and language).
4
- * visual controls and language controls for text generation
5
- * Chat about selected object for detailed understanding
6
- * Interactive demo
7
- ![](./Image/UI.png)
8
-
9
- <!-- <a src="https://img.shields.io/badge/%F0%9F%A4%97-Open%20in%20Spaces-blue" href="https://huggingface.co/spaces/wybertwang/Caption-Anything">
10
- <img src="https://img.shields.io/badge/%F0%9F%A4%97-Open%20in%20Spaces-blue" alt="Open in Spaces">
11
- </a> -->
12
-
13
- <!-- <a src="https://colab.research.google.com/assets/colab-badge.svg" href="">
14
- <img src="https://colab.research.google.com/assets/colab-badge.svg" alt="Open in Colab">
15
- </a> -->
16
-
17
- ### Demo
18
- Explore the interactive demo of Caption-Anything, which showcases its powerful capabilities in generating captions for various objects within an image. The demo allows users to control visual aspects by clicking on objects, as well as to adjust textual properties such as length, sentiment, factuality, and language.
19
- ![](./Image/demo1.png)
20
-
21
  ---
22
 
23
- ![](./Image/demo2.png)
24
-
25
- ### Getting Started
26
-
27
-
28
- * Clone the repository:
29
- ```bash
30
- git clone https://github.com/ttengwang/caption-anything.git
31
- ```
32
- * Install dependencies:
33
- ```bash
34
- cd caption-anything
35
- pip install -r requirements.txt
36
- ```
37
- * Download the [SAM checkpoints](https://dl.fbaipublicfiles.com/segment_anything/sam_vit_h_4b8939.pth) and place it to `./segmenter/sam_vit_h_4b8939.pth.`
38
-
39
- * Run the Caption-Anything gradio demo.
40
- ```bash
41
- # Configure the necessary ChatGPT APIs
42
- export OPENAI_API_KEY={Your_Private_Openai_Key}
43
- python app.py --regular_box --captioner blip2 --port 6086
44
- ```
45
-
46
- ## Acknowledgement
47
- The project is based on [Segment Anything](https://github.com/facebookresearch/segment-anything), BLIP/BLIP-2, [ChatGPT](https://openai.com/blog/chatgpt). Thanks for the authors for their efforts.
 
1
+ ---
2
+ title: Caption Anything
3
+ emoji: πŸ“š
4
+ colorFrom: green
5
+ colorTo: green
6
+ sdk: gradio
7
+ sdk_version: 3.24.1
8
+ app_file: app.py
9
+ pinned: false
10
+ license: apache-2.0
 
 
 
 
 
 
 
 
 
 
11
  ---
12
 
13
+ Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference