Spaces:
Running
Running
File size: 1,807 Bytes
7d723fe dd5b9d2 7d723fe a8e8ce8 7d723fe dd5b9d2 7d723fe dd5b9d2 0d8194c |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 |
---
title: lang-ground
app_file: app_langloc.py
sdk: gradio
sdk_version: 4.44.1
---
# Language Grounding
Localize and keep tracking things based on natural
language sepecfication is a good idea but remains challenging due to the scarcity of large-scale annotated datasets.
This repository provides a practical solution to identify relevant objects in the view and continuously tracking them, which is particularly beneficial for robotics applications.
We offer several demos that showcase the following functionalities:
## Language Localize
Identify and locate objects based on natural language queries.
Try our demo to experience an interesting use case: When analyzing food items, the model demonstrates contextual understanding:
- For food nearing expiration: Suggests storing in the cabinet
- For expired food: Recommends disposal in the trash can
## **Lang Ground (Localize + Track):**
Not only find but also continuously track objects of interest
We prioritize making this project highly accessible and customizable:
- **Open Box Design:** All components are modular and well-documented for easy understanding
- **Customizable Pipeline:** Easily adapt the system for different use cases
- **Extensible Framework:** Simple integration with other vision or language models
## 🛠️ Install
```bash
git clone https://github.com/jing-bi/lang-ground.git && cd lang-ground
mamba create -n lang-ground python=3.11
mamba activate lang-ground
pip install -e .
```
## Acknowledgments
This project is built upon and inspired by the following repositories:
- [Segment-Anything](https://github.com/facebookresearch/segment-anything-2)
- [Supervision](https://github.com/roboflow/supervision)
## License
This project is licensed under the Apache 2.0 License
|