butler / README.md
tarunkumark2's picture
deployment
2d8b8bf
|
raw
history blame
1.02 kB

Butler - Multimodal RAG Chat Assistant

A powerful chat interface that combines Retrieval-Augmented Generation (RAG) with multimodal capabilities, powered by NVIDIA AI. Butler can process both text and images, providing intelligent responses and detailed analysis of visual content.

🌟 Features

  • πŸ“ Process and analyze multiple document formats (PDF, TXT, PPTX)
  • πŸ–ΌοΈ Advanced image analysis and text extraction
  • πŸ” RAG-powered contextual responses
  • πŸ’¬ Interactive chat interface with file upload
  • πŸš€ NVIDIA AI models for superior performance
  • πŸ—„οΈ Milvus vector store for efficient retrieval

πŸ› οΈ Technology Stack

  • Frontend: Chainlit
  • Embeddings: NVIDIA NV-EmbedQA
  • LLM: NVIDIA LLaMA 3.1 70B
  • Vector Store: Milvus
  • Document Processing: LlamaIndex
  • Image Processing: PIL, PyMuPDF

πŸš€ Getting Started

Prerequisites

  • Python 3.10+
  • Docker and Docker Compose
  • NVIDIA API Key
  • 16GB+ RAM recommended

Installation

  1. Clone the Repository