RAG-PDF-Chatbot_copied / requirements.txt
sudip1987's picture
Update requirements.txt
5de325f verified
raw
history blame contribute delete
869 Bytes
torch # from pytorch , deep learing framework and used to check hardware cpu or gpu
transformers # used for importing open source model
sentence-transformers # used for creating embedding for sentences and similarity comparison
langchain==0.3.7 # used for construction of LLM based application , using tools
langchain-community # community supported tools for advanced projects
tqdm # percentage display or bar implementation
accelerate # scalling pytorch models across GPU.
pypdf # used to extract pdf into text
faiss-gpu # One of the best Vector db for small dataset
ragas # used to evaluate answer for LLM model
nltk # used for Natural language processing - tokenization ( swimming - swimm - 1 token + ing - 1 token )
langchain_huggingface # Free API for LLM model ( dependency on crowd )
qdrant-client # One of the Vector db
chromadb # One of the best Vector db