Spaces:
Sleeping
Sleeping
torch # from pytorch , deep learing framework and used to check hardware cpu or gpu | |
transformers # used for importing open source model | |
sentence-transformers # used for creating embedding for sentences and similarity comparison | |
langchain==0.3.7 # used for construction of LLM based application , using tools | |
langchain-community # community supported tools for advanced projects | |
tqdm # percentage display or bar implementation | |
accelerate # scalling pytorch models across GPU. | |
pypdf # used to extract pdf into text | |
faiss-gpu # One of the best Vector db for small dataset | |
ragas # used to evaluate answer for LLM model | |
nltk # used for Natural language processing - tokenization ( swimming - swimm - 1 token + ing - 1 token ) | |
langchain_huggingface # Free API for LLM model ( dependency on crowd ) | |
qdrant-client # One of the Vector db | |
chromadb # One of the best Vector db |