2025-01-09 15:54:08,215 - hf_validation - WARNING - No .env file found. Fine if you're on Huggingface, but you need one to run locally on your PC.
2025-01-09 15:54:08,215 - hf_validation - ERROR - No HF_TOKEN found in environment variables
2025-01-09 15:54:08,215 - main - INFO - Starting LLM API server
2025-01-09 15:54:08,216 - llm_api - INFO - Initializing LLM API
2025-01-09 15:54:08,216 - llm_api - INFO - LLM API initialized successfully
2025-01-09 15:54:08,216 - api_routes - INFO - Router initialized with LLM API instance
2025-01-09 15:54:08,218 - main - INFO - FastAPI application created successfully
2025-01-09 16:46:10,118 - api_routes - INFO - Received request to download model: microsoft/phi-4
2025-01-09 16:46:10,118 - llm_api - INFO - Starting download of model: microsoft/phi-4
2025-01-09 16:46:10,118 - llm_api - INFO - Enabling stdout logging for download
2025-01-09 17:00:32,400 - llm_api - INFO - Disabling stdout logging
2025-01-09 17:00:32,400 - llm_api - INFO - Saving model to main/models/phi-4
2025-01-09 17:02:39,928 - llm_api - INFO - Successfully downloaded model: microsoft/phi-4
2025-01-09 17:02:41,075 - api_routes - INFO - Successfully downloaded model: microsoft/phi-4
2025-01-09 17:02:41,080 - api_routes - INFO - Received request to initialize model: huihui-ai/Qwen2.5-Coder-32B-Instruct-abliterated
2025-01-09 17:02:41,080 - llm_api - INFO - Initializing generation model: huihui-ai/Qwen2.5-Coder-32B-Instruct-abliterated
2025-01-09 17:02:41,081 - llm_api - INFO - Loading model from source: huihui-ai/Qwen2.5-Coder-32B-Instruct-abliterated
2025-01-09 17:02:41,377 - llm_api - ERROR - Failed to initialize generation model huihui-ai/Qwen2.5-Coder-32B-Instruct-abliterated: Using `low_cpu_mem_usage=True` or a `device_map` requires Accelerate: `pip install 'accelerate>=0.26.0'`
2025-01-09 17:02:41,377 - api_routes - ERROR - Error initializing model: Using `low_cpu_mem_usage=True` or a `device_map` requires Accelerate: `pip install 'accelerate>=0.26.0'`
2025-01-09 17:11:25,843 - hf_validation - WARNING - No .env file found. Fine if you're on Huggingface, but you need one to run locally on your PC.
2025-01-09 17:11:25,843 - hf_validation - ERROR - No HF_TOKEN found in environment variables
2025-01-09 17:11:25,843 - main - INFO - Starting LLM API server
2025-01-09 17:11:25,843 - llm_api - INFO - Initializing LLM API
2025-01-09 17:11:25,844 - llm_api - INFO - LLM API initialized successfully
2025-01-09 17:11:25,844 - api_routes - INFO - Router initialized with LLM API instance
2025-01-09 17:11:25,846 - main - INFO - FastAPI application created successfully
2025-01-09 17:11:38,299 - api_routes - INFO - Received request to initialize model: huihui-ai/Qwen2.5-Coder-32B-Instruct-abliterated
2025-01-09 17:11:38,299 - llm_api - INFO - Initializing generation model: huihui-ai/Qwen2.5-Coder-32B-Instruct-abliterated
2025-01-09 17:11:38,299 - llm_api - INFO - Loading model from source: huihui-ai/Qwen2.5-Coder-32B-Instruct-abliterated
2025-01-09 17:11:38,487 - llm_api - ERROR - Failed to initialize generation model huihui-ai/Qwen2.5-Coder-32B-Instruct-abliterated: Using `bitsandbytes` 8-bit quantization requires the latest version of bitsandbytes: `pip install -U bitsandbytes`
2025-01-09 17:11:38,487 - api_routes - ERROR - Error initializing model: Using `bitsandbytes` 8-bit quantization requires the latest version of bitsandbytes: `pip install -U bitsandbytes`
2025-01-09 17:12:48,606 - hf_validation - WARNING - No .env file found. Fine if you're on Huggingface, but you need one to run locally on your PC.
2025-01-09 17:12:48,606 - hf_validation - ERROR - No HF_TOKEN found in environment variables
2025-01-09 17:12:48,606 - main - INFO - Starting LLM API server
2025-01-09 17:12:48,606 - llm_api - INFO - Initializing LLM API
2025-01-09 17:12:48,606 - llm_api - INFO - LLM API initialized successfully
2025-01-09 17:12:48,606 - api_routes - INFO - Router initialized with LLM API instance
2025-01-09 17:12:48,608 - main - INFO - FastAPI application created successfully
2025-01-09 17:12:59,453 - api_routes - INFO - Received request to initialize model: huihui-ai/Qwen2.5-Coder-32B-Instruct-abliterated
2025-01-09 17:12:59,453 - llm_api - INFO - Initializing generation model: huihui-ai/Qwen2.5-Coder-32B-Instruct-abliterated
2025-01-09 17:12:59,453 - llm_api - INFO - Loading model from source: huihui-ai/Qwen2.5-Coder-32B-Instruct-abliterated
2025-01-09 17:12:59,628 - llm_api - ERROR - Failed to initialize generation model huihui-ai/Qwen2.5-Coder-32B-Instruct-abliterated: CUDA is required but not available for bitsandbytes. Please consider installing the multi-platform enabled version of bitsandbytes, which is currently a work in progress. Please check currently supported platforms and installation instructions at https://huggingface.co/docs/bitsandbytes/main/en/installation#multi-backend
2025-01-09 17:12:59,628 - api_routes - ERROR - Error initializing model: CUDA is required but not available for bitsandbytes. Please consider installing the multi-platform enabled version of bitsandbytes, which is currently a work in progress. Please check currently supported platforms and installation instructions at https://huggingface.co/docs/bitsandbytes/main/en/installation#multi-backend
2025-01-09 17:14:44,390 - api_routes - INFO - Received request to initialize model: huihui-ai/Qwen2.5-Coder-32B-Instruct-abliterated
2025-01-09 17:14:44,390 - llm_api - INFO - Initializing generation model: huihui-ai/Qwen2.5-Coder-32B-Instruct-abliterated
2025-01-09 17:14:44,390 - llm_api - INFO - Loading model from source: huihui-ai/Qwen2.5-Coder-32B-Instruct-abliterated
2025-01-09 17:14:53,032 - llm_api - ERROR - Failed to initialize generation model huihui-ai/Qwen2.5-Coder-32B-Instruct-abliterated: CUDA is required but not available for bitsandbytes. Please consider installing the multi-platform enabled version of bitsandbytes, which is currently a work in progress. Please check currently supported platforms and installation instructions at https://huggingface.co/docs/bitsandbytes/main/en/installation#multi-backend
2025-01-09 17:14:53,032 - api_routes - ERROR - Error initializing model: CUDA is required but not available for bitsandbytes. Please consider installing the multi-platform enabled version of bitsandbytes, which is currently a work in progress. Please check currently supported platforms and installation instructions at https://huggingface.co/docs/bitsandbytes/main/en/installation#multi-backend
2025-01-09 17:15:14,956 - api_routes - INFO - Received request to initialize model: microsoft/phi-4
2025-01-09 17:15:14,956 - llm_api - INFO - Initializing generation model: microsoft/phi-4
2025-01-09 17:15:14,956 - llm_api - INFO - Loading model from local path: main/models/phi-4
2025-01-09 17:15:14,965 - llm_api - ERROR - Failed to initialize generation model microsoft/phi-4: CUDA is required but not available for bitsandbytes. Please consider installing the multi-platform enabled version of bitsandbytes, which is currently a work in progress. Please check currently supported platforms and installation instructions at https://huggingface.co/docs/bitsandbytes/main/en/installation#multi-backend
2025-01-09 17:15:14,965 - api_routes - ERROR - Error initializing model: CUDA is required but not available for bitsandbytes. Please consider installing the multi-platform enabled version of bitsandbytes, which is currently a work in progress. Please check currently supported platforms and installation instructions at https://huggingface.co/docs/bitsandbytes/main/en/installation#multi-backend
2025-01-13 16:04:32,247 - hf_validation - WARNING - No .env file found. Fine if you're on Huggingface, but you need one to run locally on your PC.
2025-01-13 16:04:32,247 - hf_validation - ERROR - No HF_TOKEN found in environment variables
2025-01-13 16:04:32,247 - main - INFO - Starting LLM API server
2025-01-13 16:04:32,248 - llm_api - INFO - Initializing LLM API
2025-01-13 16:04:32,248 - llm_api - INFO - LLM API initialized successfully
2025-01-13 16:04:32,248 - api_routes - INFO - Router initialized with LLM API instance
2025-01-13 16:04:32,252 - main - INFO - FastAPI application created successfully
2025-01-13 16:05:27,996 - api_routes - INFO - Received request to download model: microsoft/Phi-3.5-mini-instruct
2025-01-13 16:05:27,996 - llm_api - INFO - Starting download of model: microsoft/Phi-3.5-mini-instruct
2025-01-13 16:05:27,996 - llm_api - INFO - Enabling stdout logging for download
2025-01-13 16:08:46,773 - llm_api - INFO - Disabling stdout logging
2025-01-13 16:08:46,773 - llm_api - INFO - Saving model to main/models/Phi-3.5-mini-instruct
2025-01-13 16:10:23,543 - llm_api - INFO - Successfully downloaded model: microsoft/Phi-3.5-mini-instruct
2025-01-13 16:10:24,432 - api_routes - INFO - Successfully downloaded model: microsoft/Phi-3.5-mini-instruct
2025-01-13 16:18:45,409 - api_routes - INFO - Received request to initialize model: microsoft/Phi-3.5-mini-instruct
2025-01-13 16:18:45,409 - llm_api - INFO - Initializing generation model: microsoft/Phi-3.5-mini-instruct
2025-01-13 16:18:45,412 - llm_api - INFO - Loading model from local path: main/models/Phi-3.5-mini-instruct
2025-01-13 16:18:45,982 - llm_api - ERROR - Failed to initialize generation model microsoft/Phi-3.5-mini-instruct: Failed to import transformers.integrations.bitsandbytes because of the following error (look up to see its traceback):
Dynamo is not supported on Python 3.13+
2025-01-13 16:18:45,982 - api_routes - ERROR - Error initializing model: Failed to import transformers.integrations.bitsandbytes because of the following error (look up to see its traceback):
Dynamo is not supported on Python 3.13+
2025-01-14 11:41:25,502 - hf_validation - WARNING - No .env file found. Fine if you're on Huggingface, but you need one to run locally on your PC.
2025-01-14 11:41:25,502 - hf_validation - ERROR - No HF_TOKEN found in environment variables
2025-01-14 11:41:25,502 - main - INFO - Starting LLM API server
2025-01-14 11:41:25,503 - llm_api - INFO - Initializing LLM API
2025-01-14 11:41:25,503 - llm_api - INFO - LLM API initialized successfully
2025-01-14 11:41:25,503 - api_routes - INFO - Router initialized with LLM API instance
2025-01-14 11:41:25,509 - main - INFO - FastAPI application created successfully
2025-01-14 11:48:33,807 - hf_validation - WARNING - No .env file found. Fine if you're on Huggingface, but you need one to run locally on your PC.
2025-01-14 11:48:33,807 - hf_validation - ERROR - No HF_TOKEN found in environment variables
2025-01-14 11:48:33,807 - main - INFO - Starting LLM API server
2025-01-14 11:48:33,807 - llm_api - INFO - Initializing LLM API
2025-01-14 11:48:33,807 - llm_api - INFO - LLM API initialized successfully
2025-01-14 11:48:33,807 - api_routes - INFO - Router initialized with LLM API instance
2025-01-14 11:48:33,812 - main - INFO - FastAPI application created successfully
2025-01-14 11:53:20,777 - hf_validation - WARNING - No .env file found. Fine if you're on Huggingface, but you need one to run locally on your PC.
2025-01-14 11:53:20,777 - hf_validation - ERROR - No HF_TOKEN found in environment variables
2025-01-14 11:53:20,777 - main - INFO - Starting LLM API server
2025-01-14 11:53:20,777 - llm_api - INFO - Initializing LLM API
2025-01-14 11:53:20,778 - llm_api - INFO - LLM API initialized successfully
2025-01-14 11:53:20,778 - api_routes - INFO - Router initialized with LLM API instance
2025-01-14 11:53:20,783 - main - INFO - FastAPI application created successfully
2025-01-14 11:54:28,143 - api_routes - INFO - Received request to download model: microsoft/Phi-3.5-mini-instruct
2025-01-14 11:54:28,143 - llm_api - INFO - Starting download of model: microsoft/Phi-3.5-mini-instruct
2025-01-14 11:54:28,143 - llm_api - INFO - Enabling stdout logging for download
2025-01-14 11:54:47,061 - llm_api - INFO - Disabling stdout logging
2025-01-14 11:54:47,061 - llm_api - INFO - Saving model to main/models/Phi-3.5-mini-instruct
2025-01-14 11:56:40,600 - llm_api - INFO - Successfully downloaded model: microsoft/Phi-3.5-mini-instruct
2025-01-14 11:56:41,266 - api_routes - INFO - Successfully downloaded model: microsoft/Phi-3.5-mini-instruct
2025-01-14 11:56:41,364 - api_routes - INFO - Received request to initialize model: microsoft/Phi-3.5-mini-instruct
2025-01-14 11:56:41,365 - llm_api - INFO - Initializing generation model: microsoft/Phi-3.5-mini-instruct
2025-01-14 11:56:41,367 - llm_api - INFO - Loading model from local path: main/models/Phi-3.5-mini-instruct
2025-01-14 11:56:45,322 - llm_api - ERROR - Failed to initialize generation model microsoft/Phi-3.5-mini-instruct: /home/aurelio/Desktop/Projects/LLMServer/myenv/lib/python3.12/site-packages/bitsandbytes/libbitsandbytes_cpu.so: undefined symbol: cget_col_row_stats
2025-01-14 11:56:45,322 - api_routes - ERROR - Error initializing model: /home/aurelio/Desktop/Projects/LLMServer/myenv/lib/python3.12/site-packages/bitsandbytes/libbitsandbytes_cpu.so: undefined symbol: cget_col_row_stats
2025-01-14 12:29:54,971 - main - INFO - LLM API server started on 0.0.0.0:8001
2025-01-14 12:30:01,275 - hf_validation - WARNING - No .env file found. Fine if you're on Huggingface, but you need one to run locally on your PC.
2025-01-14 12:30:01,275 - hf_validation - ERROR - No HF_TOKEN found in environment variables
2025-01-14 12:30:01,275 - main - INFO - Starting LLM API server
2025-01-14 12:30:01,275 - llm_api - INFO - Initializing LLM API
2025-01-14 12:30:01,275 - llm_api - INFO - LLM API initialized successfully
2025-01-14 12:30:01,276 - api_routes - INFO - Router initialized with LLM API instance
2025-01-14 12:30:01,280 - main - INFO - FastAPI application created successfully
2025-01-14 12:31:15,345 - hf_validation - WARNING - No .env file found. Fine if you're on Huggingface, but you need one to run locally on your PC.
2025-01-14 12:31:15,345 - hf_validation - ERROR - No HF_TOKEN found in environment variables
2025-01-14 12:31:15,345 - main - INFO - Starting LLM API server
2025-01-14 12:31:15,345 - llm_api - INFO - Initializing LLM API
2025-01-14 12:31:15,346 - llm_api - INFO - LLM API initialized successfully
2025-01-14 12:31:15,346 - api_routes - INFO - Router initialized with LLM API instance
2025-01-14 12:31:15,350 - main - INFO - FastAPI application created successfully
2025-01-14 12:31:43,376 - hf_validation - WARNING - No .env file found. Fine if you're on Huggingface, but you need one to run locally on your PC.
2025-01-14 12:31:43,376 - hf_validation - ERROR - No HF_TOKEN found in environment variables
2025-01-14 12:31:43,376 - main - INFO - Starting LLM API server
2025-01-14 12:31:43,377 - llm_api - INFO - Initializing LLM API
2025-01-14 12:31:43,377 - llm_api - INFO - LLM API initialized successfully
2025-01-14 12:31:43,377 - api_routes - INFO - Router initialized with LLM API instance
2025-01-14 12:31:43,381 - main - INFO - FastAPI application created successfully
2025-01-14 12:31:51,142 - llm_api - INFO - INFO:     127.0.0.1:52554 - "GET /docs HTTP/1.1" 200 OK
2025-01-14 12:31:51,311 - llm_api - INFO - INFO:     127.0.0.1:52554 - "GET /openapi.json HTTP/1.1" 200 OK
2025-01-14 12:32:10,756 - api_routes - INFO - Received request to initialize model: microsoft/Phi-3.5-mini-instruct
2025-01-14 12:32:10,757 - llm_api - INFO - Initializing generation model: microsoft/Phi-3.5-mini-instruct
2025-01-14 12:32:10,757 - llm_api - INFO - Loading model from local path: main/models/Phi-3.5-mini-instruct
2025-01-14 12:32:26,447 - llm_api - INFO - Successfully initialized generation model: microsoft/Phi-3.5-mini-instruct
2025-01-14 12:32:26,448 - api_routes - INFO - Successfully initialized model: microsoft/Phi-3.5-mini-instruct
2025-01-14 12:32:26,448 - llm_api - INFO - INFO:     127.0.0.1:34282 - "POST /api/v1/model/initialize?model_name=microsoft%2FPhi-3.5-mini-instruct HTTP/1.1" 200 OK
2025-01-14 12:33:13,272 - api_routes - INFO - Received generation request for prompt: Tell me about yourself, and your capabilities...
2025-01-14 12:33:13,272 - llm_api - DEBUG - Generating response for prompt: Tell me about yourself, and your capabilities...
2025-01-14 12:33:46,448 - llm_api - DEBUG - Generated response: I am Phi, an AI language model developed by Micros...
2025-01-14 12:33:46,448 - api_routes - INFO - Successfully generated response
2025-01-14 12:33:46,448 - llm_api - INFO - INFO:     127.0.0.1:57442 - "POST /api/v1/generate HTTP/1.1" 200 OK
2025-01-14 12:34:41,588 - api_routes - INFO - Received streaming generation request for prompt: Tell me about yourself, and your capabilities...
2025-01-14 12:34:41,588 - llm_api - DEBUG - Starting streaming generation for prompt: Tell me about yourself, and your capabilities...
2025-01-14 12:34:41,608 - llm_api - DEBUG - Generated chunk: <|system|> You are a helpful assistant<|end|><|use...
2025-01-14 12:34:41,689 - llm_api - DEBUG - Generated chunk: capabilities<|end|><|assistant|> ...
2025-01-14 12:34:41,757 - llm_api - DEBUG - Generated chunk: I ...
2025-01-14 12:34:41,827 - llm_api - DEBUG - Generated chunk: am ...
2025-01-14 12:34:41,895 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:34:41,965 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:34:42,033 - llm_api - DEBUG - Generated chunk: Phi, ...
2025-01-14 12:34:42,102 - llm_api - DEBUG - Generated chunk: an ...
2025-01-14 12:34:42,172 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:34:42,241 - llm_api - DEBUG - Generated chunk: AI ...
2025-01-14 12:34:42,309 - llm_api - DEBUG - Generated chunk: language ...
2025-01-14 12:34:42,377 - llm_api - DEBUG - Generated chunk: model ...
2025-01-14 12:34:42,448 - llm_api - DEBUG - Generated chunk: created ...
2025-01-14 12:34:42,521 - llm_api - DEBUG - Generated chunk: by ...
2025-01-14 12:34:42,590 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:34:42,656 - llm_api - DEBUG - Generated chunk: Microsoft. ...
2025-01-14 12:34:42,721 - llm_api - DEBUG - Generated chunk: While ...
2025-01-14 12:34:42,788 - llm_api - DEBUG - Generated chunk: I ...
2025-01-14 12:34:42,854 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:34:42,925 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:34:42,991 - llm_api - DEBUG - Generated chunk: don't ...
2025-01-14 12:34:43,063 - llm_api - DEBUG - Generated chunk: have ...
2025-01-14 12:34:43,131 - llm_api - DEBUG - Generated chunk: personal ...
2025-01-14 12:34:43,201 - llm_api - DEBUG - Generated chunk: experiences ...
2025-01-14 12:34:43,267 - llm_api - DEBUG - Generated chunk: or ...
2025-01-14 12:34:43,334 - llm_api - DEBUG - Generated chunk: feelings ...
2025-01-14 12:34:43,402 - llm_api - DEBUG - Generated chunk: like ...
2025-01-14 12:34:43,472 - llm_api - DEBUG - Generated chunk: humans ...
2025-01-14 12:34:43,537 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:34:43,600 - llm_api - DEBUG - Generated chunk: do, ...
2025-01-14 12:34:43,663 - llm_api - DEBUG - Generated chunk: let ...
2025-01-14 12:34:43,729 - llm_api - DEBUG - Generated chunk: me ...
2025-01-14 12:34:43,793 - llm_api - DEBUG - Generated chunk: tell ...
2025-01-14 12:34:43,859 - llm_api - DEBUG - Generated chunk: you ...
2025-01-14 12:34:43,924 - llm_api - DEBUG - Generated chunk: more ...
2025-01-14 12:34:43,989 - llm_api - DEBUG - Generated chunk: about ...
2025-01-14 12:34:44,053 - llm_api - DEBUG - Generated chunk: my ...
2025-01-14 12:34:44,119 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:34:44,183 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:34:44,247 - llm_api - DEBUG - Generated chunk: functionalities:
...
2025-01-14 12:34:44,312 - llm_api - DEBUG - Generated chunk: 
...
2025-01-14 12:34:44,375 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:34:44,440 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:34:44,505 - llm_api - DEBUG - Generated chunk: 1. ...
2025-01-14 12:34:44,567 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:34:44,632 - llm_api - DEBUG - Generated chunk: **Language ...
2025-01-14 12:34:44,698 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:34:44,763 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:34:44,828 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:34:44,892 - llm_api - DEBUG - Generated chunk: Understanding**: ...
2025-01-14 12:34:44,956 - llm_api - DEBUG - Generated chunk: My ...
2025-01-14 12:34:45,020 - llm_api - DEBUG - Generated chunk: primary ...
2025-01-14 12:34:45,085 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:34:45,148 - llm_api - DEBUG - Generated chunk: capability ...
2025-01-14 12:34:45,211 - llm_api - DEBUG - Generated chunk: is ...
2025-01-14 12:34:45,275 - llm_api - DEBUG - Generated chunk: understanding ...
2025-01-14 12:34:45,338 - llm_api - DEBUG - Generated chunk: natural ...
2025-01-14 12:34:45,401 - llm_api - DEBUG - Generated chunk: human ...
2025-01-14 12:34:45,465 - llm_api - DEBUG - Generated chunk: languages ...
2025-01-14 12:34:45,529 - llm_api - DEBUG - Generated chunk: to ...
2025-01-14 12:34:45,592 - llm_api - DEBUG - Generated chunk: the ...
2025-01-14 12:34:45,658 - llm_api - DEBUG - Generated chunk: best ...
2025-01-14 12:34:45,728 - llm_api - DEBUG - Generated chunk: of ...
2025-01-14 12:34:45,804 - llm_api - DEBUG - Generated chunk: our ...
2025-01-14 12:34:45,871 - llm_api - DEBUG - Generated chunk: current ...
2025-01-14 12:34:45,938 - llm_api - DEBUG - Generated chunk: technology ...
2025-01-14 12:34:46,004 - llm_api - DEBUG - Generated chunk: allows ...
2025-01-14 12:34:46,072 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:34:46,139 - llm_api - DEBUG - Generated chunk: it. ...
2025-01-14 12:34:46,207 - llm_api - DEBUG - Generated chunk: This ...
2025-01-14 12:34:46,273 - llm_api - DEBUG - Generated chunk: includes ...
2025-01-14 12:34:46,341 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:34:46,408 - llm_api - DEBUG - Generated chunk: interpreting ...
2025-01-14 12:34:46,473 - llm_api - DEBUG - Generated chunk: text ...
2025-01-14 12:34:46,539 - llm_api - DEBUG - Generated chunk: inputs ...
2025-01-14 12:34:46,605 - llm_api - DEBUG - Generated chunk: from ...
2025-01-14 12:34:46,670 - llm_api - DEBUG - Generated chunk: various ...
2025-01-14 12:34:46,735 - llm_api - DEBUG - Generated chunk: sources ...
2025-01-14 12:34:46,801 - llm_api - DEBUG - Generated chunk: such ...
2025-01-14 12:34:46,867 - llm_api - DEBUG - Generated chunk: as ...
2025-01-14 12:34:46,935 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:34:47,005 - llm_api - DEBUG - Generated chunk: websites, ...
2025-01-14 12:34:47,073 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:34:47,142 - llm_api - DEBUG - Generated chunk: books, ...
2025-01-14 12:34:47,208 - llm_api - DEBUG - Generated chunk: articles ...
2025-01-14 12:34:47,275 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:34:47,341 - llm_api - DEBUG - Generated chunk: etc., ...
2025-01-14 12:34:47,408 - llm_api - DEBUG - Generated chunk: in ...
2025-01-14 12:34:47,472 - llm_api - DEBUG - Generated chunk: multiple ...
2025-01-14 12:34:47,536 - llm_api - DEBUG - Generated chunk: formats ...
2025-01-14 12:34:47,600 - llm_api - DEBUG - Generated chunk: including ...
2025-01-14 12:34:47,674 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:34:47,744 - llm_api - DEBUG - Generated chunk: English, ...
2025-01-14 12:34:47,814 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:34:47,901 - llm_api - DEBUG - Generated chunk: Spanish, ...
2025-01-14 12:34:47,991 - llm_api - DEBUG - Generated chunk: French ...
2025-01-14 12:34:48,066 - llm_api - DEBUG - Generated chunk: among ...
2025-01-14 12:34:48,131 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:34:48,194 - llm_api - DEBUG - Generated chunk: others. ...
2025-01-14 12:34:48,259 - llm_api - DEBUG - Generated chunk: 
...
2025-01-14 12:34:48,325 - llm_api - DEBUG - Generated chunk: 
...
2025-01-14 12:34:48,390 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:34:48,454 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:34:48,519 - llm_api - DEBUG - Generated chunk: 2. ...
2025-01-14 12:34:48,583 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:34:48,647 - llm_api - DEBUG - Generated chunk: **Text ...
2025-01-14 12:34:48,711 - llm_api - DEBUG - Generated chunk: Generation ...
2025-01-14 12:34:48,773 - llm_api - DEBUG - Generated chunk: & ...
2025-01-14 12:34:48,837 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:34:48,902 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:34:48,965 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:34:49,031 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:34:49,096 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:34:49,160 - llm_api - DEBUG - Generated chunk: Comprehension**: ...
2025-01-14 12:34:49,224 - llm_api - DEBUG - Generated chunk: Based ...
2025-01-14 12:34:49,289 - llm_api - DEBUG - Generated chunk: on ...
2025-01-14 12:34:49,353 - llm_api - DEBUG - Generated chunk: patterns ...
2025-01-14 12:34:49,419 - llm_api - DEBUG - Generated chunk: learned ...
2025-01-14 12:34:49,488 - llm_api - DEBUG - Generated chunk: during ...
2025-01-14 12:34:49,555 - llm_api - DEBUG - Generated chunk: training ...
2025-01-14 12:34:49,621 - llm_api - DEBUG - Generated chunk: with ...
2025-01-14 12:34:49,686 - llm_api - DEBUG - Generated chunk: diverse ...
2025-01-14 12:34:49,750 - llm_api - DEBUG - Generated chunk: internet ...
2025-01-14 12:34:49,814 - llm_api - DEBUG - Generated chunk: texts ...
2025-01-14 12:34:49,879 - llm_api - DEBUG - Generated chunk: data ...
2025-01-14 12:34:49,944 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:34:50,009 - llm_api - DEBUG - Generated chunk: sets, ...
2025-01-14 12:34:50,074 - llm_api - DEBUG - Generated chunk: I ...
2025-01-14 12:34:50,140 - llm_api - DEBUG - Generated chunk: can ...
2025-01-14 12:34:50,204 - llm_api - DEBUG - Generated chunk: generate ...
2025-01-14 12:34:50,269 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:34:50,336 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:34:50,401 - llm_api - DEBUG - Generated chunk: coherent ...
2025-01-14 12:34:50,466 - llm_api - DEBUG - Generated chunk: responses ...
2025-01-14 12:34:50,530 - llm_api - DEBUG - Generated chunk: that ...
2025-01-14 12:34:50,595 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:34:50,658 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:34:50,722 - llm_api - DEBUG - Generated chunk: mimic ...
2025-01-14 12:34:50,787 - llm_api - DEBUG - Generated chunk: how ...
2025-01-14 12:34:50,852 - llm_api - DEBUG - Generated chunk: real ...
2025-01-14 12:34:50,916 - llm_api - DEBUG - Generated chunk: people ...
2025-01-14 12:34:50,980 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:34:51,043 - llm_api - DEBUG - Generated chunk: write. ...
2025-01-14 12:34:51,107 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:34:51,171 - llm_api - DEBUG - Generated chunk: However, ...
2025-01-14 12:34:51,236 - llm_api - DEBUG - Generated chunk: please ...
2025-01-14 12:34:51,299 - llm_api - DEBUG - Generated chunk: note ...
2025-01-14 12:34:51,364 - llm_api - DEBUG - Generated chunk: these ...
2025-01-14 12:34:51,428 - llm_api - DEBUG - Generated chunk: generated ...
2025-01-14 12:34:51,491 - llm_api - DEBUG - Generated chunk: outputs ...
2025-01-14 12:34:51,556 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:34:51,620 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:34:51,685 - llm_api - DEBUG - Generated chunk: aren’t ...
2025-01-14 12:34:51,748 - llm_api - DEBUG - Generated chunk: perfect ...
2025-01-14 12:34:51,813 - llm_api - DEBUG - Generated chunk: nor ...
2025-01-14 12:34:51,877 - llm_api - DEBUG - Generated chunk: fully ...
2025-01-14 12:34:51,940 - llm_api - DEBUG - Generated chunk: accurate ...
2025-01-14 12:34:52,005 - llm_api - DEBUG - Generated chunk: but ...
2025-01-14 12:34:52,068 - llm_api - DEBUG - Generated chunk: they ...
2025-01-14 12:34:52,131 - llm_api - DEBUG - Generated chunk: often ...
2025-01-14 12:34:52,196 - llm_api - DEBUG - Generated chunk: make ...
2025-01-14 12:34:52,260 - llm_api - DEBUG - Generated chunk: sense ...
2025-01-14 12:34:52,324 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:34:52,388 - llm_api - DEBUG - Generated chunk: contextually ...
2025-01-14 12:34:52,451 - llm_api - DEBUG - Generated chunk: within ...
2025-01-14 12:34:52,516 - llm_api - DEBUG - Generated chunk: given ...
2025-01-14 12:34:52,579 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:34:52,643 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:34:52,707 - llm_api - DEBUG - Generated chunk: prompts.
...
2025-01-14 12:34:52,771 - llm_api - DEBUG - Generated chunk: 
...
2025-01-14 12:34:52,835 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:34:52,899 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:34:52,963 - llm_api - DEBUG - Generated chunk: 3. ...
2025-01-14 12:34:53,026 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:34:53,095 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:34:53,168 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:34:53,237 - llm_api - DEBUG - Generated chunk: **Knowledge ...
2025-01-14 12:34:53,302 - llm_api - DEBUG - Generated chunk: Base ...
2025-01-14 12:34:53,371 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:34:53,440 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:34:53,508 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:34:53,576 - llm_api - DEBUG - Generated chunk: Accessing**: ...
2025-01-14 12:34:53,642 - llm_api - DEBUG - Generated chunk: Although ...
2025-01-14 12:34:53,710 - llm_api - DEBUG - Generated chunk: not ...
2025-01-14 12:34:53,775 - llm_api - DEBUG - Generated chunk: connected ...
2025-01-14 12:34:53,838 - llm_api - DEBUG - Generated chunk: live ...
2025-01-14 12:34:53,903 - llm_api - DEBUG - Generated chunk: for ...
2025-01-14 12:34:53,968 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:34:54,032 - llm_api - DEBUG - Generated chunk: browsing ...
2025-01-14 12:34:54,096 - llm_api - DEBUG - Generated chunk: external ...
2025-01-14 12:34:54,159 - llm_api - DEBUG - Generated chunk: databases ...
2025-01-14 12:34:54,224 - llm_api - DEBUG - Generated chunk: at ...
2025-01-14 12:34:54,287 - llm_api - DEBUG - Generated chunk: this ...
2025-01-14 12:34:54,351 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:34:54,414 - llm_api - DEBUG - Generated chunk: moment, ...
2025-01-14 12:34:54,478 - llm_api - DEBUG - Generated chunk: information ...
2025-01-14 12:34:54,542 - llm_api - DEBUG - Generated chunk: up ...
2025-01-14 12:34:54,606 - llm_api - DEBUG - Generated chunk: until ...
2025-01-14 12:34:54,670 - llm_api - DEBUG - Generated chunk: September ...
2025-01-14 12:34:54,735 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:34:54,799 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:34:54,864 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:34:54,928 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:34:54,992 - llm_api - DEBUG - Generated chunk: 2021 ...
2025-01-14 12:34:55,056 - llm_api - DEBUG - Generated chunk: has ...
2025-01-14 12:34:55,120 - llm_api - DEBUG - Generated chunk: been ...
2025-01-14 12:34:55,184 - llm_api - DEBUG - Generated chunk: used ...
2025-01-14 12:34:55,249 - llm_api - DEBUG - Generated chunk: when ...
2025-01-14 12:34:55,313 - llm_api - DEBUG - Generated chunk: generating ...
2025-01-14 12:34:55,376 - llm_api - DEBUG - Generated chunk: answers ...
2025-01-14 12:34:55,441 - llm_api - DEBUG - Generated chunk: based ...
2025-01-14 12:34:55,504 - llm_api - DEBUG - Generated chunk: upon ...
2025-01-14 12:34:55,568 - llm_api - DEBUG - Generated chunk: extensive ...
2025-01-14 12:34:55,632 - llm_api - DEBUG - Generated chunk: datasets ...
2025-01-14 12:34:55,696 - llm_api - DEBUG - Generated chunk: which ...
2025-01-14 12:34:55,760 - llm_api - DEBUG - Generated chunk: include ...
2025-01-14 12:34:55,825 - llm_api - DEBUG - Generated chunk: facts ...
2025-01-14 12:34:55,889 - llm_api - DEBUG - Generated chunk: known ...
2025-01-14 12:34:55,953 - llm_api - DEBUG - Generated chunk: till ...
2025-01-14 12:34:56,017 - llm_api - DEBUG - Generated chunk: then ...
2025-01-14 12:34:56,082 - llm_api - DEBUG - Generated chunk: across ...
2025-01-14 12:34:56,146 - llm_api - DEBUG - Generated chunk: numerous ...
2025-01-14 12:34:56,210 - llm_api - DEBUG - Generated chunk: topics ...
2025-01-14 12:34:56,281 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:34:56,346 - llm_api - DEBUG - Generated chunk: ranging ...
2025-01-14 12:34:56,410 - llm_api - DEBUG - Generated chunk: from ...
2025-01-14 12:34:56,474 - llm_api - DEBUG - Generated chunk: science ...
2025-01-14 12:34:56,537 - llm_api - DEBUG - Generated chunk: to ...
2025-01-14 12:34:56,631 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:34:56,730 - llm_api - DEBUG - Generated chunk: arts, ...
2025-01-14 12:34:56,818 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:34:56,886 - llm_api - DEBUG - Generated chunk: history, ...
2025-01-14 12:34:56,951 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:34:57,016 - llm_api - DEBUG - Generated chunk: culture, ...
2025-01-14 12:34:57,080 - llm_api - DEBUG - Generated chunk: sports ...
2025-01-14 12:34:57,145 - llm_api - DEBUG - Generated chunk: amongst ...
2025-01-14 12:34:57,209 - llm_api - DEBUG - Generated chunk: many ...
2025-01-14 12:34:57,273 - llm_api - DEBUG - Generated chunk: other ...
2025-01-14 12:34:57,337 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:34:57,401 - llm_api - DEBUG - Generated chunk: fields.
...
2025-01-14 12:34:57,467 - llm_api - DEBUG - Generated chunk: 
...
2025-01-14 12:34:57,531 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:34:57,595 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:34:57,659 - llm_api - DEBUG - Generated chunk: 4. ...
2025-01-14 12:34:57,723 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:34:57,786 - llm_api - DEBUG - Generated chunk: **Problem ...
2025-01-14 12:34:57,850 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:34:57,914 - llm_api - DEBUG - Generated chunk: Solving ...
2025-01-14 12:34:57,978 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:34:58,042 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:34:58,106 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:34:58,168 - llm_api - DEBUG - Generated chunk: Skills**: ...
2025-01-14 12:34:58,231 - llm_api - DEBUG - Generated chunk: In ...
2025-01-14 12:34:58,294 - llm_api - DEBUG - Generated chunk: certain ...
2025-01-14 12:34:58,357 - llm_api - DEBUG - Generated chunk: scenarios ...
2025-01-14 12:34:58,421 - llm_api - DEBUG - Generated chunk: where ...
2025-01-14 12:34:58,484 - llm_api - DEBUG - Generated chunk: logical ...
2025-01-14 12:34:58,549 - llm_api - DEBUG - Generated chunk: reasoning ...
2025-01-14 12:34:58,612 - llm_api - DEBUG - Generated chunk: might ...
2025-01-14 12:34:58,676 - llm_api - DEBUG - Generated chunk: be ...
2025-01-14 12:34:58,739 - llm_api - DEBUG - Generated chunk: required ...
2025-01-14 12:34:58,802 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:34:58,867 - llm_api - DEBUG - Generated chunk: (like ...
2025-01-14 12:34:58,930 - llm_api - DEBUG - Generated chunk: math ...
2025-01-14 12:34:58,994 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:34:59,057 - llm_api - DEBUG - Generated chunk: problems), ...
2025-01-14 12:34:59,120 - llm_api - DEBUG - Generated chunk: algorithms ...
2025-01-14 12:34:59,184 - llm_api - DEBUG - Generated chunk: enable ...
2025-01-14 12:34:59,248 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:34:59,312 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:34:59,376 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:34:59,439 - llm_api - DEBUG - Generated chunk: problem-solving ...
2025-01-14 12:34:59,503 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:34:59,567 - llm_api - DEBUG - Generated chunk: abilities ...
2025-01-14 12:34:59,631 - llm_api - DEBUG - Generated chunk: similar ...
2025-01-14 12:34:59,695 - llm_api - DEBUG - Generated chunk: those ...
2025-01-14 12:34:59,758 - llm_api - DEBUG - Generated chunk: found ...
2025-01-14 12:34:59,822 - llm_api - DEBUG - Generated chunk: commonly ...
2025-01-14 12:34:59,884 - llm_api - DEBUG - Generated chunk: seen ...
2025-01-14 12:34:59,948 - llm_api - DEBUG - Generated chunk: in ...
2025-01-14 12:35:00,011 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:35:00,075 - llm_api - DEBUG - Generated chunk: calculators ...
2025-01-14 12:35:00,139 - llm_api - DEBUG - Generated chunk: yet ...
2025-01-14 12:35:00,202 - llm_api - DEBUG - Generated chunk: without ...
2025-01-14 12:35:00,266 - llm_api - DEBUG - Generated chunk: any ...
2025-01-14 12:35:00,329 - llm_api - DEBUG - Generated chunk: direct ...
2025-01-14 12:35:00,393 - llm_api - DEBUG - Generated chunk: interaction ...
2025-01-14 12:35:00,458 - llm_api - DEBUG - Generated chunk: beyond ...
2025-01-14 12:35:00,523 - llm_api - DEBUG - Generated chunk: what ...
2025-01-14 12:35:00,590 - llm_api - DEBUG - Generated chunk: was ...
2025-01-14 12:35:00,656 - llm_api - DEBUG - Generated chunk: provided ...
2025-01-14 12:35:00,721 - llm_api - DEBUG - Generated chunk: initially ...
2025-01-14 12:35:00,786 - llm_api - DEBUG - Generated chunk: into ...
2025-01-14 12:35:00,850 - llm_api - DEBUG - Generated chunk: them ...
2025-01-14 12:35:00,916 - llm_api - DEBUG - Generated chunk: - ...
2025-01-14 12:35:00,980 - llm_api - DEBUG - Generated chunk: no ...
2025-01-14 12:35:01,045 - llm_api - DEBUG - Generated chunk: memory ...
2025-01-14 12:35:01,109 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:35:01,173 - llm_api - DEBUG - Generated chunk: retention ...
2025-01-14 12:35:01,239 - llm_api - DEBUG - Generated chunk: after ...
2025-01-14 12:35:01,305 - llm_api - DEBUG - Generated chunk: each ...
2025-01-14 12:35:01,372 - llm_api - DEBUG - Generated chunk: session ...
2025-01-14 12:35:01,438 - llm_api - DEBUG - Generated chunk: ends ...
2025-01-14 12:35:01,501 - llm_api - DEBUG - Generated chunk: due ...
2025-01-14 12:35:01,567 - llm_api - DEBUG - Generated chunk: to ...
2025-01-14 12:35:01,630 - llm_api - DEBUG - Generated chunk: design ...
2025-01-14 12:35:01,694 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:35:01,759 - llm_api - DEBUG - Generated chunk: considerations ...
2025-01-14 12:35:01,823 - llm_api - DEBUG - Generated chunk: around ...
2025-01-14 12:35:01,887 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:35:01,951 - llm_api - DEBUG - Generated chunk: privacy ...
2025-01-14 12:35:02,015 - llm_api - DEBUG - Generated chunk: protection ...
2025-01-14 12:35:02,079 - llm_api - DEBUG - Generated chunk: policies ...
2025-01-14 12:35:02,142 - llm_api - DEBUG - Generated chunk: followed ...
2025-01-14 12:35:02,207 - llm_api - DEBUG - Generated chunk: strictly ...
2025-01-14 12:35:02,271 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:35:02,334 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:35:02,399 - llm_api - DEBUG - Generated chunk: adhered ...
2025-01-14 12:35:02,462 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:35:02,527 - llm_api - DEBUG - Generated chunk: too.
...
2025-01-14 12:35:02,592 - llm_api - DEBUG - Generated chunk: 
...
2025-01-14 12:35:02,654 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:35:02,716 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:35:02,781 - llm_api - DEBUG - Generated chunk: 5. ...
2025-01-14 12:35:02,844 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:35:02,908 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:35:02,974 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:35:03,043 - llm_api - DEBUG - Generated chunk: **Learning ...
2025-01-14 12:35:03,108 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:35:03,173 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:35:03,239 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:35:03,303 - llm_api - DEBUG - Generated chunk: Capabilities**: ...
2025-01-14 12:35:03,369 - llm_api - DEBUG - Generated chunk: It ...
2025-01-14 12:35:03,433 - llm_api - DEBUG - Generated chunk: should ...
2025-01-14 12:35:03,498 - llm_api - DEBUG - Generated chunk: also ...
2025-01-14 12:35:03,562 - llm_api - DEBUG - Generated chunk: be ...
2025-01-14 12:35:03,626 - llm_api - DEBUG - Generated chunk: noted ...
2025-01-14 12:35:03,690 - llm_api - DEBUG - Generated chunk: though ...
2025-01-14 12:35:03,755 - llm_api - DEBUG - Generated chunk: there ...
2025-01-14 12:35:03,819 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:35:03,884 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:35:03,949 - llm_api - DEBUG - Generated chunk: isn't ...
2025-01-14 12:35:04,013 - llm_api - DEBUG - Generated chunk: learning ...
2025-01-14 12:35:04,078 - llm_api - DEBUG - Generated chunk: happening ...
2025-01-14 12:35:04,142 - llm_api - DEBUG - Generated chunk: per ...
2025-01-14 12:35:04,206 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:35:04,270 - llm_api - DEBUG - Generated chunk: se; ...
2025-01-14 12:35:04,334 - llm_api - DEBUG - Generated chunk: continuous ...
2025-01-14 12:35:04,399 - llm_api - DEBUG - Generated chunk: improvements ...
2025-01-14 12:35:04,463 - llm_api - DEBUG - Generated chunk: occur ...
2025-01-14 12:35:04,528 - llm_api - DEBUG - Generated chunk: through ...
2025-01-14 12:35:04,593 - llm_api - DEBUG - Generated chunk: updates ...
2025-01-14 12:35:04,659 - llm_api - DEBUG - Generated chunk: made ...
2025-01-14 12:35:04,724 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:35:04,790 - llm_api - DEBUG - Generated chunk: periodically ...
2025-01-14 12:35:04,855 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:35:04,923 - llm_api - DEBUG - Generated chunk: reflective ...
2025-01-14 12:35:04,993 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:35:05,061 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:35:05,129 - llm_api - DEBUG - Generated chunk: advancements ...
2025-01-14 12:35:05,197 - llm_api - DEBUG - Generated chunk: achieved ...
2025-01-14 12:35:05,265 - llm_api - DEBUG - Generated chunk: over ...
2025-01-14 12:35:05,333 - llm_api - DEBUG - Generated chunk: time ...
2025-01-14 12:35:05,400 - llm_api - DEBUG - Generated chunk: via ...
2025-01-14 12:35:05,467 - llm_api - DEBUG - Generated chunk: machine ...
2025-01-14 12:35:05,535 - llm_api - DEBUG - Generated chunk: learning ...
2025-01-14 12:35:05,603 - llm_api - DEBUG - Generated chunk: techniques ...
2025-01-14 12:35:05,672 - llm_api - DEBUG - Generated chunk: applied ...
2025-01-14 12:35:05,742 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:35:05,812 - llm_api - DEBUG - Generated chunk: systematically ...
2025-01-14 12:35:05,881 - llm_api - DEBUG - Generated chunk: throughout ...
2025-01-14 12:35:05,951 - llm_api - DEBUG - Generated chunk: development ...
2025-01-14 12:35:06,022 - llm_api - DEBUG - Generated chunk: phases ...
2025-01-14 12:35:06,091 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:35:06,162 - llm_api - DEBUG - Generated chunk: aimed ...
2025-01-14 12:35:06,231 - llm_api - DEBUG - Generated chunk: towards ...
2025-01-14 12:35:06,301 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:35:06,370 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:35:06,439 - llm_api - DEBUG - Generated chunk: enhancing ...
2025-01-14 12:35:06,505 - llm_api - DEBUG - Generated chunk: performance ...
2025-01-14 12:35:06,569 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:35:06,634 - llm_api - DEBUG - Generated chunk: consistently ...
2025-01-14 12:35:06,697 - llm_api - DEBUG - Generated chunk: while ...
2025-01-14 12:35:06,761 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:35:06,825 - llm_api - DEBUG - Generated chunk: maintaining ...
2025-01-14 12:35:06,888 - llm_api - DEBUG - Generated chunk: user ...
2025-01-14 12:35:06,952 - llm_api - DEBUG - Generated chunk: trust ...
2025-01-14 12:35:07,017 - llm_api - DEBUG - Generated chunk: simultaneously ...
2025-01-14 12:35:07,081 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:35:07,145 - llm_api - DEBUG - Generated chunk: ensuring ...
2025-01-14 12:35:07,210 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:35:07,273 - llm_api - DEBUG - Generated chunk: ethical ...
2025-01-14 12:35:07,339 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:35:07,406 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:35:07,472 - llm_api - DEBUG - Generated chunk: guidelines ...
2025-01-14 12:35:07,539 - llm_api - DEBUG - Generated chunk: remain ...
2025-01-14 12:35:07,606 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:35:07,673 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:35:07,740 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:35:07,806 - llm_api - DEBUG - Generated chunk: uncompromised ...
2025-01-14 12:35:07,871 - llm_api - DEBUG - Generated chunk: always ...
2025-01-14 12:35:07,938 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:35:08,004 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:35:08,070 - llm_api - DEBUG - Generated chunk: prioritized ...
2025-01-14 12:35:08,136 - llm_api - DEBUG - Generated chunk: above ...
2025-01-14 12:35:08,203 - llm_api - DEBUG - Generated chunk: all ...
2025-01-14 12:35:08,270 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:35:08,337 - llm_api - DEBUG - Generated chunk: else!
...
2025-01-14 12:35:08,404 - llm_api - DEBUG - Generated chunk: 
...
2025-01-14 12:35:08,470 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:35:08,535 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:35:08,602 - llm_api - DEBUG - Generated chunk: 6. ...
2025-01-14 12:35:08,667 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:35:08,731 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:35:08,796 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:35:08,860 - llm_api - DEBUG - Generated chunk: **Multilingual ...
2025-01-14 12:35:08,927 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:35:08,990 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:35:09,054 - llm_api - DEBUG - Generated chunk: Support**: ...
2025-01-14 12:35:09,119 - llm_api - DEBUG - Generated chunk: As ...
2025-01-14 12:35:09,184 - llm_api - DEBUG - Generated chunk: mentioned ...
2025-01-14 12:35:09,248 - llm_api - DEBUG - Generated chunk: earlier ...
2025-01-14 12:35:09,311 - llm_api - DEBUG - Generated chunk: regarding ...
2025-01-14 12:35:09,375 - llm_api - DEBUG - Generated chunk: Language ...
2025-01-14 12:35:09,439 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:35:09,503 - llm_api - DEBUG - Generated chunk: comprehension ...
2025-01-14 12:35:09,569 - llm_api - DEBUG - Generated chunk: skills ...
2025-01-14 12:35:09,633 - llm_api - DEBUG - Generated chunk: – ...
2025-01-14 12:35:09,698 - llm_api - DEBUG - Generated chunk: one ...
2025-01-14 12:35:09,762 - llm_api - DEBUG - Generated chunk: significant ...
2025-01-14 12:35:09,825 - llm_api - DEBUG - Generated chunk: advantage ...
2025-01-14 12:35:09,890 - llm_api - DEBUG - Generated chunk: here ...
2025-01-14 12:35:09,953 - llm_api - DEBUG - Generated chunk: lies ...
2025-01-14 12:35:10,019 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:35:10,084 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:35:10,149 - llm_api - DEBUG - Generated chunk: multilanguage ...
2025-01-14 12:35:10,213 - llm_api - DEBUG - Generated chunk: support ...
2025-01-14 12:35:10,278 - llm_api - DEBUG - Generated chunk: allowing ...
2025-01-14 12:35:10,342 - llm_api - DEBUG - Generated chunk: users ...
2025-01-14 12:35:10,408 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:35:10,472 - llm_api - DEBUG - Generated chunk: worldwide ...
2025-01-14 12:35:10,537 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:35:10,603 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:35:10,669 - llm_api - DEBUG - Generated chunk: irrespective ...
2025-01-14 12:35:10,735 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:35:10,801 - llm_api - DEBUG - Generated chunk: geographical ...
2025-01-14 12:35:10,866 - llm_api - DEBUG - Generated chunk: location ...
2025-01-14 12:35:10,931 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:35:10,996 - llm_api - DEBUG - Generated chunk: accessibility ...
2025-01-14 12:35:11,061 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:35:11,125 - llm_api - DEBUG - Generated chunk: facilitated ...
2025-01-14 12:35:11,190 - llm_api - DEBUG - Generated chunk: smooth ...
2025-01-14 12:35:11,255 - llm_api - DEBUG - Generated chunk: communication ...
2025-01-14 12:35:11,327 - llm_api - DEBUG - Generated chunk: experience ...
2025-01-14 12:35:11,393 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:35:11,460 - llm_api - DEBUG - Generated chunk: fostering ...
2025-01-14 12:35:11,527 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:35:11,593 - llm_api - DEBUG - Generated chunk: inclusivity ...
2025-01-14 12:35:11,699 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:35:11,794 - llm_api - DEBUG - Generated chunk: globally ...
2025-01-14 12:35:11,887 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:35:11,960 - llm_api - DEBUG - Generated chunk: promoting ...
2025-01-14 12:35:12,034 - llm_api - DEBUG - Generated chunk: cross ...
2025-01-14 12:35:12,113 - llm_api - DEBUG - Generated chunk: cultural ...
2025-01-14 12:35:12,184 - llm_api - DEBUG - Generated chunk: exchange ...
2025-01-14 12:35:12,252 - llm_api - DEBUG - Generated chunk: effectively ...
2025-01-14 12:35:12,331 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:35:12,401 - llm_api - DEBUG - Generated chunk: bridging ...
2025-01-14 12:35:12,467 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:35:12,532 - llm_api - DEBUG - Generated chunk: gaps ...
2025-01-14 12:35:12,598 - llm_api - DEBUG - Generated chunk: between ...
2025-01-14 12:35:12,662 - llm_api - DEBUG - Generated chunk: different ...
2025-01-14 12:35:12,726 - llm_api - DEBUG - Generated chunk: communities ...
2025-01-14 12:35:12,792 - llm_api - DEBUG - Generated chunk: everywhere ...
2025-01-14 12:35:12,857 - llm_api - DEBUG - Generated chunk: creating ...
2025-01-14 12:35:12,922 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:35:12,986 - llm_api - DEBUG - Generated chunk: opportunities ...
2025-01-14 12:35:13,053 - llm_api - DEBUG - Generated chunk: connecting ...
2025-01-14 12:35:13,120 - llm_api - DEBUG - Generated chunk: hearts ...
2025-01-14 12:35:13,186 - llm_api - DEBUG - Generated chunk: minds ...
2025-01-14 12:35:13,252 - llm_api - DEBUG - Generated chunk: together ...
2025-01-14 12:35:13,319 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:35:13,385 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:35:13,450 - llm_api - DEBUG - Generated chunk: harmoniously ...
2025-01-14 12:35:13,516 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:35:13,583 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:35:13,648 - llm_api - DEBUG - Generated chunk: transcending ...
2025-01-14 12:35:13,713 - llm_api - DEBUG - Generated chunk: boundaries ...
2025-01-14 12:35:13,779 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:35:13,844 - llm_api - DEBUG - Generated chunk: effortlessly ...
2025-01-14 12:35:13,909 - llm_api - DEBUG - Generated chunk: breaking ...
2025-01-14 12:35:13,975 - llm_api - DEBUG - Generated chunk: down ...
2025-01-14 12:35:14,042 - llm_api - DEBUG - Generated chunk: walls ...
2025-01-14 12:35:14,111 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:35:14,176 - llm_api - DEBUG - Generated chunk: silencing ...
2025-01-14 12:35:14,242 - llm_api - DEBUG - Generated chunk: voices ...
2025-01-14 12:35:14,307 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:35:14,372 - llm_api - DEBUG - Generated chunk: suppressions ...
2025-01-14 12:35:14,438 - llm_api - DEBUG - Generated chunk: fear ...
2025-01-14 12:35:14,503 - llm_api - DEBUG - Generated chunk: ...
2025-01-14 12:35:14,569 - llm_api - DEBUG - Generated chunk: dividing ...
2025-01-14 12:35:14,570 - llm_api - DEBUG - Generated chunk: us...
2025-01-14 12:35:14,570 - llm_api - INFO - INFO:     127.0.0.1:37118 - "POST /api/v1/generate/stream HTTP/1.1" 200 OK
2025-01-14 12:47:53,791 - api_routes - INFO - Received generation request for prompt: Tell me about yourself and your capabilities...
2025-01-14 12:47:53,791 - llm_api - DEBUG - Generating response for prompt: Tell me about yourself and your capabilities...
2025-01-14 12:48:27,656 - llm_api - DEBUG - Generated response: I'm Phi, an AI developed by Microsoft. While I don...
2025-01-14 12:48:27,656 - api_routes - INFO - Successfully generated response
2025-01-14 12:48:27,656 - llm_api - INFO - INFO:     127.0.0.1:43528 - "POST /api/v1/generate HTTP/1.1" 200 OK
2025-01-14 12:50:17,735 - api_routes - INFO - Received generation request for prompt: Please analyze this query and create a JSON respon...
2025-01-14 12:50:17,735 - llm_api - DEBUG - Generating response for prompt: Please analyze this query and create a JSON respon...
2025-01-14 12:50:31,906 - llm_api - DEBUG - Generated response: ```json
{
  "original_query": "Who is Djengis Khan...
2025-01-14 12:50:31,906 - api_routes - INFO - Successfully generated response
2025-01-14 12:50:31,906 - llm_api - INFO - INFO:     127.0.0.1:50042 - "POST /api/v1/generate HTTP/1.1" 200 OK
2025-01-14 13:08:38,951 - api_routes - INFO - Received request to download model: PowerInfer/SmallThinker-3B-Preview
2025-01-14 13:08:38,951 - llm_api - INFO - Starting download of model: PowerInfer/SmallThinker-3B-Preview
2025-01-14 13:08:38,951 - llm_api - INFO - Enabling stdout logging for download
2025-01-14 13:11:52,350 - llm_api - INFO - Disabling stdout logging
2025-01-14 13:11:52,350 - llm_api - INFO - Saving model to main/models/SmallThinker-3B-Preview
2025-01-14 13:13:04,420 - llm_api - INFO - Successfully downloaded model: PowerInfer/SmallThinker-3B-Preview
2025-01-14 13:13:05,175 - api_routes - INFO - Successfully downloaded model: PowerInfer/SmallThinker-3B-Preview
2025-01-14 13:13:31,469 - api_routes - INFO - Received request to initialize model: PowerInfer/SmallThinker-3B-Preview
2025-01-14 13:13:31,469 - llm_api - INFO - Initializing generation model: PowerInfer/SmallThinker-3B-Preview
2025-01-14 13:13:31,472 - llm_api - INFO - Loading model from local path: main/models/SmallThinker-3B-Preview
2025-01-14 13:13:31,909 - llm_api - ERROR - Failed to initialize generation model PowerInfer/SmallThinker-3B-Preview: Some modules are dispatched on the CPU or the disk. Make sure you have enough GPU RAM to fit the quantized model. If you want to dispatch the model on the CPU or the disk while keeping these modules in 32-bit, you need to set `llm_int8_enable_fp32_cpu_offload=True` and pass a custom `device_map` to `from_pretrained`. Check https://huggingface.co/docs/transformers/main/en/main_classes/quantization#offload-between-cpu-and-gpu for more details. 
2025-01-14 13:13:31,909 - api_routes - ERROR - Error initializing model: Some modules are dispatched on the CPU or the disk. Make sure you have enough GPU RAM to fit the quantized model. If you want to dispatch the model on the CPU or the disk while keeping these modules in 32-bit, you need to set `llm_int8_enable_fp32_cpu_offload=True` and pass a custom `device_map` to `from_pretrained`. Check https://huggingface.co/docs/transformers/main/en/main_classes/quantization#offload-between-cpu-and-gpu for more details. 
2025-01-14 13:14:36,924 - main - INFO - LLM API server started on 0.0.0.0:8001
2025-01-14 13:14:49,486 - hf_validation - WARNING - No .env file found. Fine if you're on Huggingface, but you need one to run locally on your PC.
2025-01-14 13:14:49,486 - hf_validation - ERROR - No HF_TOKEN found in environment variables
2025-01-14 13:14:49,486 - main - INFO - Starting LLM API server
2025-01-14 13:14:49,486 - llm_api - INFO - Initializing LLM API
2025-01-14 13:14:49,486 - llm_api - INFO - LLM API initialized successfully
2025-01-14 13:14:49,486 - api_routes - INFO - Router initialized with LLM API instance
2025-01-14 13:14:49,490 - main - INFO - FastAPI application created successfully
2025-01-14 13:14:56,382 - api_routes - INFO - Received request to initialize model: PowerInfer/SmallThinker-3B-Preview
2025-01-14 13:14:56,383 - llm_api - INFO - Initializing generation model: PowerInfer/SmallThinker-3B-Preview
2025-01-14 13:14:56,383 - llm_api - INFO - Loading model from local path: main/models/SmallThinker-3B-Preview
2025-01-14 13:15:07,065 - llm_api - INFO - Successfully initialized generation model: PowerInfer/SmallThinker-3B-Preview
2025-01-14 13:15:07,065 - api_routes - INFO - Successfully initialized model: PowerInfer/SmallThinker-3B-Preview
2025-01-14 13:15:07,065 - llm_api - INFO - INFO:     127.0.0.1:40472 - "POST /api/v1/model/initialize?model_name=PowerInfer%2FSmallThinker-3B-Preview HTTP/1.1" 200 OK
2025-01-14 13:16:09,874 - api_routes - INFO - Received generation request for prompt: Tell me about yourself and your capabilities...
2025-01-14 13:16:09,874 - llm_api - DEBUG - Generating response for prompt: Tell me about yourself and your capabilities...
2025-01-14 13:17:03,595 - llm_api - DEBUG - Generated response: I'm an AI developed by Alibaba, designed to assist...
2025-01-14 13:17:03,595 - api_routes - INFO - Successfully generated response
2025-01-14 13:17:03,595 - llm_api - INFO - INFO:     127.0.0.1:44786 - "POST /api/v1/generate HTTP/1.1" 200 OK
2025-01-14 13:18:04,891 - main - INFO - LLM API server started on 0.0.0.0:8001