104 Commits

Author SHA1 Message Date
choizhang
164faf94e2 feat(TokenTracker): Add context manager support to simplify token tracking 2025-03-30 00:59:23 +08:00
yangdx
c590d5878c refactor: standardize .env loading behavior across modules
- Use .env from current folder for each lightrag instance
- Allow different .env files for different instances
- Make OS env vars take precedence over .env file
2025-03-29 03:37:23 +08:00
yangdx
feacae1ce4 Show more info in verbose_debug 2025-03-28 21:39:04 +08:00
choizhang
8488229a29 feat: Add TokenTracker to track token usage for LLM calls 2025-03-28 01:25:15 +08:00
yangdx
dfa63e863c Fix linting 2025-03-26 23:53:41 +08:00
yangdx
ebe7620b5f Add pipeline_status endpoint to log filter 2025-03-26 23:24:26 +08:00
yangdx
4854ff83b3 Increase conten summary from 100 to 250 CHARS 2025-03-25 23:39:09 +08:00
Pankaj Kaushal
6972b3e1cc Refactor logger setup to conditionally enable file logging.
Added error handling for file creation issues.
2025-03-18 12:08:42 +01:00
yangdx
3400d3302a Added "/documents" to filtered paths 2025-03-13 17:45:56 +08:00
yangdx
82c2cae324 Unify two log filters into one and move it to utils 2025-03-13 17:43:11 +08:00
zrguo
418aea3895 fix linting 2025-03-11 15:44:01 +08:00
zrguo
62b304600b clean lightrag.py 2025-03-11 15:43:04 +08:00
yangdx
4065a7df92 Fix linting 2025-03-10 02:07:19 +08:00
yangdx
6b0acce644 Avoid redundant llm cache updates 2025-03-10 01:45:58 +08:00
yangdx
bc42afe7b6 Unify llm_response_cache and hashing_kv, prevent creating an independent hashing_kv. 2025-03-09 22:15:26 +08:00
yangdx
3cf4268e7a Change logging level from INFO to DEBUG for cache hit/miss messages 2025-03-09 00:59:40 +08:00
yangdx
462c27c167 Refactor logging setup and simplify Gunicorn configuration
• Move logging setup code to utils.py
• Provide setup_logger for standalone LightRAG logger intialization
2025-03-03 23:18:41 +08:00
yangdx
731d820bcc Remove redundancy set_logger function and related calls 2025-02-28 21:46:45 +08:00
yangdx
c973498c34 Fix linting 2025-02-28 21:35:04 +08:00
yangdx
157ec862ae Enhance logging system with file rotation and unified configuration
• Unify logging across Gunicorn and Uvicorn
• Add rotating file handlers
2025-02-28 14:57:25 +08:00
yangdx
7436c06f6c Fix linting 2025-02-26 18:11:16 +08:00
yangdx
15a6a9cf7c fix: log filtering void when uvicorn wokers is greater than 1
- Centralize logging setup
- Fix logger propagation issues
2025-02-26 12:23:35 +08:00
yangdx
e935fed50e Add automatic comment handling in .env files 2025-02-22 13:25:12 +08:00
yangdx
c95656ca87 feat: improve debug message handling with better truncation and formatting 2025-02-21 16:28:08 +08:00
yangdx
8164c57b7e Fix linting 2025-02-21 14:59:50 +08:00
yangdx
cff229a806 fix: respect user-specified log level in set_logger
Previously, the set_logger function would always set the log level to DEBUG, overriding any user-specified log level.
2025-02-21 14:46:27 +08:00
Yannick Stephan
c7bc2c63cf cleanup storages 2025-02-20 13:21:41 +01:00
Yannick Stephan
32e489865c cleanup code 2025-02-20 13:18:17 +01:00
Yannick Stephan
2524e02428 remove tqdm and cleaned readme and ollama 2025-02-18 19:58:03 +01:00
Yannick Stephan
24ae083284 removed never used method 2025-02-18 19:38:04 +01:00
Yannick Stephan
161baa6f08 pm bs4 when ollama 2025-02-18 17:11:17 +01:00
zrguo
fce24f7611
Merge pull request #797 from danielaskdd/add-env-settings
Add the token size truncation for local query and token size setting by env
2025-02-17 15:00:07 +08:00
ArnoChen
6da53a302a add api tab in webui and handle invalid num_turns 2025-02-17 12:32:04 +08:00
yangdx
9963fb7ff4 Make VERBOSE_DEBUG configurable via environment variable
- Adds environment variable support
- Defaults to "false" if not set
- Case-insensitive check for "true"
- Simplifies debugging configuration
- Maintains backward compatibility
2025-02-17 11:37:38 +08:00
yangdx
806eadf5dc Add verbose debug option to control detailed debug output level
• Added VERBOSE env var & CLI flag
• Implemented verbose_debug() function
• Added verbose option to splash screen
• Reduced default debug output length
• Modified LLM debug logging behavior
2025-02-17 01:38:18 +08:00
Yannick Stephan
3319db0dba cleaned code 2025-02-15 22:37:32 +01:00
Yannick Stephan
eaf1d553d2 improved typing 2025-02-15 22:37:12 +01:00
Yannick Stephan
621540a54e cleaned code 2025-02-15 00:23:14 +01:00
Yannick Stephan
66f555677a cleaning the message and project no needed 2025-02-14 23:31:27 +01:00
yangdx
cdd52809b0 Fix linting 2025-02-13 14:07:36 +08:00
yangdx
e5adb2e0f3 Improve cache logging and add more detailed log messages
• Add cache type to log data structure
• Make debug logs more detailed
• Add high-level info logs for cache hits
• Add null check for best_response
• Improve log message readability
2025-02-13 13:53:52 +08:00
Yannick Stephan
1f8fc44591 cleaned type 2025-02-09 11:46:01 +01:00
ultrageopro
19ee3d109c
feat: trimming the model’s reasoning 2025-02-06 22:56:17 +03:00
yangdx
0a693dbfda Fix linting 2025-02-02 04:27:55 +08:00
yangdx
8484564f50 Fix llm_model_func retrieval error. 2025-02-02 03:54:41 +08:00
yangdx
873b52d2e4 Add debug logging for cache response retrieval 2025-02-02 03:15:43 +08:00
yangdx
bed5a97ae2 Fix prompt respond cache fail when is_embedding_cache_enabled is true 2025-02-02 03:09:06 +08:00
yangdx
5d14ab03eb Fix linting 2025-02-02 01:56:32 +08:00
yangdx
b45ae1567c Refactor LLM cache handling and entity extraction
- Removed custom LLM function in entity extraction
- Simplified cache handling logic
- Added `force_llm_cache` parameter
- Updated cache handling conditions
2025-02-02 01:28:46 +08:00
yangdx
6c7d7c25d3 Refactor cache handling logic for better readability, keep function unchanged. 2025-02-02 00:10:21 +08:00