choizhang
164faf94e2
feat(TokenTracker): Add context manager support to simplify token tracking
2025-03-30 00:59:23 +08:00
yangdx
c590d5878c
refactor: standardize .env loading behavior across modules
...
- Use .env from current folder for each lightrag instance
- Allow different .env files for different instances
- Make OS env vars take precedence over .env file
2025-03-29 03:37:23 +08:00
yangdx
feacae1ce4
Show more info in verbose_debug
2025-03-28 21:39:04 +08:00
choizhang
8488229a29
feat: Add TokenTracker to track token usage for LLM calls
2025-03-28 01:25:15 +08:00
yangdx
dfa63e863c
Fix linting
2025-03-26 23:53:41 +08:00
yangdx
ebe7620b5f
Add pipeline_status endpoint to log filter
2025-03-26 23:24:26 +08:00
yangdx
4854ff83b3
Increase conten summary from 100 to 250 CHARS
2025-03-25 23:39:09 +08:00
Pankaj Kaushal
6972b3e1cc
Refactor logger setup to conditionally enable file logging.
...
Added error handling for file creation issues.
2025-03-18 12:08:42 +01:00
yangdx
3400d3302a
Added "/documents" to filtered paths
2025-03-13 17:45:56 +08:00
yangdx
82c2cae324
Unify two log filters into one and move it to utils
2025-03-13 17:43:11 +08:00
zrguo
418aea3895
fix linting
2025-03-11 15:44:01 +08:00
zrguo
62b304600b
clean lightrag.py
2025-03-11 15:43:04 +08:00
yangdx
4065a7df92
Fix linting
2025-03-10 02:07:19 +08:00
yangdx
6b0acce644
Avoid redundant llm cache updates
2025-03-10 01:45:58 +08:00
yangdx
bc42afe7b6
Unify llm_response_cache and hashing_kv, prevent creating an independent hashing_kv.
2025-03-09 22:15:26 +08:00
yangdx
3cf4268e7a
Change logging level from INFO to DEBUG for cache hit/miss messages
2025-03-09 00:59:40 +08:00
yangdx
462c27c167
Refactor logging setup and simplify Gunicorn configuration
...
• Move logging setup code to utils.py
• Provide setup_logger for standalone LightRAG logger intialization
2025-03-03 23:18:41 +08:00
yangdx
731d820bcc
Remove redundancy set_logger function and related calls
2025-02-28 21:46:45 +08:00
yangdx
c973498c34
Fix linting
2025-02-28 21:35:04 +08:00
yangdx
157ec862ae
Enhance logging system with file rotation and unified configuration
...
• Unify logging across Gunicorn and Uvicorn
• Add rotating file handlers
2025-02-28 14:57:25 +08:00
yangdx
7436c06f6c
Fix linting
2025-02-26 18:11:16 +08:00
yangdx
15a6a9cf7c
fix: log filtering void when uvicorn wokers is greater than 1
...
- Centralize logging setup
- Fix logger propagation issues
2025-02-26 12:23:35 +08:00
yangdx
e935fed50e
Add automatic comment handling in .env files
2025-02-22 13:25:12 +08:00
yangdx
c95656ca87
feat: improve debug message handling with better truncation and formatting
2025-02-21 16:28:08 +08:00
yangdx
8164c57b7e
Fix linting
2025-02-21 14:59:50 +08:00
yangdx
cff229a806
fix: respect user-specified log level in set_logger
...
Previously, the set_logger function would always set the log level to DEBUG, overriding any user-specified log level.
2025-02-21 14:46:27 +08:00
Yannick Stephan
c7bc2c63cf
cleanup storages
2025-02-20 13:21:41 +01:00
Yannick Stephan
32e489865c
cleanup code
2025-02-20 13:18:17 +01:00
Yannick Stephan
2524e02428
remove tqdm and cleaned readme and ollama
2025-02-18 19:58:03 +01:00
Yannick Stephan
24ae083284
removed never used method
2025-02-18 19:38:04 +01:00
Yannick Stephan
161baa6f08
pm bs4 when ollama
2025-02-18 17:11:17 +01:00
zrguo
fce24f7611
Merge pull request #797 from danielaskdd/add-env-settings
...
Add the token size truncation for local query and token size setting by env
2025-02-17 15:00:07 +08:00
ArnoChen
6da53a302a
add api tab in webui and handle invalid num_turns
2025-02-17 12:32:04 +08:00
yangdx
9963fb7ff4
Make VERBOSE_DEBUG configurable via environment variable
...
- Adds environment variable support
- Defaults to "false" if not set
- Case-insensitive check for "true"
- Simplifies debugging configuration
- Maintains backward compatibility
2025-02-17 11:37:38 +08:00
yangdx
806eadf5dc
Add verbose debug option to control detailed debug output level
...
• Added VERBOSE env var & CLI flag
• Implemented verbose_debug() function
• Added verbose option to splash screen
• Reduced default debug output length
• Modified LLM debug logging behavior
2025-02-17 01:38:18 +08:00
Yannick Stephan
3319db0dba
cleaned code
2025-02-15 22:37:32 +01:00
Yannick Stephan
eaf1d553d2
improved typing
2025-02-15 22:37:12 +01:00
Yannick Stephan
621540a54e
cleaned code
2025-02-15 00:23:14 +01:00
Yannick Stephan
66f555677a
cleaning the message and project no needed
2025-02-14 23:31:27 +01:00
yangdx
cdd52809b0
Fix linting
2025-02-13 14:07:36 +08:00
yangdx
e5adb2e0f3
Improve cache logging and add more detailed log messages
...
• Add cache type to log data structure
• Make debug logs more detailed
• Add high-level info logs for cache hits
• Add null check for best_response
• Improve log message readability
2025-02-13 13:53:52 +08:00
Yannick Stephan
1f8fc44591
cleaned type
2025-02-09 11:46:01 +01:00
ultrageopro
19ee3d109c
feat: trimming the model’s reasoning
2025-02-06 22:56:17 +03:00
yangdx
0a693dbfda
Fix linting
2025-02-02 04:27:55 +08:00
yangdx
8484564f50
Fix llm_model_func retrieval error.
2025-02-02 03:54:41 +08:00
yangdx
873b52d2e4
Add debug logging for cache response retrieval
2025-02-02 03:15:43 +08:00
yangdx
bed5a97ae2
Fix prompt respond cache fail when is_embedding_cache_enabled is true
2025-02-02 03:09:06 +08:00
yangdx
5d14ab03eb
Fix linting
2025-02-02 01:56:32 +08:00
yangdx
b45ae1567c
Refactor LLM cache handling and entity extraction
...
- Removed custom LLM function in entity extraction
- Simplified cache handling logic
- Added `force_llm_cache` parameter
- Updated cache handling conditions
2025-02-02 01:28:46 +08:00
yangdx
6c7d7c25d3
Refactor cache handling logic for better readability, keep function unchanged.
2025-02-02 00:10:21 +08:00