130 Commits

Author SHA1 Message Date
yangdx
6977db3dd1 Remove the single quotation marks that enclose the names of the entities 2025-04-23 21:30:07 +08:00
yangdx
21c0bb7abf Merge branch 'context_format_csv_to_json' 2025-04-22 12:25:50 +08:00
yangdx
e7063b5f1e Remove embedding_cache_config 2025-04-22 00:28:17 +08:00
yangdx
85684164f0 Fix linting 2025-04-21 20:18:05 +08:00
yangdx
17f5439952 Remove space between chinese chars and Egnlish symbols 2025-04-21 19:21:30 +08:00
孟超
8064a2339f change process_combine_contexts params type to list[dict[str, str]] 2025-04-21 12:08:12 +08:00
mengchao
510a6adfbc Fix linting 2025-04-20 19:28:25 +08:00
mengchao
f2f3a2721d Refactor context handling to convert data from CSV to JSON format for improved compatibility with LLM, replacing the list_of_list_to_csv function with list_of_list_to_json 2025-04-20 19:24:05 +08:00
孟超
6d486f5813 json dumps without ascii 2025-04-19 15:28:07 +08:00
孟超
a20d68d865 Revise the context format of chunks from CSV to JSON to enhance compatibility with LLM 2025-04-19 15:18:33 +08:00
drahnreb
9c6b5aefcb fix linting 2025-04-18 16:24:43 +02:00
drahnreb
0f949dd5d7 fix truncation with global_config tokenizer 2025-04-18 16:24:43 +02:00
drahnreb
20ba1eb9c2 add: to optionally replace default tiktoken Tokenizer with a custom one 2025-04-18 16:24:43 +02:00
yangdx
bffb9dbdb0 Fix linting 2025-04-17 23:00:34 +08:00
yangdx
a3ca134e97 Fix special chars problem for Postgres 2025-04-17 22:58:36 +08:00
yangdx
2b387fd9e5 Fix cache persistence bugs 2025-04-16 01:27:02 +08:00
yangdx
2e95947c40 Fix: disable LLM cache recording while enable_llm_cache is disabled 2025-04-15 21:01:44 +08:00
yangdx
5c1d4201f9 Fix linting 2025-04-14 12:08:56 +08:00
yangdx
89d1e68d97 Move graph edit function implemention to a utils_graph.py to educe the size of lightray.py 2025-04-14 03:06:23 +08:00
yangdx
6174554c58 Fix linting 2025-04-12 20:50:21 +08:00
yangdx
2ac66c3531 Remove chinese quotes in entity name 2025-04-12 20:45:41 +08:00
yangdx
0eed5eb718 feat: implement entity/relation name and description normalization
- Remove spaces between Chinese characters
- Remove spaces between Chinese and English/numbers
- Preserve spaces within English text and numbers
- Replace Chinese parentheses with English parentheses
- Replace Chinese dash with English dash
2025-04-12 19:26:02 +08:00
yangdx
3007dff153 Add env FORCE_LLM_SUMMARY_ON_MERGE 2025-04-10 17:29:07 +08:00
yangdx
496f87a1e6 Fix linting 2025-04-10 03:58:04 +08:00
yangdx
8d858da4d0 Fix LLM cache now work for nodes and edges merging 2025-04-10 03:57:36 +08:00
IcySugar000
8aa3cd799a Fix: Fixed null value handling and ensure exceptions are avoided 2025-04-09 11:32:05 +08:00
choizhang
164faf94e2 feat(TokenTracker): Add context manager support to simplify token tracking 2025-03-30 00:59:23 +08:00
yangdx
c590d5878c refactor: standardize .env loading behavior across modules
- Use .env from current folder for each lightrag instance
- Allow different .env files for different instances
- Make OS env vars take precedence over .env file
2025-03-29 03:37:23 +08:00
yangdx
feacae1ce4 Show more info in verbose_debug 2025-03-28 21:39:04 +08:00
choizhang
8488229a29 feat: Add TokenTracker to track token usage for LLM calls 2025-03-28 01:25:15 +08:00
yangdx
dfa63e863c Fix linting 2025-03-26 23:53:41 +08:00
yangdx
ebe7620b5f Add pipeline_status endpoint to log filter 2025-03-26 23:24:26 +08:00
yangdx
4854ff83b3 Increase conten summary from 100 to 250 CHARS 2025-03-25 23:39:09 +08:00
Pankaj Kaushal
6972b3e1cc Refactor logger setup to conditionally enable file logging.
Added error handling for file creation issues.
2025-03-18 12:08:42 +01:00
yangdx
3400d3302a Added "/documents" to filtered paths 2025-03-13 17:45:56 +08:00
yangdx
82c2cae324 Unify two log filters into one and move it to utils 2025-03-13 17:43:11 +08:00
zrguo
418aea3895 fix linting 2025-03-11 15:44:01 +08:00
zrguo
62b304600b clean lightrag.py 2025-03-11 15:43:04 +08:00
yangdx
4065a7df92 Fix linting 2025-03-10 02:07:19 +08:00
yangdx
6b0acce644 Avoid redundant llm cache updates 2025-03-10 01:45:58 +08:00
yangdx
bc42afe7b6 Unify llm_response_cache and hashing_kv, prevent creating an independent hashing_kv. 2025-03-09 22:15:26 +08:00
yangdx
3cf4268e7a Change logging level from INFO to DEBUG for cache hit/miss messages 2025-03-09 00:59:40 +08:00
yangdx
462c27c167 Refactor logging setup and simplify Gunicorn configuration
• Move logging setup code to utils.py
• Provide setup_logger for standalone LightRAG logger intialization
2025-03-03 23:18:41 +08:00
yangdx
731d820bcc Remove redundancy set_logger function and related calls 2025-02-28 21:46:45 +08:00
yangdx
c973498c34 Fix linting 2025-02-28 21:35:04 +08:00
yangdx
157ec862ae Enhance logging system with file rotation and unified configuration
• Unify logging across Gunicorn and Uvicorn
• Add rotating file handlers
2025-02-28 14:57:25 +08:00
yangdx
7436c06f6c Fix linting 2025-02-26 18:11:16 +08:00
yangdx
15a6a9cf7c fix: log filtering void when uvicorn wokers is greater than 1
- Centralize logging setup
- Fix logger propagation issues
2025-02-26 12:23:35 +08:00
yangdx
e935fed50e Add automatic comment handling in .env files 2025-02-22 13:25:12 +08:00
yangdx
c95656ca87 feat: improve debug message handling with better truncation and formatting 2025-02-21 16:28:08 +08:00