yangdx
6977db3dd1
Remove the single quotation marks that enclose the names of the entities
2025-04-23 21:30:07 +08:00
yangdx
21c0bb7abf
Merge branch 'context_format_csv_to_json'
2025-04-22 12:25:50 +08:00
yangdx
e7063b5f1e
Remove embedding_cache_config
2025-04-22 00:28:17 +08:00
yangdx
85684164f0
Fix linting
2025-04-21 20:18:05 +08:00
yangdx
17f5439952
Remove space between chinese chars and Egnlish symbols
2025-04-21 19:21:30 +08:00
孟超
8064a2339f
change process_combine_contexts params type to list[dict[str, str]]
2025-04-21 12:08:12 +08:00
mengchao
510a6adfbc
Fix linting
2025-04-20 19:28:25 +08:00
mengchao
f2f3a2721d
Refactor context handling to convert data from CSV to JSON format for improved compatibility with LLM, replacing the list_of_list_to_csv function with list_of_list_to_json
2025-04-20 19:24:05 +08:00
孟超
6d486f5813
json dumps without ascii
2025-04-19 15:28:07 +08:00
孟超
a20d68d865
Revise the context format of chunks from CSV to JSON to enhance compatibility with LLM
2025-04-19 15:18:33 +08:00
drahnreb
9c6b5aefcb
fix linting
2025-04-18 16:24:43 +02:00
drahnreb
0f949dd5d7
fix truncation with global_config tokenizer
2025-04-18 16:24:43 +02:00
drahnreb
20ba1eb9c2
add: to optionally replace default tiktoken Tokenizer with a custom one
2025-04-18 16:24:43 +02:00
yangdx
bffb9dbdb0
Fix linting
2025-04-17 23:00:34 +08:00
yangdx
a3ca134e97
Fix special chars problem for Postgres
2025-04-17 22:58:36 +08:00
yangdx
2b387fd9e5
Fix cache persistence bugs
2025-04-16 01:27:02 +08:00
yangdx
2e95947c40
Fix: disable LLM cache recording while enable_llm_cache is disabled
2025-04-15 21:01:44 +08:00
yangdx
5c1d4201f9
Fix linting
2025-04-14 12:08:56 +08:00
yangdx
89d1e68d97
Move graph edit function implemention to a utils_graph.py to educe the size of lightray.py
2025-04-14 03:06:23 +08:00
yangdx
6174554c58
Fix linting
2025-04-12 20:50:21 +08:00
yangdx
2ac66c3531
Remove chinese quotes in entity name
2025-04-12 20:45:41 +08:00
yangdx
0eed5eb718
feat: implement entity/relation name and description normalization
...
- Remove spaces between Chinese characters
- Remove spaces between Chinese and English/numbers
- Preserve spaces within English text and numbers
- Replace Chinese parentheses with English parentheses
- Replace Chinese dash with English dash
2025-04-12 19:26:02 +08:00
yangdx
3007dff153
Add env FORCE_LLM_SUMMARY_ON_MERGE
2025-04-10 17:29:07 +08:00
yangdx
496f87a1e6
Fix linting
2025-04-10 03:58:04 +08:00
yangdx
8d858da4d0
Fix LLM cache now work for nodes and edges merging
2025-04-10 03:57:36 +08:00
IcySugar000
8aa3cd799a
Fix: Fixed null value handling and ensure exceptions are avoided
2025-04-09 11:32:05 +08:00
choizhang
164faf94e2
feat(TokenTracker): Add context manager support to simplify token tracking
2025-03-30 00:59:23 +08:00
yangdx
c590d5878c
refactor: standardize .env loading behavior across modules
...
- Use .env from current folder for each lightrag instance
- Allow different .env files for different instances
- Make OS env vars take precedence over .env file
2025-03-29 03:37:23 +08:00
yangdx
feacae1ce4
Show more info in verbose_debug
2025-03-28 21:39:04 +08:00
choizhang
8488229a29
feat: Add TokenTracker to track token usage for LLM calls
2025-03-28 01:25:15 +08:00
yangdx
dfa63e863c
Fix linting
2025-03-26 23:53:41 +08:00
yangdx
ebe7620b5f
Add pipeline_status endpoint to log filter
2025-03-26 23:24:26 +08:00
yangdx
4854ff83b3
Increase conten summary from 100 to 250 CHARS
2025-03-25 23:39:09 +08:00
Pankaj Kaushal
6972b3e1cc
Refactor logger setup to conditionally enable file logging.
...
Added error handling for file creation issues.
2025-03-18 12:08:42 +01:00
yangdx
3400d3302a
Added "/documents" to filtered paths
2025-03-13 17:45:56 +08:00
yangdx
82c2cae324
Unify two log filters into one and move it to utils
2025-03-13 17:43:11 +08:00
zrguo
418aea3895
fix linting
2025-03-11 15:44:01 +08:00
zrguo
62b304600b
clean lightrag.py
2025-03-11 15:43:04 +08:00
yangdx
4065a7df92
Fix linting
2025-03-10 02:07:19 +08:00
yangdx
6b0acce644
Avoid redundant llm cache updates
2025-03-10 01:45:58 +08:00
yangdx
bc42afe7b6
Unify llm_response_cache and hashing_kv, prevent creating an independent hashing_kv.
2025-03-09 22:15:26 +08:00
yangdx
3cf4268e7a
Change logging level from INFO to DEBUG for cache hit/miss messages
2025-03-09 00:59:40 +08:00
yangdx
462c27c167
Refactor logging setup and simplify Gunicorn configuration
...
• Move logging setup code to utils.py
• Provide setup_logger for standalone LightRAG logger intialization
2025-03-03 23:18:41 +08:00
yangdx
731d820bcc
Remove redundancy set_logger function and related calls
2025-02-28 21:46:45 +08:00
yangdx
c973498c34
Fix linting
2025-02-28 21:35:04 +08:00
yangdx
157ec862ae
Enhance logging system with file rotation and unified configuration
...
• Unify logging across Gunicorn and Uvicorn
• Add rotating file handlers
2025-02-28 14:57:25 +08:00
yangdx
7436c06f6c
Fix linting
2025-02-26 18:11:16 +08:00
yangdx
15a6a9cf7c
fix: log filtering void when uvicorn wokers is greater than 1
...
- Centralize logging setup
- Fix logger propagation issues
2025-02-26 12:23:35 +08:00
yangdx
e935fed50e
Add automatic comment handling in .env files
2025-02-22 13:25:12 +08:00
yangdx
c95656ca87
feat: improve debug message handling with better truncation and formatting
2025-02-21 16:28:08 +08:00