415 Commits

Author SHA1 Message Date
yangdx
bbff3ed0ab Fix linting 2025-03-10 17:30:40 +08:00
yangdx
3cca18c59c Refactor pipeline status updates and entity extraction.
- Let all parrallel jobs using one pipe_status objects
- Improved thread safety with pipeline_status_lock
- Only pipeline jobs can add message to pipe_status
- Marked insert_custom_chunks as deprecated
2025-03-10 16:48:59 +08:00
yangdx
adca27fae9 Merge branch 'main' into neo4j-add-min-degree 2025-03-10 02:13:49 +08:00
yangdx
4065a7df92 Fix linting 2025-03-10 02:07:19 +08:00
yangdx
bc42afe7b6 Unify llm_response_cache and hashing_kv, prevent creating an independent hashing_kv. 2025-03-09 22:15:26 +08:00
zrguo
e822f35c89 Fix edit entity and relation bugs 2025-03-07 14:39:06 +08:00
yangdx
7e088ca528 Refactor code and update environment type definitions.
- Consolidate type definitions in vite-env.d.ts
- Update TypeScript include paths
2025-03-07 08:17:25 +08:00
yangdx
5942d148f0 Set default max_depth to 3 for knowledge graph retrieval 2025-03-07 07:34:29 +08:00
yangdx
5b29e760f0 Add dynamic parameter handling for storage 2025-03-06 14:29:48 +08:00
yangdx
252d1f57e0 Merge branch 'main' into add-graph-search-mode 2025-03-06 10:23:38 +08:00
zrguo
ec0450f712 Add merge entities 2025-03-06 00:53:23 +08:00
zrguo
20f2e57260
Merge pull request #1006 from HKUDS/dev
[Bug]Fix the issue where editing entity names does not properly update the corresponding relationship in the vdb.
2025-03-05 17:00:43 +08:00
zrguo
917dc39334 fix linting 2025-03-05 17:00:01 +08:00
zrguo
649164c3e6 Update lightrag.py 2025-03-05 16:55:09 +08:00
zrguo
ea8fe3d7a0
Merge pull request #1002 from danielaskdd/improve-async-task-error-handling
Improved task handling and error management in LightRAG
2025-03-05 15:05:36 +08:00
yangdx
1fddc8552e Added minimum degree filter for graph queries
- Introduced min_degree parameter in graph query
- Updated UI to include minimum degree setting
- Modified API to handle min_degree parameter
- Updated graph query logic in LightRAG
2025-03-05 11:37:55 +08:00
yangdx
d52b6bead1 Refactor graph search and add local Vite config.
- Simplify graph search parameters in API
- Add inclusive search and min degree options
- Update Vite config for local development
- Enhance graph query endpoint in web UI
- Add new Vite config file for local setup
2025-03-05 10:39:27 +08:00
Yannick Stephan
4501a20a6a
Merge pull request #990 from HKUDS/dev
Completed the missing methods in various databases to support modifications for the Graph.
2025-03-04 18:56:48 +01:00
zrguo
3264f6a118 Update delete_by_doc_id 2025-03-04 16:36:58 +08:00
yangdx
002948d342 Added search mode and min degree filtering for NetworkX
- Implemented exact and inclusive search modes
- Added min degree filtering for nodes
- Updated API to parse label for search options
2025-03-04 16:08:05 +08:00
zrguo
81568f3bad fix linting 2025-03-04 15:53:20 +08:00
zrguo
3a2a636862 Implement the missing methods. 2025-03-04 15:50:53 +08:00
yangdx
735231d851 No need the await entity_relation_task first 2025-03-04 15:30:52 +08:00
yangdx
8cf9f04dbc Improved task handling and error management in LightRAG
- Created tasks with references for cancellation
- Prioritized entity relation task execution
- Implemented task cancellation on failure
- Added error logging to pipeline_status
2025-03-04 14:59:50 +08:00
yangdx
25cbb9bf92 Merge branch 'main' into Add-summary-lang-support 2025-03-04 14:02:21 +08:00
yangdx
06b2124dd0 Fix linting 2025-03-04 14:02:14 +08:00
zrguo
9d56b1c8a4
Merge pull request #976 from danielaskdd/validate-content-before-enqueue
Improved file handling and validation for document processing
2025-03-04 13:26:54 +08:00
zrguo
fd9f71e0ee fix delete_by_doc_id 2025-03-04 13:22:33 +08:00
yangdx
6c39cbf773 Add summary language setting by env 2025-03-04 12:45:35 +08:00
yangdx
d69042f161 Merge branch 'main' into standalone-logger-setup 2025-03-04 09:54:14 +08:00
yangdx
56d6a68139 Merge branch 'main' into validate-content-before-enqueue 2025-03-04 09:53:47 +08:00
Yannick Stephan
cf87c931d4
Merge pull request #978 from MdNazishArmanShorthillsAI/main
Improved caching check
2025-03-03 23:29:55 +01:00
yangdx
0af774a28f Fix linting 2025-03-04 01:28:39 +08:00
yangdx
9056994292 Deprecate and remove logging parameters in LightRAG.
- Set log_level and log_file_path to None by default
- Issue warnings if deprecated parameters are used
- Maintain backward compatibility with warnings
2025-03-04 01:28:08 +08:00
yangdx
b26a574f40 Deprecate log_level and log_file_path in LightRAG.
- Remove log_level from API initialization
- Add warnings for deprecated logging params
2025-03-04 01:07:34 +08:00
yangdx
63cb057d41 Merge branch 'main' into standalone-logger-setup 2025-03-03 23:36:17 +08:00
yangdx
462c27c167 Refactor logging setup and simplify Gunicorn configuration
• Move logging setup code to utils.py
• Provide setup_logger for standalone LightRAG logger intialization
2025-03-03 23:18:41 +08:00
zrguo
a814285155 Add a feature that allows modifying nodes and relationships. 2025-03-03 21:09:45 +08:00
zrguo
a27cf5a09e fix delete_by_doc_id 2025-03-03 19:17:34 +08:00
MdNazishArmanShorthillsAI
0ea274a30d Improved cashing check 2025-03-03 13:53:45 +05:30
zrguo
887388c317 fix linting 2025-03-03 14:54:28 +08:00
zrguo
0320aa4ccc
Merge pull request #971 from Volve-Technologies/abyl/adding_full_doc_id
adding full_doc_id to insert
2025-03-03 14:44:50 +08:00
yangdx
e854313438 Merge branch 'main' into validate-content-before-enqueue 2025-03-03 01:34:55 +08:00
Yannick Stephan
2d6d0be128
Merge pull request #969 from danielaskdd/add-multi-worker-support
Add multi workers support for API Server
2025-03-02 17:47:00 +01:00
yangdx
aa5888042e Improved file handling and validation for document processing
• Enhanced UTF-8 validation for text files
• Added content validation checks
• Better handling of binary data
• Added logging for ignored document IDs
• Improved document ID filtering
2025-03-02 23:57:57 +08:00
zrguo
265fc2c87f fix linting 2025-03-02 14:24:54 +08:00
zrguo
5198240cf9 remove " and upper() 2025-03-02 14:23:06 +08:00
yangdx
7124845e55 Optimize document processing pipeline with better status tracking & batch handling
• Add upfront doc processing check
• Optimize pipeline status updates
2025-03-02 11:09:32 +08:00
yangdx
1a5eb20003 Fix history_messages clearing in LightRAG pipeline status initialization 2025-03-02 04:43:41 +08:00
yangdx
c0b22a8ae2 Merge branch 'main' into add-multi-worker-support 2025-03-02 02:54:57 +08:00