zrguo
81568f3bad
fix linting
2025-03-04 15:53:20 +08:00
zrguo
3a2a636862
Implement the missing methods.
2025-03-04 15:50:53 +08:00
yangdx
735231d851
No need the await entity_relation_task first
2025-03-04 15:30:52 +08:00
yangdx
8cf9f04dbc
Improved task handling and error management in LightRAG
...
- Created tasks with references for cancellation
- Prioritized entity relation task execution
- Implemented task cancellation on failure
- Added error logging to pipeline_status
2025-03-04 14:59:50 +08:00
yangdx
25cbb9bf92
Merge branch 'main' into Add-summary-lang-support
2025-03-04 14:02:21 +08:00
yangdx
06b2124dd0
Fix linting
2025-03-04 14:02:14 +08:00
zrguo
9d56b1c8a4
Merge pull request #976 from danielaskdd/validate-content-before-enqueue
...
Improved file handling and validation for document processing
2025-03-04 13:26:54 +08:00
zrguo
fd9f71e0ee
fix delete_by_doc_id
2025-03-04 13:22:33 +08:00
yangdx
6c39cbf773
Add summary language setting by env
2025-03-04 12:45:35 +08:00
yangdx
d69042f161
Merge branch 'main' into standalone-logger-setup
2025-03-04 09:54:14 +08:00
yangdx
56d6a68139
Merge branch 'main' into validate-content-before-enqueue
2025-03-04 09:53:47 +08:00
Yannick Stephan
cf87c931d4
Merge pull request #978 from MdNazishArmanShorthillsAI/main
...
Improved caching check
2025-03-03 23:29:55 +01:00
yangdx
0af774a28f
Fix linting
2025-03-04 01:28:39 +08:00
yangdx
9056994292
Deprecate and remove logging parameters in LightRAG.
...
- Set log_level and log_file_path to None by default
- Issue warnings if deprecated parameters are used
- Maintain backward compatibility with warnings
2025-03-04 01:28:08 +08:00
yangdx
b26a574f40
Deprecate log_level and log_file_path in LightRAG.
...
- Remove log_level from API initialization
- Add warnings for deprecated logging params
2025-03-04 01:07:34 +08:00
yangdx
63cb057d41
Merge branch 'main' into standalone-logger-setup
2025-03-03 23:36:17 +08:00
yangdx
462c27c167
Refactor logging setup and simplify Gunicorn configuration
...
• Move logging setup code to utils.py
• Provide setup_logger for standalone LightRAG logger intialization
2025-03-03 23:18:41 +08:00
zrguo
a814285155
Add a feature that allows modifying nodes and relationships.
2025-03-03 21:09:45 +08:00
zrguo
a27cf5a09e
fix delete_by_doc_id
2025-03-03 19:17:34 +08:00
MdNazishArmanShorthillsAI
0ea274a30d
Improved cashing check
2025-03-03 13:53:45 +05:30
zrguo
887388c317
fix linting
2025-03-03 14:54:28 +08:00
zrguo
0320aa4ccc
Merge pull request #971 from Volve-Technologies/abyl/adding_full_doc_id
...
adding full_doc_id to insert
2025-03-03 14:44:50 +08:00
yangdx
e854313438
Merge branch 'main' into validate-content-before-enqueue
2025-03-03 01:34:55 +08:00
Yannick Stephan
2d6d0be128
Merge pull request #969 from danielaskdd/add-multi-worker-support
...
Add multi workers support for API Server
2025-03-02 17:47:00 +01:00
yangdx
aa5888042e
Improved file handling and validation for document processing
...
• Enhanced UTF-8 validation for text files
• Added content validation checks
• Better handling of binary data
• Added logging for ignored document IDs
• Improved document ID filtering
2025-03-02 23:57:57 +08:00
zrguo
265fc2c87f
fix linting
2025-03-02 14:24:54 +08:00
zrguo
5198240cf9
remove " and upper()
2025-03-02 14:23:06 +08:00
yangdx
7124845e55
Optimize document processing pipeline with better status tracking & batch handling
...
• Add upfront doc processing check
• Optimize pipeline status updates
2025-03-02 11:09:32 +08:00
yangdx
1a5eb20003
Fix history_messages clearing in LightRAG pipeline status initialization
2025-03-02 04:43:41 +08:00
yangdx
c0b22a8ae2
Merge branch 'main' into add-multi-worker-support
2025-03-02 02:54:57 +08:00
Abyl Ikhsanov
bf0ddc6450
making optional for ainsert
2025-03-01 13:34:49 +01:00
Abyl Ikhsanov
baa505eeb0
adding full_doc_id to insert
2025-03-01 13:26:02 +01:00
zrguo
9aa438cf79
fix linting
2025-03-01 18:35:12 +08:00
zrguo
a8f4385c05
Add clear_cache
2025-03-01 18:30:58 +08:00
yangdx
e3a40c2fdb
Fix linting
2025-03-01 16:23:34 +08:00
yangdx
3507e894d9
Merge branch 'main' into add-multi-worker-support
2025-03-01 15:55:37 +08:00
yangdx
c07a5039b7
Refactor shared storage locks to separate pipeline, storage and internal locks for deadlock preventing
2025-03-01 10:48:55 +08:00
yangdx
b3328542c7
refactor: migrate synchronous locks to async locks for improved concurrency
...
• Add UnifiedLock wrapper class
• Convert with blocks to async with
2025-03-01 02:22:35 +08:00
yangdx
731d820bcc
Remove redundancy set_logger function and related calls
2025-02-28 21:46:45 +08:00
yangdx
c973498c34
Fix linting
2025-02-28 21:35:04 +08:00
yangdx
8cd45161f2
feat: add history_messages to track pipeline processing progress
...
• Add shared history_messages list
• Track pipeline progress with messages
2025-02-28 13:53:40 +08:00
yangdx
b2da69b7f1
Add pipeline status control for concurrent document indexing processes
...
• Add shared pipeline status namespace
• Implement concurrent process control
• Add request queuing for pending jobs
2025-02-28 11:52:42 +08:00
yangdx
b4bcd76599
Remove useless scan progress tracking functionality and related code
2025-02-28 10:53:36 +08:00
Huỳnh Triệu Vĩ
2f7fe5e4b6
feat: fix delete by document id
2025-02-27 23:34:57 +07:00
yangdx
27500191b4
Standarize scan progress namespace initialization
2025-02-27 19:08:36 +08:00
yangdx
64f22966a3
Fix linting
2025-02-27 19:05:51 +08:00
yangdx
946095ef80
Fix multiprocess dict creation logic, add process safety locks for namespace creation.
2025-02-27 19:03:53 +08:00
yangdx
92ecb0da97
Refactor document scanning progress share variable initialization
2025-02-27 16:07:00 +08:00
yangdx
7c237920b1
Refactor shared storage to support both single and multi-process modes
...
• Initialize storage based on worker count
• Remove redundant global variable checks
• Add explicit mutex initialization
• Centralize shared storage initialization
• Fix process/thread lock selection logic
2025-02-27 08:48:33 +08:00
Yannick Stephan
3c9908b94a
fixed lint
2025-02-26 12:11:28 +01:00
