79 Commits

Author SHA1 Message Date
yangdx
bdcd55a871 Feat: Add delete upload file option to document deletion 2025-06-25 19:02:46 +08:00
yangdx
51bb0471cd Change the API for deleting documents to support deleting multiple documents at once. 2025-06-25 16:19:49 +08:00
yangdx
495d6c8cce Improve the pipeline status message for document deletetion 2025-06-25 15:46:58 +08:00
yangdx
2aaa6d5f7d Fix linting 2025-06-25 14:59:45 +08:00
yangdx
49baeb7318 Change document deletion API to async 2025-06-25 14:59:10 +08:00
yangdx
922484915b Remove deprecated API endpoint. 2025-06-25 13:55:47 +08:00
yangdx
8b6dcfb6eb Pls do not use /delete_document API endpoint 2025-06-24 11:26:38 +08:00
yangdx
5ae945c1e5 Improved error handling for document deletion
Added HTTPException for not_found status
Added HTTPException for fail status
2025-06-24 01:12:25 +08:00
yangdx
c18065a912 Disable document deletion when LLM cache for extraction is off 2025-06-23 22:41:27 +08:00
yangdx
1973c80dca Feat: Add entity and relation deletion endpoints 2025-06-23 22:14:50 +08:00
yangdx
bd487dd252 Unify document APIs returen status string 2025-06-23 21:38:47 +08:00
yangdx
5099ac8213 Fix linting 2025-06-23 18:41:30 +08:00
yangdx
dffe659388 Feat: Add document deletion by ID API endpoint
- New DELETE endpoint for document removal
- Implements doc_id-based deletion
- Handles pipeline status during operation
- Includes proper error handling
- Updates pipeline status messages
2025-06-23 18:10:40 +08:00
yangdx
a6046bf827 Fix linting 2025-05-22 10:06:09 +08:00
Benjamin L
1b6ddcaf5b change validator method names 2025-05-21 16:06:35 +02:00
Benjamin L
62b536ea6f Adding file_source.s as optional attribute to text.s requests 2025-05-21 15:10:27 +02:00
yangdx
36f8787bc7 Fix linting 2025-05-01 10:04:31 +08:00
yangdx
a561be0cff Fix time zone problem of doc status 2025-05-01 02:16:19 +08:00
yangdx
31bd274601 Add Unicode collation for Chinese file sorting of document scanning 2025-04-25 01:02:09 +08:00
yangdx
3aab5b41f2 Fix linting 2025-04-24 14:15:10 +08:00
yangdx
fc425f1397 Send all found files to pipeline at once 2025-04-24 14:00:43 +08:00
cuikunyu
135a40d696 Optimize: Use python-docx for better parsing. 2025-04-11 03:10:20 +00:00
yangdx
bd2c528dba Merge branch 'optimize-config-management' into clear-doc 2025-04-04 19:46:45 +08:00
yangdx
b0f0f1ff84 refactor: improve document clearing status management
- Use update() for atomic status updates
- Improve history messages clearing while preserving list object
2025-04-01 14:03:45 +08:00
yangdx
cd94e84267 Update clear cache endpoint path 2025-04-01 10:36:28 +08:00
yangdx
d54bda8d36 feat(api): Add Pydantic models for all endpoints in document_routes.py 2025-03-31 23:53:14 +08:00
yangdx
8845779ed7 Add clear cache API endpoint 2025-03-31 23:37:03 +08:00
yangdx
95a8ee27ed Fix linting 2025-03-31 23:22:27 +08:00
yangdx
04967b33cc feat(api): Add dedicated ClearDocumentsResponse class for document deletion endpoint 2025-03-31 19:13:27 +08:00
yangdx
bbc770d1ed feat(api): enhance document clearing error handling and status reporting
- Change pipeline busy status from "error" to "busy"
- Improve error handling documentation
2025-03-31 13:01:52 +08:00
Milin
4dbd5e3899 Merge branch 'main' into optimize-config-management
# Conflicts:
#	env.example
#	lightrag/api/utils_api.py
2025-03-31 11:29:29 +08:00
Milin
088fc19318 feat(config): Refactor configuration management
- Optimize JWT Auth module to load configuration via `global_args`.
- Decouple configuration-related code from `utils_api.py`, and add a new `config.py` file for unified configuration management.
- Adjust configuration import in `lightrag_server.py`, `auth.py`, and `document_routes.py` to be introduced through `global_args`.
2025-03-31 11:19:47 +08:00
yangdx
949a3904a9 feat(api): Enhance document clearing functionality
- Use storage drop methods to properly clean up all data
- Add file deletion from input directory
- Add pipeline status checking and locking mechanism
- Improve error handling with detailed logging and pipeline message tracking
2025-03-30 16:30:41 +08:00
yangdx
adb4ca9294 Fix linting 2025-03-28 16:49:35 +08:00
yangdx
35d4503677 Feat: add duplicate file check 2025-03-28 16:48:46 +08:00
yangdx
d456269718 feat: Add file name display in WebUI
Backend:
- Add file_path field to DocStatusResponse
- Update document status response creation

Frontend:
- Remove metadata column
- Improve filename display with truncation and tooltips
- Add show/hide filename toggle with proper styling
- Update translations for all supported languages"
2025-03-25 22:42:46 +08:00
yangdx
35df22cf08 Update pipeline_enqueue_file to include file_paths parameter 2025-03-25 20:47:25 +08:00
yangdx
d05cf286f4 Fix linting 2025-03-24 14:30:17 +08:00
yangdx
9e3994419e Refactor authentication logic and Swagger UI config
- Consolidate authentication dependencies
- Improve Swagger UI security parameters
2025-03-24 14:29:36 +08:00
yangdx
79bf26dfeb Process update flags status for proper boolean conversion
- Convert MutableBoolean to regular boolean values
- Handle both multiprocess and single process cases
2025-03-24 12:49:39 +08:00
yangdx
77ab26e5bf Fix linting 2025-03-24 05:39:50 +08:00
yangdx
071302d10f Moved update status logic to document routes.
- Removed update status from health check endpoint
- Added update_status field to PipelineStatusResponse
2025-03-24 05:37:03 +08:00
yangdx
90ef55960d Refactor authentication and whitelist handling
- Combined auth and API key dependencies
- Optimized whitelist path matching
- Added optional API key to OllamaAPI
2025-03-24 05:23:40 +08:00
yangdx
7e8a2c0e9b Added temperature parameter for LLM 2025-03-24 02:02:34 +08:00
yangdx
53396e4d82 Fixlinting 2025-03-21 16:56:47 +08:00
yangdx
0761af19c6 Files are now processed in batches in auto scan 2025-03-21 13:41:37 +08:00
yangdx
168232803b Optimized the document processing pipeline
- Enqueue all files to pipeline before starting process when scanning input folder
- Changed parallel enqueue to sequential to prevent CPU overload by heavy file extraction jobs
2025-03-21 13:08:57 +08:00
yangdx
73440e3a96 Fix linting 2025-03-12 16:28:55 +08:00
yangdx
16e06100e7 Add PipelineStatusResponse model for API endpoint 2025-03-12 16:16:39 +08:00
Saifeddine ALOUI
53cfb72db4 linted 2025-03-08 23:07:51 +01:00