yangdx
73440e3a96
Fix linting
2025-03-12 16:28:55 +08:00
yangdx
16e06100e7
Add PipelineStatusResponse model for API endpoint
2025-03-12 16:16:39 +08:00
Saifeddine ALOUI
53cfb72db4
linted
2025-03-08 23:07:51 +01:00
zrguo
c67e6aceca
Merge branch 'main' into main
2025-03-09 00:23:06 +08:00
zrguo
3286a0d57f
Merge pull request #1003 from danielaskdd/add-graph-search-mode
...
Feat: Added minimum degree filter for graph queries
2025-03-07 12:37:44 +08:00
Milin
c015296081
refactor(api): Fix issues reported by pre-commit
...
- Modified code layout and formatting in multiple files, improving code readability.
- Updated import statements, removing unused libraries.
- Simplified the writing of some functions and exception handling.
2025-03-06 14:23:52 +08:00
Saifeddine ALOUI
00f3c6c6dd
Upgraded document loading engine
2025-03-06 01:11:48 +01:00
Saifeddine ALOUI
6e4daea056
Linting
2025-03-05 15:36:47 +01:00
Saifeddine ALOUI
95a6a274ca
Update ollama_api.py
2025-03-05 15:33:06 +01:00
Saifeddine ALOUI
aaa8194423
Update document_routes.py
2025-03-05 15:32:39 +01:00
Milin
59e3b2eec1
refactor(api): Code optimization based on review comments.
...
- Removed authentication dependency for the health check endpoint in lightrag_server.py
- Removed the authentication dependency for the entire router in ollama_api.py
- Updated the parameter list and example usage in README.md, removing authentication-related parts
- Removed neo4j and tqdm dependencies from requirements.txt
- Deleted command-line argument parsing code related to authentication from utils_api.py
2025-03-05 20:38:05 +08:00
Milin
852634e20e
Merge branch 'main' into feat_login-jwt
2025-03-05 12:42:40 +08:00
yangdx
5e40e4107d
Added min_degree exception for connected nodes
2025-03-05 11:48:04 +08:00
yangdx
1fddc8552e
Added minimum degree filter for graph queries
...
- Introduced min_degree parameter in graph query
- Updated UI to include minimum degree setting
- Modified API to handle min_degree parameter
- Updated graph query logic in LightRAG
2025-03-05 11:37:55 +08:00
Milin
63aa4f9dfc
feat(api): Add user authentication functionality
...
- Implement JWT-based user authentication logic
- Add login endpoint and token validation middleware
- Update API routes with authentication dependencies
- Add authentication-related environment variables
- Optimize requirements.txt with necessary dependencies
2025-03-05 11:09:31 +08:00
yangdx
d52b6bead1
Refactor graph search and add local Vite config.
...
- Simplify graph search parameters in API
- Add inclusive search and min degree options
- Update Vite config for local development
- Enhance graph query endpoint in web UI
- Add new Vite config file for local setup
2025-03-05 10:39:27 +08:00
yangdx
002948d342
Added search mode and min degree filtering for NetworkX
...
- Implemented exact and inclusive search modes
- Added min degree filtering for nodes
- Updated API to parse label for search options
2025-03-04 16:08:05 +08:00
zrguo
9d56b1c8a4
Merge pull request #976 from danielaskdd/validate-content-before-enqueue
...
Improved file handling and validation for document processing
2025-03-04 13:26:54 +08:00
yangdx
61839f311a
Fix package name checks for docx and pptx modules.
...
- Added type ignore for package checks
- Corrected docx pptx package name for new version
2025-03-04 10:00:07 +08:00
yangdx
56d6a68139
Merge branch 'main' into validate-content-before-enqueue
2025-03-04 09:53:47 +08:00
yangdx
aa5888042e
Improved file handling and validation for document processing
...
• Enhanced UTF-8 validation for text files
• Added content validation checks
• Better handling of binary data
• Added logging for ignored document IDs
• Improved document ID filtering
2025-03-02 23:57:57 +08:00
yangdx
465737efed
Fix linting
2025-03-02 17:32:25 +08:00
yangdx
1ca6837219
Add max nodes limit for graph retrieval of networkX
...
• Set MAX_GRAPH_NODES env var (default 1000)
• Change edge type to "RELATED"
2025-03-02 12:52:25 +08:00
yangdx
3507e894d9
Merge branch 'main' into add-multi-worker-support
2025-03-01 15:55:37 +08:00
yangdx
d704512139
Refactor shared storage module to improve async handling and naming consistency
...
• Add async support for get_namespace_data
• Rename get_update_flags to get_update_flag
• Rename set_update_flag to set_all_update_flags
• Update docstrings for clarity
• Fix typos in log messages
2025-03-01 05:01:26 +08:00
yangdx
c973498c34
Fix linting
2025-02-28 21:35:04 +08:00
yangdx
157ec862ae
Enhance logging system with file rotation and unified configuration
...
• Unify logging across Gunicorn and Uvicorn
• Add rotating file handlers
2025-02-28 14:57:25 +08:00
yangdx
8cd45161f2
feat: add history_messages to track pipeline processing progress
...
• Add shared history_messages list
• Track pipeline progress with messages
2025-02-28 13:53:40 +08:00
yangdx
04bd5413c9
Add API endpoint to retrieve document indexing pipeline status
...
• GET /pipeline_status endpoint added
• Returns current pipeline processing state
2025-02-28 12:21:50 +08:00
yangdx
b4bcd76599
Remove useless scan progress tracking functionality and related code
2025-02-28 10:53:36 +08:00
yangdx
db2a902fcb
Rename get_scan_lock to get_storage_lock
2025-02-28 00:34:33 +08:00
yangdx
92ecb0da97
Refactor document scanning progress share variable initialization
2025-02-27 16:07:00 +08:00
yangdx
7436c06f6c
Fix linting
2025-02-26 18:11:16 +08:00
yangdx
4eb069d1d6
Initialize scan_progress with default values if not already set
2025-02-26 17:42:49 +08:00
yangdx
2752a764ae
Refactor storage implementations to support both single and multi-process modes
...
• Add shared storage management module
• Support process/thread lock based on mode
2025-02-26 05:38:38 +08:00
ArnoChen
40a1a94a31
add graph depth and layout iteration settings
2025-02-25 18:32:53 +08:00
yangdx
d74a23d2cc
Add multiple workers support for API Server
2025-02-25 09:37:00 +08:00
yangdx
facf7c11fe
Reduce knowledge graph max_depth from 100 to 3
2025-02-24 03:34:44 +08:00
yangdx
f29628125b
Fix typo in parameter name from 'nodel_label' to 'node_label'
2025-02-24 02:36:36 +08:00
yangdx
dbeda8a9ff
Change scanning logs from INFO to DEBUG level
2025-02-23 16:12:08 +08:00
yangdx
3c866eec16
Merge branch 'refactor-api-server' into clear-text-before-insert
2025-02-22 10:04:56 +08:00
yangdx
b144e0c3b0
Sync modifications from main branch
2025-02-21 21:07:37 +08:00
yangdx
9ba12a4f31
refactor: remove redundant top_k checks in query routes
...
The top_k parameter already has a default value set in the QueryParam class (base.py), making these checks unnecessary. This change simplifies the code while maintaining the same functionality.
Changes:
Remove top_k check in query_text function
Remove top_k check in query_text_stream function
2025-02-21 18:53:43 +08:00
yangdx
1749678384
Fix linting
2025-02-21 12:16:04 +08:00
yangdx
f52b9929bb
fix: add missing rag parameter in pipeline_enqueue_file call
...
• Add rag param to function call
• Fix argument mismatch error
• Ensure proper pipeline execution
2025-02-20 14:48:54 +08:00
yangdx
82a4cb3e79
Fix refactoring error on document handling
...
- Fix refactoring error on pipeline_index_file
- Delete unsed func: scan_directory
- Add type hints of rag for better maintainability
- Refine comments for better understanding
2025-02-20 14:30:41 +08:00
yangdx
62e1fe5df2
Change Ollama API router tag to lowercase
2025-02-20 14:23:33 +08:00
yangdx
57cdab2b2b
Add tags to OllamaAPI router
2025-02-20 12:33:43 +08:00
yangdx
5d884f6d3e
refactor: centralize configuration and utility functions
...
- Move parse_args and display_splash_screen functions from lightrag_server.py to utils_api.py
- Move OllamaServerInfos class and instance from ollama_api.py to utils_api.py
2025-02-20 12:12:20 +08:00
yangdx
a8abcf14ac
Fit linting
2025-02-20 04:12:21 +08:00