705 Commits

Author SHA1 Message Date
yangdx
9ba12a4f31 refactor: remove redundant top_k checks in query routes
The top_k parameter already has a default value set in the QueryParam class (base.py), making these checks unnecessary. This change simplifies the code while maintaining the same functionality.

Changes:

Remove top_k check in query_text function
Remove top_k check in query_text_stream function
2025-02-21 18:53:43 +08:00
yangdx
e8efcc335d Add access log filtering to reduce noise from high-frequency API endpoints 2025-02-21 17:53:01 +08:00
yangdx
1749678384 Fix linting 2025-02-21 12:16:04 +08:00
Saifeddine ALOUI
ed9dc799b0
Merge branch 'HKUDS:main' into main 2025-02-20 18:15:55 +01:00
Yannick Stephan
678e0f9aea
Revert "Cleanup of code" 2025-02-20 15:09:43 +01:00
Yannick Stephan
439685e69c
Revert "removed get_knowledge_graph" 2025-02-20 14:29:36 +01:00
Saifeddine ALOUI
c3c3c87494
Added instructions on how to install age for postgresql 2025-02-20 11:55:09 +01:00
Saifeddine ALOUI
167fa82363 Fixed linting 2025-02-20 11:38:07 +01:00
Saifeddine ALOUI
3f3e9ef367 Upgraded webui to show more upload options and added building without using bun to the webui 2025-02-20 11:25:57 +01:00
Saifeddine ALOUI
3627b4485f Upgraded webui to support more files 2025-02-20 11:14:48 +01:00
Saifeddine ALOUI
38b62d58ad
Added extra extentions 2025-02-20 10:59:07 +01:00
yangdx
f52b9929bb fix: add missing rag parameter in pipeline_enqueue_file call
• Add rag param to function call
• Fix argument mismatch error
• Ensure proper pipeline execution
2025-02-20 14:48:54 +08:00
yangdx
82a4cb3e79 Fix refactoring error on document handling
- Fix refactoring error on pipeline_index_file
- Delete unsed func: scan_directory
- Add type hints of rag for better maintainability
- Refine comments for better understanding
2025-02-20 14:30:41 +08:00
yangdx
62e1fe5df2 Change Ollama API router tag to lowercase 2025-02-20 14:23:33 +08:00
yangdx
57cdab2b2b Add tags to OllamaAPI router 2025-02-20 12:33:43 +08:00
yangdx
5d884f6d3e refactor: centralize configuration and utility functions
- Move parse_args and display_splash_screen functions from lightrag_server.py to utils_api.py
- Move OllamaServerInfos class and instance from ollama_api.py to utils_api.py
2025-02-20 12:12:20 +08:00
Yannick Stephan
89c35c82c7 removed get_knowledge_graph 2025-02-19 22:57:46 +01:00
Yannick Stephan
eb3306f34c cleanup 2025-02-19 22:52:49 +01:00
yangdx
a8abcf14ac Fit linting 2025-02-20 04:12:21 +08:00
yangdx
3c080a9ebf Enhance webui mounting with root endpoint and directory check.
- Added FileResponse for webui root endpoint
- Enabled directory check in StaticFiles mount
- Improved webui static file handling
- Ensured webui directory existence
- Simplified webui access with root endpoint
2025-02-20 04:04:54 +08:00
yangdx
c0c87edc45 split lightrag_servery.py to smaller files 2025-02-20 03:26:39 +08:00
Yannick Stephan
c79b15c1cc
Merge pull request #844 from danielaskdd/add-duplicate-check
Fix office file indexing problem
2025-02-19 08:34:40 +01:00
yangdx
32bfcbb332 Revert "Improved document enqueue logic with existence checks" 2025-02-19 13:39:50 +08:00
Yannick Stephan
ccb117e1c6
Merge pull request #846 from ArnoChenFx/db-connection-and-storage-lifecycle
Refactor Database Connection Management and Improve Storage Lifecycle Handling
2025-02-18 22:39:31 +01:00
ArnoChen
ca170ce783 rename is_managed_by_server to auto_manage_storages_states 2025-02-19 05:27:38 +08:00
Yannick Stephan
e0ecb4777e fixed missing install 2025-02-18 22:24:59 +01:00
ArnoChen
f3b030e1a3 revert temp changes 2025-02-19 04:53:33 +08:00
ArnoChen
6d8e627f85 improve MongoDB client management and storage init 2025-02-19 04:30:52 +08:00
ArnoChen
e194e04226 refactor database connection management and improve storage lifecycle handling
update
2025-02-19 03:49:05 +08:00
Yannick Stephan
011227e426 cleanup no required install 2025-02-18 20:27:59 +01:00
Yannick Stephan
ea41d08b9f removed torch from requirement lightrag server 2025-02-18 20:05:51 +01:00
Yannick Stephan
2524e02428 remove tqdm and cleaned readme and ollama 2025-02-18 19:58:03 +01:00
yangdx
8196df83f8 Fix linting 2025-02-19 01:39:25 +08:00
yangdx
d34dbc5717 Improved document enqueue logic with existence checks.
- Added return status to `apipeline_enqueue_documents`
- Enhanced logging for duplicate documents
2025-02-19 01:35:34 +08:00
yangdx
cac93424d9 Added support for reading .xlsx files in LightRAG.
- Install openpyxl if not present
- Load .xlsx file using openpyxl
- Extract sheet titles and content
- Format rows with tab-separated values
- Append sheet content to overall text
2025-02-19 01:34:51 +08:00
yangdx
9c45824e78 Optimize file handling for DOCX and PPTX processing.
- Removed redundant file content reading.
- Directly passed file to BytesIO.
- Simplified DOCX content extraction.
- Streamlined PPTX slide processing.
- Reduced memory usage in file handling.
2025-02-19 01:34:25 +08:00
Yannick Stephan
99dc4859a9
Merge pull request #837 from ParisNeo/main
Fixes and Enhancements for PostgreSQL and JSON Document Storage
2025-02-18 16:46:13 +01:00
Saifeddine ALOUI
8d043c599d
Update LightRagWithPostGRESQL.md 2025-02-18 15:50:00 +01:00
Yannick Stephan
e1e00a897c
Merge pull request #833 from danielaskdd/import-as-needed
Implement dynamic database module imports
2025-02-18 15:13:33 +01:00
Yannick Stephan
bc190816ce
Update LightRagWithPostGRESQL.md 2025-02-18 13:13:20 +01:00
yangdx
89c01c686f Fix casting dateime it to str in needed
- Added datetime formatting utility and standardized timestamp handling in DocStatusResponse
2025-02-18 17:46:28 +08:00
yangdx
5acd054180 Fix linting 2025-02-18 16:33:57 +08:00
yangdx
75ee4592b8 refactor: Implement dynamic database module imports
- Consolidate database instance management
- Improve database management and error handling
- Enhance error handling and logging
2025-02-18 16:14:11 +08:00
yangdx
8ab369c2af Remove unused package 2025-02-18 16:08:20 +08:00
Saifeddine ALOUI
3c15a2def5 linting done 2025-02-17 20:37:17 +01:00
Saifeddine ALOUI
e6bc1cb851
Removed AI message 2025-02-17 20:27:35 +01:00
Saifeddine ALOUI
66d2d24607
Update LightRagWithPostGRESQL.md 2025-02-17 20:12:40 +01:00
Saifeddine ALOUI
b50ff40bc2
Update LightRagWithPostGRESQL.md 2025-02-17 18:40:47 +01:00
Saifeddine ALOUI
b1dc1a0fc4
Create LightRagWithPostGRESQL.md 2025-02-17 18:34:55 +01:00
ArnoChen
900ba63f69 build new webui 2025-02-18 00:43:57 +08:00