yangdx
8196df83f8
Fix linting
2025-02-19 01:39:25 +08:00
yangdx
d34dbc5717
Improved document enqueue logic with existence checks.
...
- Added return status to `apipeline_enqueue_documents`
- Enhanced logging for duplicate documents
2025-02-19 01:35:34 +08:00
yangdx
cac93424d9
Added support for reading .xlsx files in LightRAG.
...
- Install openpyxl if not present
- Load .xlsx file using openpyxl
- Extract sheet titles and content
- Format rows with tab-separated values
- Append sheet content to overall text
2025-02-19 01:34:51 +08:00
yangdx
9c45824e78
Optimize file handling for DOCX and PPTX processing.
...
- Removed redundant file content reading.
- Directly passed file to BytesIO.
- Simplified DOCX content extraction.
- Streamlined PPTX slide processing.
- Reduced memory usage in file handling.
2025-02-19 01:34:25 +08:00
yangdx
89c01c686f
Fix casting dateime it to str in needed
...
- Added datetime formatting utility and standardized timestamp handling in DocStatusResponse
2025-02-18 17:46:28 +08:00
yangdx
5acd054180
Fix linting
2025-02-18 16:33:57 +08:00
yangdx
75ee4592b8
refactor: Implement dynamic database module imports
...
- Consolidate database instance management
- Improve database management and error handling
- Enhance error handling and logging
2025-02-18 16:14:11 +08:00
Yannick Stephan
ad5c5bba31
fix merge
2025-02-17 08:48:53 +01:00
Yannick Stephan
ef92a3f1f4
Merge remote-tracking branch 'origin/main' into api_improvment
...
# Conflicts:
# lightrag/api/lightrag_server.py
2025-02-17 08:48:15 +01:00
Yannick Stephan
e9e786b75c
update pr
2025-02-17 08:44:37 +01:00
zrguo
fc6dff04ff
fix logger level
2025-02-17 15:10:15 +08:00
zrguo
fce24f7611
Merge pull request #797 from danielaskdd/add-env-settings
...
Add the token size truncation for local query and token size setting by env
2025-02-17 15:00:07 +08:00
Yannick Stephan
efec27c0b8
fixed stream
2025-02-16 20:10:28 +01:00
Yannick Stephan
0b78787b25
cleaned code
2025-02-16 20:03:52 +01:00
Yannick Stephan
1fdcd93e84
cleaned code
2025-02-16 19:58:30 +01:00
Yannick Stephan
e8c80ce683
cleaned code
2025-02-16 19:44:25 +01:00
Yannick Stephan
3119f76e26
added field check
2025-02-16 19:42:09 +01:00
Yannick Stephan
730e2bc8ce
added conditions
2025-02-16 19:34:27 +01:00
Yannick Stephan
7f5f44a646
added type validation
2025-02-16 19:24:12 +01:00
ArnoChen
6efee1c2fe
fix docstring for documents endpoint
2025-02-17 02:23:24 +08:00
Yannick Stephan
b09589cfd9
cleaned code
2025-02-16 19:13:29 +01:00
Yannick Stephan
709461b875
added insert texts
2025-02-16 19:07:06 +01:00
yangdx
806eadf5dc
Add verbose debug option to control detailed debug output level
...
• Added VERBOSE env var & CLI flag
• Implemented verbose_debug() function
• Added verbose option to splash screen
• Reduced default debug output length
• Modified LLM debug logging behavior
2025-02-17 01:38:18 +08:00
ArnoChen
f5ee1f2cdb
release new webui
2025-02-17 01:14:33 +08:00
ArnoChen
ca85b82a47
implement endpoint to retrieve document statuses
2025-02-17 01:03:24 +08:00
ArnoChen
b580e47324
format
2025-02-16 21:20:43 +08:00
ArnoChen
1a6c6f30a1
Merge remote-tracking branch 'origin/main' into refactor-server
...
# Conflicts:
# lightrag/api/lightrag_server.py
2025-02-16 21:19:30 +08:00
ArnoChen
bbe24ab7ce
enhance query and indexing with pipeline
2025-02-16 21:11:05 +08:00
ArnoChen
33a4f00b1d
index multiple files concurrently
2025-02-16 01:11:02 +08:00
ArnoChen
147d73bd56
refactor file indexing for background async processing
2025-02-15 22:25:48 +08:00
yangdx
8fdbcb0d3f
fix: reorganize server info display and add CORS origins info
...
• Add CORS origins display
• Move API key status higher in display
• Fix tree symbols for better readability
• Regroup related server info
• Remove redundant line breaks
2025-02-15 11:46:47 +08:00
yangdx
2985d88f97
refactor: improve CORS and streaming response headers
...
- Add configurable CORS origins
- Remove duplicate CORS headers
- Add X-Accel-Buffering header
- Update env example file
- Clean up header configurations
2025-02-15 11:39:10 +08:00
yangdx
258c7596e6
fix: Improve file path handling and logging for document scanning
...
• Convert relative paths to absolute paths
• Add logging for file scanning progress
• Log total number of new files found
• Enhance file scanning feedback
• Improve path resolution safety
2025-02-14 12:50:43 +08:00
zrguo
4d58ff8bb4
Merge pull request #771 from enriquecatala/fix-litellm-litellm-proxy-support
...
Enable LiteLLM proxy with embedding_binding_host
2025-02-14 09:43:55 +08:00
Enrique Catalá
f9d69b889e
ruff reformat
2025-02-14 00:16:59 +01:00
Enrique Catalá
0ece8e102d
lint fix
2025-02-14 00:09:32 +01:00
Enrique Catalá
991fa33986
Enable LiteLLM proxy with embedding_binding_host
2025-02-13 22:45:03 +01:00
yangdx
35d6e2d322
Fix linting
2025-02-14 02:32:33 +08:00
yangdx
6f999aa5e5
Refactor file conversion to use async execution
...
- Wrap sync conversion in async function
- Use asyncio.to_thread for non-blocking IO
- Maintain same functionality as before
- Clean up temporary files properly
- Improve responsiveness of file processing
2025-02-14 02:31:58 +08:00
yangdx
cd3815e825
Fix linting
2025-02-14 01:14:12 +08:00
yangdx
08364e99fb
Move document scanning trigger by command line to background task
...
- Added background task management
- Prevented concurrent scanning
- Tracked scanning progress
- Improved startup performance
- Enhanced error handling
2025-02-14 01:12:39 +08:00
yangdx
47268c2ab1
Fix linting
2025-02-13 21:01:34 +08:00
yangdx
e1d9dba20d
Fix typos in documentation tree structure and storage implementation names
...
• Correct menu tree structure in splash screen
• Fix MilvusVectorDBStorage typo
• Update storage env requirements
2025-02-13 20:40:29 +08:00
zrguo
dea6f4f288
Merge branch 'main' into select-datastore-in-api-server
2025-02-13 20:03:38 +08:00
ArnoChen
464042f2c0
display webui and graph viewer links in splash screen
2025-02-13 18:03:09 +08:00
ArnoChen
bc83c4c7ed
update readme
...
configure output directory
2025-02-13 17:54:10 +08:00
ArnoChen
c674905a98
use KnowledgeGraph typed dict for graph API response
2025-02-13 17:32:51 +08:00
ArnoChen
e4562c761c
fix typo
2025-02-13 17:32:05 +08:00
yangdx
cdd52809b0
Fix linting
2025-02-13 14:07:36 +08:00
yangdx
28b17b327b
Fix: top_k param handling error, unify top_k and cosine default value.
2025-02-13 06:05:21 +08:00
