322 Commits

Author SHA1 Message Date
ArnoChen
f3b030e1a3 revert temp changes 2025-02-19 04:53:33 +08:00
ArnoChen
6d8e627f85 improve MongoDB client management and storage init 2025-02-19 04:30:52 +08:00
ArnoChen
e194e04226 refactor database connection management and improve storage lifecycle handling
update
2025-02-19 03:49:05 +08:00
Yannick Stephan
99dc4859a9
Merge pull request #837 from ParisNeo/main
Fixes and Enhancements for PostgreSQL and JSON Document Storage
2025-02-18 16:46:13 +01:00
Saifeddine ALOUI
8d043c599d
Update LightRagWithPostGRESQL.md 2025-02-18 15:50:00 +01:00
Yannick Stephan
e1e00a897c
Merge pull request #833 from danielaskdd/import-as-needed
Implement dynamic database module imports
2025-02-18 15:13:33 +01:00
Yannick Stephan
bc190816ce
Update LightRagWithPostGRESQL.md 2025-02-18 13:13:20 +01:00
yangdx
89c01c686f Fix casting dateime it to str in needed
- Added datetime formatting utility and standardized timestamp handling in DocStatusResponse
2025-02-18 17:46:28 +08:00
yangdx
5acd054180 Fix linting 2025-02-18 16:33:57 +08:00
yangdx
75ee4592b8 refactor: Implement dynamic database module imports
- Consolidate database instance management
- Improve database management and error handling
- Enhance error handling and logging
2025-02-18 16:14:11 +08:00
yangdx
8ab369c2af Remove unused package 2025-02-18 16:08:20 +08:00
Saifeddine ALOUI
3c15a2def5 linting done 2025-02-17 20:37:17 +01:00
Saifeddine ALOUI
e6bc1cb851
Removed AI message 2025-02-17 20:27:35 +01:00
Saifeddine ALOUI
66d2d24607
Update LightRagWithPostGRESQL.md 2025-02-17 20:12:40 +01:00
Saifeddine ALOUI
b50ff40bc2
Update LightRagWithPostGRESQL.md 2025-02-17 18:40:47 +01:00
Saifeddine ALOUI
b1dc1a0fc4
Create LightRagWithPostGRESQL.md 2025-02-17 18:34:55 +01:00
ArnoChen
900ba63f69 build new webui 2025-02-18 00:43:57 +08:00
Yannick Stephan
ad5c5bba31 fix merge 2025-02-17 08:48:53 +01:00
Yannick Stephan
ef92a3f1f4 Merge remote-tracking branch 'origin/main' into api_improvment
# Conflicts:
#	lightrag/api/lightrag_server.py
2025-02-17 08:48:15 +01:00
Yannick Stephan
e9e786b75c update pr 2025-02-17 08:44:37 +01:00
zrguo
fc6dff04ff fix logger level 2025-02-17 15:10:15 +08:00
zrguo
fce24f7611
Merge pull request #797 from danielaskdd/add-env-settings
Add the token size truncation for local query and token size setting by env
2025-02-17 15:00:07 +08:00
yangdx
4fd1f214c1 Add verbose debug output option to API configuration
- Introduced `--verbose` flag
- Defaults to `False`
2025-02-17 03:57:58 +08:00
Yannick Stephan
efec27c0b8 fixed stream 2025-02-16 20:10:28 +01:00
Yannick Stephan
0b78787b25 cleaned code 2025-02-16 20:03:52 +01:00
Yannick Stephan
1fdcd93e84 cleaned code 2025-02-16 19:58:30 +01:00
Yannick Stephan
e8c80ce683 cleaned code 2025-02-16 19:44:25 +01:00
Yannick Stephan
3119f76e26 added field check 2025-02-16 19:42:09 +01:00
Yannick Stephan
730e2bc8ce added conditions 2025-02-16 19:34:27 +01:00
Yannick Stephan
7f5f44a646 added type validation 2025-02-16 19:24:12 +01:00
ArnoChen
6efee1c2fe fix docstring for documents endpoint 2025-02-17 02:23:24 +08:00
Yannick Stephan
b09589cfd9 cleaned code 2025-02-16 19:13:29 +01:00
ArnoChen
dfd7f702dc new build
fix api alert
2025-02-17 02:08:55 +08:00
Yannick Stephan
709461b875 added insert texts 2025-02-16 19:07:06 +01:00
yangdx
806eadf5dc Add verbose debug option to control detailed debug output level
• Added VERBOSE env var & CLI flag
• Implemented verbose_debug() function
• Added verbose option to splash screen
• Reduced default debug output length
• Modified LLM debug logging behavior
2025-02-17 01:38:18 +08:00
ArnoChen
f5ee1f2cdb release new webui 2025-02-17 01:14:33 +08:00
ArnoChen
ca85b82a47 implement endpoint to retrieve document statuses 2025-02-17 01:03:24 +08:00
yangdx
9ec920661d Improve token estimation accuracy by using tiktoken instead of regex-based approach
• Replace regex token estimation method
• Use tiktoken for more precise counting
• Support all types of text input
• Simplify code implementation
2025-02-16 22:53:58 +08:00
ArnoChen
b580e47324 format 2025-02-16 21:20:43 +08:00
ArnoChen
1a6c6f30a1 Merge remote-tracking branch 'origin/main' into refactor-server
# Conflicts:
#	lightrag/api/lightrag_server.py
2025-02-16 21:19:30 +08:00
ArnoChen
bbe24ab7ce enhance query and indexing with pipeline 2025-02-16 21:11:05 +08:00
zrguo
2a0c7c0322
Merge pull request #785 from danielaskdd/improve-CORS-handling
improve CORS and streaming response headers
2025-02-16 20:31:33 +08:00
ArnoChen
33a4f00b1d index multiple files concurrently 2025-02-16 01:11:02 +08:00
ArnoChen
147d73bd56 refactor file indexing for background async processing 2025-02-15 22:25:48 +08:00
yangdx
8fdbcb0d3f fix: reorganize server info display and add CORS origins info
• Add CORS origins display
• Move API key status higher in display
• Fix tree symbols for better readability
• Regroup related server info
• Remove redundant line breaks
2025-02-15 11:46:47 +08:00
yangdx
2985d88f97 refactor: improve CORS and streaming response headers
- Add configurable CORS origins
- Remove duplicate CORS headers
- Add X-Accel-Buffering header
- Update env example file
- Clean up header configurations
2025-02-15 11:39:10 +08:00
yangdx
0db0419c6d Fix linting 2025-02-15 11:08:54 +08:00
yangdx
ad88ba03bf docs: reorganize Ollama emulation API documentation for better readability 2025-02-15 11:07:38 +08:00
ArnoChen
a600beb619 implement MongoDB support for VectorDB storage. optimize existing MongoDB implementations 2025-02-15 00:38:41 +08:00
yangdx
258c7596e6 fix: Improve file path handling and logging for document scanning
• Convert relative paths to absolute paths
• Add logging for file scanning progress
• Log total number of new files found
• Enhance file scanning feedback
• Improve path resolution safety
2025-02-14 12:50:43 +08:00