208 Commits

Author SHA1 Message Date
ArnoChen
bbe24ab7ce enhance query and indexing with pipeline 2025-02-16 21:11:05 +08:00
ArnoChen
33a4f00b1d index multiple files concurrently 2025-02-16 01:11:02 +08:00
ArnoChen
147d73bd56 refactor file indexing for background async processing 2025-02-15 22:25:48 +08:00
yangdx
8fdbcb0d3f fix: reorganize server info display and add CORS origins info
• Add CORS origins display
• Move API key status higher in display
• Fix tree symbols for better readability
• Regroup related server info
• Remove redundant line breaks
2025-02-15 11:46:47 +08:00
yangdx
2985d88f97 refactor: improve CORS and streaming response headers
- Add configurable CORS origins
- Remove duplicate CORS headers
- Add X-Accel-Buffering header
- Update env example file
- Clean up header configurations
2025-02-15 11:39:10 +08:00
yangdx
258c7596e6 fix: Improve file path handling and logging for document scanning
• Convert relative paths to absolute paths
• Add logging for file scanning progress
• Log total number of new files found
• Enhance file scanning feedback
• Improve path resolution safety
2025-02-14 12:50:43 +08:00
zrguo
4d58ff8bb4
Merge pull request #771 from enriquecatala/fix-litellm-litellm-proxy-support
Enable LiteLLM proxy with embedding_binding_host
2025-02-14 09:43:55 +08:00
Enrique Catalá
f9d69b889e ruff reformat 2025-02-14 00:16:59 +01:00
Enrique Catalá
0ece8e102d lint fix 2025-02-14 00:09:32 +01:00
Enrique Catalá
991fa33986 Enable LiteLLM proxy with embedding_binding_host 2025-02-13 22:45:03 +01:00
yangdx
35d6e2d322 Fix linting 2025-02-14 02:32:33 +08:00
yangdx
6f999aa5e5 Refactor file conversion to use async execution
- Wrap sync conversion in async function
- Use asyncio.to_thread for non-blocking IO
- Maintain same functionality as before
- Clean up temporary files properly
- Improve responsiveness of file processing
2025-02-14 02:31:58 +08:00
yangdx
cd3815e825 Fix linting 2025-02-14 01:14:12 +08:00
yangdx
08364e99fb Move document scanning trigger by command line to background task
- Added background task management
- Prevented concurrent scanning
- Tracked scanning progress
- Improved startup performance
- Enhanced error handling
2025-02-14 01:12:39 +08:00
yangdx
47268c2ab1 Fix linting 2025-02-13 21:01:34 +08:00
yangdx
e1d9dba20d Fix typos in documentation tree structure and storage implementation names
• Correct menu tree structure in splash screen
• Fix MilvusVectorDBStorage typo
• Update storage env requirements
2025-02-13 20:40:29 +08:00
zrguo
dea6f4f288
Merge branch 'main' into select-datastore-in-api-server 2025-02-13 20:03:38 +08:00
ArnoChen
464042f2c0 display webui and graph viewer links in splash screen 2025-02-13 18:03:09 +08:00
ArnoChen
bc83c4c7ed update readme
configure output directory
2025-02-13 17:54:10 +08:00
ArnoChen
c674905a98 use KnowledgeGraph typed dict for graph API response 2025-02-13 17:32:51 +08:00
ArnoChen
e4562c761c fix typo 2025-02-13 17:32:05 +08:00
yangdx
cdd52809b0 Fix linting 2025-02-13 14:07:36 +08:00
yangdx
28b17b327b Fix: top_k param handling error, unify top_k and cosine default value. 2025-02-13 06:05:21 +08:00
ArnoChen
c50c581767 Merge branch 'main' into graph-viewer-webui 2025-02-13 04:42:57 +08:00
yangdx
ed73ea4076 Fix linting 2025-02-13 04:12:00 +08:00
yangdx
d25386ff1b refactor: simplify storage configuration handling while maintaining the same functionality 2025-02-13 04:04:51 +08:00
yangdx
9a77d91023 Add LLM response cache to registered RagServer components 2025-02-13 01:30:21 +08:00
yangdx
4c39cf399d refactor: move database connection pool initialization to lifespan of FastAPI
- Add proper database connection lifecycle management
- Add connection pool cleanup in FastAPI lifespan
2025-02-13 01:11:09 +08:00
ArnoChen
9daab4340c add MongoDocStatusStorage
remove unnecessary logging

format
2025-02-12 04:13:48 +08:00
yangdx
aaddc08336 Add storage info to splash screen 2025-02-11 14:57:37 +08:00
yangdx
56c1792767 feat optimize storage configuration and environment variables
* add storage type compatibility validation table
* add enviroment variables check for storage
* modify storage init to get setting from confing.ini and env
2025-02-11 00:55:52 +08:00
ArnoChen
07f19b939c Merge branch 'main' into graph-viewer-webui 2025-02-10 13:56:25 +08:00
ArnoChen
09195182c2 enable MongoGraphStorage based on config
mongo graph
2025-02-10 01:07:41 +08:00
ArnoChen
294d094076 use "database" instead of "LightRAG" for MongoDB config 2025-02-10 01:00:02 +08:00
ArnoChen
c858e4a4e6 add qdrant backend 2025-02-10 00:57:28 +08:00
ArnoChen
1c7f918d8c format
format
2025-02-10 00:33:59 +08:00
ArnoChen
09ee968926 fix mount 2025-02-09 23:28:42 +08:00
ArnoChen
489d7f6c12 mount graph viewer webui in /webui endpoint 2025-02-09 23:17:30 +08:00
ArnoChen
c1d7fbe02b fix typo 2025-02-09 22:22:44 +08:00
ArnoChen
f974bf39bb format
format
2025-02-08 13:53:00 +08:00
ArnoChen
88d691deb9 add namespace prefix to storage namespaces 2025-02-08 13:53:00 +08:00
yangdx
070501fdaa Merge branch 'add-keyword-extraction-param-for-llm' into fix-mutable-default-param 2025-02-06 16:22:30 +08:00
yangdx
eb9883d8da fix: add keyword_extraction param support for LLM func of API Server 2025-02-06 15:56:18 +08:00
yangdx
eb5f57e989 fix: Fix potential mutable default parameter issue 2025-02-06 14:46:07 +08:00
yangdx
fd9b3b2658 Fix splash screen SSL line connector type. 2025-02-06 01:21:42 +08:00
yangdx
1a61d9ee7f Fix linting 2025-02-05 22:29:07 +08:00
yangdx
f703334ce4 Split the Ollama API implementation to a separated file 2025-02-05 22:15:14 +08:00
yangdx
f77faf8023 Fix linting 2025-02-05 12:36:52 +08:00
yangdx
4663dcfbab Merge branch 'main' into handle-stream-cancel-error 2025-02-05 12:27:05 +08:00
yangdx
f1ea7f7415 update error response format in streaming API to a normal message. So user can get what's going on. 2025-02-05 11:07:31 +08:00