445 Commits

Author SHA1 Message Date
ArnoChen
c674905a98 use KnowledgeGraph typed dict for graph API response 2025-02-13 17:32:51 +08:00
ArnoChen
e4562c761c fix typo 2025-02-13 17:32:05 +08:00
yangdx
5ad3555f4c docs: add MongoDB storage support and improve storage client comment 2025-02-13 14:31:12 +08:00
yangdx
7017f114e1 Merge branch 'main' into select-datastore-in-api-server 2025-02-13 11:25:52 +08:00
ArnoChen
c50c581767 Merge branch 'main' into graph-viewer-webui 2025-02-13 04:42:57 +08:00
yangdx
ed73ea4076 Fix linting 2025-02-13 04:12:00 +08:00
yangdx
f01f57d0da refactor: make cosine similarity threshold a required config parameter
• Remove default threshold from env var
• Add validation for missing threshold
• Move default to lightrag.py config init
• Update all vector DB implementations
• Improve threshold validation consistency
2025-02-13 03:25:48 +08:00
yangdx
4c39cf399d refactor: move database connection pool initialization to lifespan of FastAPI
- Add proper database connection lifecycle management
- Add connection pool cleanup in FastAPI lifespan
2025-02-13 01:11:09 +08:00
yangdx
274cd73a8f refactor: improve storage initialization with named instances to aid logging
• Add storage names to instance list
• Use tuples to store name with instance
• Update type hints for storage instances
• Improve logging with actual storage names
• Clean up loop variable naming
2025-02-12 22:55:47 +08:00
yangdx
7b79427097 refactor: improve database initialization by centralizing db instance injection
- Move db configs to separate methods
- Remove db field defaults in storage classes
- Add _initialize_database_if_needed method
- Inject db instances during initialization
- Clean up storage implementation code
2025-02-12 22:25:34 +08:00
yangdx
cf61bed62c Reorganize env config sections, add data store config to env file.
• Add namespace prefix config option
• Make AGE graph name optional
• Update env variable requirements
• Add comments for deprecated options
2025-02-12 21:48:48 +08:00
yangdx
fc0f522ed5 Merge branch 'main' into select-datastore-in-api-server 2025-02-12 09:49:18 +08:00
ArnoChen
9daab4340c add MongoDocStatusStorage
remove unnecessary logging

format
2025-02-12 04:13:48 +08:00
ArnoChen
1af72b4ce9 Merge remote-tracking branch 'origin/main' into graph-viewer-webui 2025-02-11 22:52:01 +08:00
zrguo
a272c7b3f7
Merge pull request #741 from Brenon28/fix-update-doc-status-postgresql
fix(postgres): update document status with partial update instead of …
2025-02-11 22:14:52 +08:00
ArnoChen
bd7d4c0b17 Merge branch 'main' into graph-viewer-webui 2025-02-11 17:34:25 +08:00
yangdx
afb5272816 Fix type and class name in doc status storage class assignment
• Corrected PGDocStatusStorage class name
• Fixed db assignment to class not instance
• Fixed incorrect Oracle reference
2025-02-11 17:07:53 +08:00
zrguo
2d2ed19095 Fix cache bugs 2025-02-11 13:28:18 +08:00
yangdx
14fd89c168 Remove storage class method check 2025-02-11 12:05:37 +08:00
yangdx
0e660d4000 Fix doc_status error 2025-02-11 10:17:51 +08:00
yangdx
f20a164467 Translate Chinese comments to English 2025-02-11 05:22:40 +08:00
yangdx
17abd214a2 Fix linting 2025-02-11 05:18:09 +08:00
yangdx
1f7990646e update storage environment requirements for TiDB and Oracle
• Changed TiDB URI to user/password
• Added Oracle config dir requirement
• Fixed Oracle DSN naming
• Fixed extra comma in Oracle Graph config
• Made env vars more explicit
2025-02-11 04:42:10 +08:00
yangdx
c5c606f491 Inject TiDB同LightRAG storage when needed 2025-02-11 04:27:45 +08:00
yangdx
5408e7ea02 Add table existence check for Oracle and PostgreSQL DB initialization
• Add Oracle table check on startup
• Add PostgreSQL table check on startup
• Use event loop for async DB operations
• Ensure tables exist before DB operations
2025-02-11 04:19:12 +08:00
yangdx
7ec769456c Inject Postgres to LightRag storage class when needed 2025-02-11 03:55:15 +08:00
yangdx
a4cf7e66d3 Inject oracle db to LightRag storage class when needed 2025-02-11 03:54:54 +08:00
Yannick Stephan
4c2f13f79e improved docs 2025-02-10 19:57:55 +01:00
yangdx
56c1792767 feat optimize storage configuration and environment variables
* add storage type compatibility validation table
* add enviroment variables check for storage
* modify storage init to get setting from confing.ini and env
2025-02-11 00:55:52 +08:00
Brenon
4723e9b535 fix(postgres): update document status with partial update instead of full upsert 2025-02-10 15:05:44 +03:00
ArnoChen
07f19b939c Merge branch 'main' into graph-viewer-webui 2025-02-10 13:56:25 +08:00
zrguo
ad8349aff5
Merge pull request #738 from ArnoChenFx/qdrant-backend
add qdrant backend, enable MongoGraphStorage based on config
2025-02-10 13:55:15 +08:00
Yannick Stephan
bfd280450a cleaned code 2025-02-09 21:48:19 +01:00
Yannick Stephan
a47e09c69e improving ainsert_custom_chunks paralelism 2025-02-09 21:42:04 +01:00
Yannick Stephan
07f31606d2 cleaned code 2025-02-09 21:34:38 +01:00
Yannick Stephan
f37f2c7555 improved parallele 2025-02-09 21:17:09 +01:00
Yannick Stephan
068924b59f updated type 2025-02-09 21:12:39 +01:00
Yannick Stephan
3e49ced307 Improved paralle 2025-02-09 21:03:14 +01:00
Yannick Stephan
2b99637584 improved paralle 2025-02-09 20:41:18 +01:00
Yannick Stephan
5e3100221c cleaned code 2025-02-09 20:18:38 +01:00
Yannick Stephan
07e3d2b24f fixed typo 2025-02-09 20:11:35 +01:00
Yannick Stephan
d70d7ff20e added at call check 2025-02-09 20:05:59 +01:00
Yannick Stephan
62115b836f cleaned set 2025-02-09 20:03:15 +01:00
Yannick Stephan
55cfb4dab1 fixed typo 2025-02-09 19:24:41 +01:00
Yannick Stephan
7d63898015 fixed bugs 2025-02-09 19:21:49 +01:00
ArnoChen
c858e4a4e6 add qdrant backend 2025-02-10 00:57:28 +08:00
ArnoChen
a62f2b382b Merge branch 'main' into graph-viewer-webui 2025-02-10 00:54:05 +08:00
Yannick Stephan
93717e6705 cleaned code 2025-02-09 15:36:01 +01:00
Yannick Stephan
c36c6743d6 cleaned code 2025-02-09 15:25:58 +01:00
Yannick Stephan
1949c4a2c6 improved get status 2025-02-09 15:24:52 +01:00