183 Commits

Author SHA1 Message Date
yangdx
f01f57d0da refactor: make cosine similarity threshold a required config parameter
• Remove default threshold from env var
• Add validation for missing threshold
• Move default to lightrag.py config init
• Update all vector DB implementations
• Improve threshold validation consistency
2025-02-13 03:25:48 +08:00
yangdx
4c39cf399d refactor: move database connection pool initialization to lifespan of FastAPI
- Add proper database connection lifecycle management
- Add connection pool cleanup in FastAPI lifespan
2025-02-13 01:11:09 +08:00
yangdx
274cd73a8f refactor: improve storage initialization with named instances to aid logging
• Add storage names to instance list
• Use tuples to store name with instance
• Update type hints for storage instances
• Improve logging with actual storage names
• Clean up loop variable naming
2025-02-12 22:55:47 +08:00
yangdx
7b79427097 refactor: improve database initialization by centralizing db instance injection
- Move db configs to separate methods
- Remove db field defaults in storage classes
- Add _initialize_database_if_needed method
- Inject db instances during initialization
- Clean up storage implementation code
2025-02-12 22:25:34 +08:00
yangdx
cf61bed62c Reorganize env config sections, add data store config to env file.
• Add namespace prefix config option
• Make AGE graph name optional
• Update env variable requirements
• Add comments for deprecated options
2025-02-12 21:48:48 +08:00
yangdx
fc0f522ed5 Merge branch 'main' into select-datastore-in-api-server 2025-02-12 09:49:18 +08:00
zrguo
a272c7b3f7
Merge pull request #741 from Brenon28/fix-update-doc-status-postgresql
fix(postgres): update document status with partial update instead of …
2025-02-11 22:14:52 +08:00
yangdx
afb5272816 Fix type and class name in doc status storage class assignment
• Corrected PGDocStatusStorage class name
• Fixed db assignment to class not instance
• Fixed incorrect Oracle reference
2025-02-11 17:07:53 +08:00
zrguo
2d2ed19095 Fix cache bugs 2025-02-11 13:28:18 +08:00
yangdx
14fd89c168 Remove storage class method check 2025-02-11 12:05:37 +08:00
yangdx
0e660d4000 Fix doc_status error 2025-02-11 10:17:51 +08:00
yangdx
f20a164467 Translate Chinese comments to English 2025-02-11 05:22:40 +08:00
yangdx
17abd214a2 Fix linting 2025-02-11 05:18:09 +08:00
yangdx
1f7990646e update storage environment requirements for TiDB and Oracle
• Changed TiDB URI to user/password
• Added Oracle config dir requirement
• Fixed Oracle DSN naming
• Fixed extra comma in Oracle Graph config
• Made env vars more explicit
2025-02-11 04:42:10 +08:00
yangdx
c5c606f491 Inject TiDB同LightRAG storage when needed 2025-02-11 04:27:45 +08:00
yangdx
5408e7ea02 Add table existence check for Oracle and PostgreSQL DB initialization
• Add Oracle table check on startup
• Add PostgreSQL table check on startup
• Use event loop for async DB operations
• Ensure tables exist before DB operations
2025-02-11 04:19:12 +08:00
yangdx
7ec769456c Inject Postgres to LightRag storage class when needed 2025-02-11 03:55:15 +08:00
yangdx
a4cf7e66d3 Inject oracle db to LightRag storage class when needed 2025-02-11 03:54:54 +08:00
Yannick Stephan
4c2f13f79e improved docs 2025-02-10 19:57:55 +01:00
yangdx
56c1792767 feat optimize storage configuration and environment variables
* add storage type compatibility validation table
* add enviroment variables check for storage
* modify storage init to get setting from confing.ini and env
2025-02-11 00:55:52 +08:00
Brenon
4723e9b535 fix(postgres): update document status with partial update instead of full upsert 2025-02-10 15:05:44 +03:00
zrguo
ad8349aff5
Merge pull request #738 from ArnoChenFx/qdrant-backend
add qdrant backend, enable MongoGraphStorage based on config
2025-02-10 13:55:15 +08:00
Yannick Stephan
bfd280450a cleaned code 2025-02-09 21:48:19 +01:00
Yannick Stephan
a47e09c69e improving ainsert_custom_chunks paralelism 2025-02-09 21:42:04 +01:00
Yannick Stephan
07f31606d2 cleaned code 2025-02-09 21:34:38 +01:00
Yannick Stephan
f37f2c7555 improved parallele 2025-02-09 21:17:09 +01:00
Yannick Stephan
068924b59f updated type 2025-02-09 21:12:39 +01:00
Yannick Stephan
3e49ced307 Improved paralle 2025-02-09 21:03:14 +01:00
Yannick Stephan
2b99637584 improved paralle 2025-02-09 20:41:18 +01:00
Yannick Stephan
5e3100221c cleaned code 2025-02-09 20:18:38 +01:00
Yannick Stephan
07e3d2b24f fixed typo 2025-02-09 20:11:35 +01:00
Yannick Stephan
d70d7ff20e added at call check 2025-02-09 20:05:59 +01:00
Yannick Stephan
62115b836f cleaned set 2025-02-09 20:03:15 +01:00
Yannick Stephan
55cfb4dab1 fixed typo 2025-02-09 19:24:41 +01:00
Yannick Stephan
7d63898015 fixed bugs 2025-02-09 19:21:49 +01:00
ArnoChen
c858e4a4e6 add qdrant backend 2025-02-10 00:57:28 +08:00
Yannick Stephan
93717e6705 cleaned code 2025-02-09 15:36:01 +01:00
Yannick Stephan
c36c6743d6 cleaned code 2025-02-09 15:25:58 +01:00
Yannick Stephan
1949c4a2c6 improved get status 2025-02-09 15:24:52 +01:00
Yannick Stephan
82481ecf28 cleaned code 2025-02-09 14:55:52 +01:00
Yannick Stephan
58d776561d cleaned docs 2025-02-09 14:39:32 +01:00
Yannick Stephan
abcdcd5a73 cleaned docs 2025-02-09 14:36:49 +01:00
Yannick Stephan
37943a65a3 cleaned code 2025-02-09 14:36:00 +01:00
Yannick Stephan
f8779cb193 updated naming 2025-02-09 14:32:48 +01:00
Yannick Stephan
5faae81417 simplified process 2025-02-09 14:24:35 +01:00
Yannick Stephan
6a4a77bfe9 make more clear 2025-02-09 14:11:11 +01:00
Yannick Stephan
1c7d14ef76 updated the pipe 2025-02-09 13:54:04 +01:00
Yannick Stephan
acbe3e2ff2 cleaned code 2025-02-09 13:18:47 +01:00
Yannick Stephan
263a301179 fixed filtering 2025-02-09 13:16:21 +01:00
Yannick Stephan
bf89dc18b7 fixed the processed 2025-02-09 13:03:50 +01:00