415 Commits

Author SHA1 Message Date
yangdx
601df31edf feat: move query-related settings to env file for better configuration
• Add env vars for token and chunk settings
• Add token count logging for prompts
• Add token count logging for context
• Move hardcoded values to env variables
• Improve logging clarity and consistency
2025-02-16 19:26:57 +08:00
Yannick Stephan
eaf1d553d2 improved typing 2025-02-15 22:37:12 +01:00
Yannick Stephan
621540a54e cleaned code 2025-02-15 00:23:14 +01:00
Yannick Stephan
805da7b95b cleaned code 2025-02-15 00:02:24 +01:00
Yannick Stephan
7e526d3436 cleaned code 2025-02-14 23:52:05 +01:00
Yannick Stephan
e6520ad6a2 added typing 2025-02-14 23:49:39 +01:00
Yannick Stephan
cf6e327bf4 added type and cleaned code 2025-02-14 23:42:52 +01:00
Yannick Stephan
dfa8681924 code clean 2025-02-14 23:33:59 +01:00
Yannick Stephan
66f555677a cleaning the message and project no needed 2025-02-14 23:31:27 +01:00
Yannick Stephan
28c8443ff2 cleaning the mess 2025-02-14 22:50:49 +01:00
ArnoChen
a600beb619 implement MongoDB support for VectorDB storage. optimize existing MongoDB implementations 2025-02-15 00:38:41 +08:00
zrguo
6a5e92aeed
Merge pull request #769 from YanSte/fix-delete
Fixe the delete
2025-02-14 09:42:43 +08:00
zrguo
1841c8d536
Merge branch 'main' into fix-backends 2025-02-14 09:39:11 +08:00
Yannick Stephan
cf0b9ce6be fixed the delete 2025-02-13 20:52:33 +01:00
ArnoChen
0f12b400e4 disabled check_storage_env_vars
because the configurations of many backends can be read from the configuration file instead of environment variables.
2025-02-14 02:50:11 +08:00
ArnoChen
637e7efa83 add the missing MongoDocStatusStorage 2025-02-14 02:49:00 +08:00
yangdx
e1d9dba20d Fix typos in documentation tree structure and storage implementation names
• Correct menu tree structure in splash screen
• Fix MilvusVectorDBStorage typo
• Update storage env requirements
2025-02-13 20:40:29 +08:00
zrguo
dea6f4f288
Merge branch 'main' into select-datastore-in-api-server 2025-02-13 20:03:38 +08:00
ArnoChen
42d90f2b16 rename jsondocstatus to json_doc_status for consistency 2025-02-13 18:38:12 +08:00
ArnoChen
6896d4ab21 add pre-built graph viewer files
format

a

a
2025-02-13 18:05:50 +08:00
ArnoChen
c674905a98 use KnowledgeGraph typed dict for graph API response 2025-02-13 17:32:51 +08:00
ArnoChen
e4562c761c fix typo 2025-02-13 17:32:05 +08:00
yangdx
5ad3555f4c docs: add MongoDB storage support and improve storage client comment 2025-02-13 14:31:12 +08:00
yangdx
7017f114e1 Merge branch 'main' into select-datastore-in-api-server 2025-02-13 11:25:52 +08:00
ArnoChen
c50c581767 Merge branch 'main' into graph-viewer-webui 2025-02-13 04:42:57 +08:00
yangdx
ed73ea4076 Fix linting 2025-02-13 04:12:00 +08:00
yangdx
f01f57d0da refactor: make cosine similarity threshold a required config parameter
• Remove default threshold from env var
• Add validation for missing threshold
• Move default to lightrag.py config init
• Update all vector DB implementations
• Improve threshold validation consistency
2025-02-13 03:25:48 +08:00
yangdx
4c39cf399d refactor: move database connection pool initialization to lifespan of FastAPI
- Add proper database connection lifecycle management
- Add connection pool cleanup in FastAPI lifespan
2025-02-13 01:11:09 +08:00
yangdx
274cd73a8f refactor: improve storage initialization with named instances to aid logging
• Add storage names to instance list
• Use tuples to store name with instance
• Update type hints for storage instances
• Improve logging with actual storage names
• Clean up loop variable naming
2025-02-12 22:55:47 +08:00
yangdx
7b79427097 refactor: improve database initialization by centralizing db instance injection
- Move db configs to separate methods
- Remove db field defaults in storage classes
- Add _initialize_database_if_needed method
- Inject db instances during initialization
- Clean up storage implementation code
2025-02-12 22:25:34 +08:00
yangdx
cf61bed62c Reorganize env config sections, add data store config to env file.
• Add namespace prefix config option
• Make AGE graph name optional
• Update env variable requirements
• Add comments for deprecated options
2025-02-12 21:48:48 +08:00
yangdx
fc0f522ed5 Merge branch 'main' into select-datastore-in-api-server 2025-02-12 09:49:18 +08:00
ArnoChen
9daab4340c add MongoDocStatusStorage
remove unnecessary logging

format
2025-02-12 04:13:48 +08:00
ArnoChen
1af72b4ce9 Merge remote-tracking branch 'origin/main' into graph-viewer-webui 2025-02-11 22:52:01 +08:00
zrguo
a272c7b3f7
Merge pull request #741 from Brenon28/fix-update-doc-status-postgresql
fix(postgres): update document status with partial update instead of …
2025-02-11 22:14:52 +08:00
ArnoChen
bd7d4c0b17 Merge branch 'main' into graph-viewer-webui 2025-02-11 17:34:25 +08:00
yangdx
afb5272816 Fix type and class name in doc status storage class assignment
• Corrected PGDocStatusStorage class name
• Fixed db assignment to class not instance
• Fixed incorrect Oracle reference
2025-02-11 17:07:53 +08:00
zrguo
2d2ed19095 Fix cache bugs 2025-02-11 13:28:18 +08:00
yangdx
14fd89c168 Remove storage class method check 2025-02-11 12:05:37 +08:00
yangdx
0e660d4000 Fix doc_status error 2025-02-11 10:17:51 +08:00
yangdx
f20a164467 Translate Chinese comments to English 2025-02-11 05:22:40 +08:00
yangdx
17abd214a2 Fix linting 2025-02-11 05:18:09 +08:00
yangdx
1f7990646e update storage environment requirements for TiDB and Oracle
• Changed TiDB URI to user/password
• Added Oracle config dir requirement
• Fixed Oracle DSN naming
• Fixed extra comma in Oracle Graph config
• Made env vars more explicit
2025-02-11 04:42:10 +08:00
yangdx
c5c606f491 Inject TiDB同LightRAG storage when needed 2025-02-11 04:27:45 +08:00
yangdx
5408e7ea02 Add table existence check for Oracle and PostgreSQL DB initialization
• Add Oracle table check on startup
• Add PostgreSQL table check on startup
• Use event loop for async DB operations
• Ensure tables exist before DB operations
2025-02-11 04:19:12 +08:00
yangdx
7ec769456c Inject Postgres to LightRag storage class when needed 2025-02-11 03:55:15 +08:00
yangdx
a4cf7e66d3 Inject oracle db to LightRag storage class when needed 2025-02-11 03:54:54 +08:00
Yannick Stephan
4c2f13f79e improved docs 2025-02-10 19:57:55 +01:00
yangdx
56c1792767 feat optimize storage configuration and environment variables
* add storage type compatibility validation table
* add enviroment variables check for storage
* modify storage init to get setting from confing.ini and env
2025-02-11 00:55:52 +08:00
Brenon
4723e9b535 fix(postgres): update document status with partial update instead of full upsert 2025-02-10 15:05:44 +03:00