208 Commits

Author SHA1 Message Date
Daniel.y
0277c94a61
Merge pull request #1091 from JoramMillenaar/quickfix--small-db-fields
Updated PSQL's chunk_id field to be a TEXT field
2025-03-16 22:48:54 +08:00
Daniel.y
9d971e5889
Merge pull request #1062 from ericshao/fix-postgres
Fix PGDocStatusStorage content extraction for DocProcessingStatus
2025-03-16 15:47:32 +08:00
jofoks
912e70feb1 Updated chunk_id field to be a TEXT field 2025-03-14 11:03:28 -07:00
jofoks
edc95126de Fixed some query parsing issues 2025-03-13 11:30:52 -07:00
Mykola Chaban
ceae2eb92d fixed issue with convert the age query to the dictionary;
refactored solution of storing chunk ids;
2025-03-13 13:45:09 +02:00
Eric Shao
01f60d5a4d 修复 PGDocStatusStorage 中的内容提取错误 2025-03-12 07:47:21 +08:00
zrguo
c26cb3a9ea fix merge bugs 2025-03-11 16:05:04 +08:00
Roy
92ae895713 Refactor requirements and code formatting
- Simplified requirements.txt by removing specific version constraints
- Added comment about extra library installation using pipmaster
- Improved code formatting in base.py, operate.py, and postgres_impl.py
- Cleaned up SQL templates and query method signatures with consistent formatting
2025-03-10 15:39:18 +00:00
Roy
04fdc617bb main_merge 2025-03-08 20:34:29 +00:00
Roy
e31c0c8f6c Update vector query methods to support ID filtering in PostgreSQL
- Modified `mix_kg_vector_query` in operate.py to pass optional IDs to vector search
- Updated PostgreSQL SQL template to filter results using document IDs instead of chunk_id
- Improved query flexibility by allowing precise document selection during vector search
2025-03-08 20:25:20 +00:00
Roy
528fb11364 Refactor vector query methods to support optional ID filtering
- Updated BaseVectorStorage query method signature to accept optional IDs
- Modified operate.py to pass query parameter IDs to vector storage queries
- Updated PostgreSQL vector storage SQL templates to filter results by document IDs
- Removed unused parameters and simplified query logic across multiple files
2025-03-08 15:43:17 +00:00
Samuel Chan
b7f67eda21 fix the postgres get all labels and get knowledge graph 2025-03-08 11:45:59 +08:00
Roy
bbe139cfeb Enhance PostgreSQL vector storage with chunk_id support
- Updated SQL templates for entity and relationship upsert to include chunk_id
- Modified PGVectorStorage methods to add chunk_id when inserting or updating records
- Expanded database schema to track chunk-level metadata
2025-03-07 20:18:01 +00:00
Roy
0ec61d6407 Update project dependencies and example test files
- Updated requirements.txt with latest package versions
- Added support for filtering query results by IDs in base and operate modules
- Modified PostgreSQL vector storage to include document and chunk ID fields
2025-03-07 18:45:28 +00:00
zrguo
e822f35c89 Fix edit entity and relation bugs 2025-03-07 14:39:06 +08:00
zrguo
81568f3bad fix linting 2025-03-04 15:53:20 +08:00
zrguo
3a2a636862 Implement the missing methods. 2025-03-04 15:50:53 +08:00
yangdx
e3a40c2fdb Fix linting 2025-03-01 16:23:34 +08:00
yangdx
d18eb52ccc Add type ignore comments for asyncpg imports to suppress mypy errors 2025-03-01 15:38:39 +08:00
Samuel Chan
60ad8ccf12 Add support to namespace_prefix 2025-02-21 22:48:23 +08:00
Yannick Stephan
678e0f9aea
Revert "Cleanup of code" 2025-02-20 15:09:43 +01:00
Yannick Stephan
439685e69c
Revert "removed get_knowledge_graph" 2025-02-20 14:29:36 +01:00
Yannick Stephan
32d0f1acb0 added docs and fields 2025-02-20 13:09:33 +01:00
Yannick Stephan
9f2c659d9c remove unused log 2025-02-20 12:54:14 +01:00
Yannick Stephan
cedb5f3975
Merge pull request #886 from YanSte/clean-2
removed get_knowledge_graph
2025-02-19 22:59:10 +01:00
Yannick Stephan
89c35c82c7 removed get_knowledge_graph 2025-02-19 22:57:46 +01:00
Yannick Stephan
4978379b9c
Merge pull request #885 from YanSte/remove-unsused
Cleanup of code
2025-02-19 22:54:58 +01:00
Yannick Stephan
eb3306f34c cleanup 2025-02-19 22:52:49 +01:00
Yannick Stephan
48a1ad9b3b
Merge pull request #883 from YanSte/fix-return-none
Optimised returns
2025-02-19 22:24:50 +01:00
Yannick Stephan
9277fe8c29 fixed return 2025-02-19 22:22:41 +01:00
Saifeddine ALOUI
45ee4dd08c fixed linting 2025-02-19 20:50:39 +01:00
Saifeddine ALOUI
521dbf2be1
Update postgres_impl.py 2025-02-19 19:50:46 +01:00
Yannick Stephan
ad07f22cc8 back age 2025-02-19 15:09:41 +01:00
Yannick Stephan
48377d91ef back age 2025-02-19 14:26:46 +01:00
Yannick Stephan
fc151e5866 cleaned code 2025-02-19 13:54:27 +01:00
Yannick Stephan
4adb4418fd cleaned code 2025-02-19 13:42:49 +01:00
Yannick Stephan
05147f4799 improved code of postgress and execution 2025-02-19 13:31:30 +01:00
Yannick Stephan
ccb117e1c6
Merge pull request #846 from ArnoChenFx/db-connection-and-storage-lifecycle
Refactor Database Connection Management and Improve Storage Lifecycle Handling
2025-02-18 22:39:31 +01:00
ArnoChen
bfc548edf2 change init=False to default=None for db fields to prevent no attribute error 2025-02-19 04:55:59 +08:00
ArnoChen
f50604b2d3 improve conditional checks for db instance 2025-02-19 04:53:15 +08:00
ArnoChen
e194e04226 refactor database connection management and improve storage lifecycle handling
update
2025-02-19 03:49:05 +08:00
Yannick Stephan
2524e02428 remove tqdm and cleaned readme and ollama 2025-02-18 19:58:03 +01:00
Yannick Stephan
46e1865b98 cleanup code 2025-02-18 16:58:11 +01:00
Saifeddine ALOUI
f7ef4c7ee8
Update postgres_impl.py 2025-02-18 16:10:26 +01:00
Saifeddine ALOUI
b4e0c47607
Update postgres_impl.py 2025-02-18 10:29:07 +01:00
Saifeddine ALOUI
fec7889458
Update postgres_impl.py 2025-02-18 10:27:38 +01:00
Saifeddine ALOUI
9b9f989160
Update postgres_impl.py 2025-02-18 10:24:19 +01:00
Saifeddine ALOUI
a15d164d87
Update postgres_impl.py 2025-02-18 10:16:00 +01:00
Saifeddine ALOUI
941c89521c
Debug 2025-02-18 10:12:08 +01:00
Saifeddine ALOUI
becf76a528
Debuggging 2025-02-18 10:07:57 +01:00