yangdx
810676d54c
Fix faisss import error
2025-07-04 19:12:23 +08:00
yangdx
531502677e
fix: Use create_time when update_time is 0 in PGKVStorage queries
2025-07-03 23:38:53 +08:00
yangdx
3355a0ce95
Fix create_time conflict in MongoKVStorage updates
2025-07-03 22:58:08 +08:00
yangdx
04d793abbd
Update logger message
2025-07-03 22:15:32 +08:00
yangdx
67f51597c2
Bump api version to 0178
2025-07-03 21:37:47 +08:00
yangdx
05231233f1
Feat: Check pending equest_pending after document deletion
...
- Add double-check for pipeline status to prevent race conditions
- Implement automatic processing of pending indexing requests after deletion
2025-07-03 21:36:35 +08:00
yangdx
6c2ae40d7d
Refac: Enhance KG rebuild stability by incorporating create_time into the LLM cache
2025-07-03 17:08:29 +08:00
yangdx
a9e10ae810
Update logger messages
2025-07-03 14:08:19 +08:00
yangdx
6b6d14bc3a
fix: Deduplicate entities and relationships in a single chunk with multiple gleaning results during KG rebuild
2025-07-03 13:47:52 +08:00
yangdx
70e154b0aa
Fix linting
2025-07-03 12:26:05 +08:00
yangdx
ff1b1c61c7
Implemented storage types: PostgreSQL and MongoDB
2025-07-03 11:46:24 +08:00
yangdx
e56734cb8b
Refac: Optimize document deletion performance
...
- Adding chunks_list to dock_status
- Adding llm_cache_list to text_chunks
- Implemented storage types: JsonKV and Redis
2025-07-03 04:18:25 +08:00
Daniel.y
d0f04383cc
Merge pull request #1729 from danielaskdd/refac-kv-cache
...
feat: Flatten LLM cache structure for improved recall efficiency
2025-07-02 16:36:45 +08:00
yangdx
3be8727e3e
Bump api version to 0177
2025-07-02 16:35:22 +08:00
yangdx
86c9a0cda2
Fix linting
2025-07-02 16:29:43 +08:00
yangdx
271722405f
feat: Flatten LLM cache structure for improved recall efficiency
...
Refactored the LLM cache to a flat Key-Value (KV) structure, replacing the previous nested format. The old structure used the 'mode' as a key and stored specific cache content as JSON nested under it. This change significantly enhances cache recall efficiency.
2025-07-02 16:11:53 +08:00
zrguo
479865a271
Add max_gleaning to env
2025-07-01 17:13:33 +08:00
SLKun
4e88ee3662
update ollama compatible api
2025-06-30 10:41:35 +08:00
yangdx
4c2b4b4b6b
Revert "Fix LLM cache handling for Redis to address document deletion scenarios."
...
This reverts commit 14cda93988dc110c11cf1fe8286ded7b5db7b8fb.
2025-06-29 22:35:40 +08:00
yangdx
10cd9c90e7
Revert "Fix linting"
...
This reverts commit abd9de2a63b39021320855fab9f5c3b332dee162.
2025-06-29 22:35:26 +08:00
yangdx
75ea0bc38d
Remove default get_nodes_by_chunk_ids implementation
...
- Deletes inefficient default implementation
- Makes method purely abstract
2025-06-29 22:05:48 +08:00
yangdx
e70f5a35e5
Refac: Add KG rebuild logging with pipeline status
...
- Logs detailed progress, including warnings and failures, to the pipeline status.
- Adds counters to report the total number of successfully rebuilt entities and relationships upon completion.
2025-06-29 21:27:12 +08:00
yangdx
abd9de2a63
Fix linting
2025-06-29 15:15:49 +08:00
yangdx
14cda93988
Fix LLM cache handling for Redis to address document deletion scenarios.
...
- Implements bulk scan for "extract" cache entries
- Maintains backward compatibility for normal IDs
2025-06-29 15:13:42 +08:00
yangdx
e2824b721e
Fix LLM cache handling for MongoKVStorage to address document deletion scenarios.
...
- Support fetching all "default_" prefixed documents
- Maintain original behavior for other IDs
- Return dictionary of documents for "default"
- Keep backward compatibility
2025-06-29 15:03:57 +08:00
yangdx
37bf341a69
Fix LLM cache handling for PGKVStorage to address document deletion scenarios.
...
- Add dynamic cache_type field
- Support mode parameter for LLM cache
- Maintain backward compatibility
2025-06-29 14:39:50 +08:00
Moddy Surala
319d12bb6a
Fix GRAPH_FIELD_SEP import typo
2025-06-29 01:28:39 +05:00
yangdx
6d5e73a251
Merge branch 'kenspirit/main'
2025-06-29 00:30:58 +08:00
yangdx
28aedd8b3c
Update comments
2025-06-29 00:30:39 +08:00
Ken Chen
4a953d6829
As Graph edges should be treated undirectional, fix incorrect upsert_edge method in MongoDBGraph
2025-06-28 21:03:54 +08:00
Ken Chen
5116d61eaa
As Graph edges should be treated undirectional, fix incorrect has_edge method in MongoDBGraph
2025-06-28 20:48:30 +08:00
Ken Chen
73cc86662a
Add two BFS subgraph search support for MongoDBGraph
2025-06-28 20:00:13 +08:00
yangdx
8522bfc9dc
Optimied logger info
2025-06-28 19:27:36 +08:00
Ken Chen
5739f52d29
Rewrite get_knowledge_graph with label * by degree
2025-06-28 17:10:39 +08:00
Ken Chen
d0f4eee404
Fix accidentally hardcoded edge collection name in searching upstream nodes
2025-06-28 16:25:44 +08:00
yangdx
b7f8c20e61
fix(postgres): use correct table for vector queries
...
Change SQL templates from LIGHTRAG_DOC_CHUNKS to LIGHTRAG_VDB_CHUNKS
to fix "content_vector does not exist" error in vector operations.
2025-06-28 15:36:54 +08:00
yangdx
2c47367975
Fix linting
2025-06-28 14:37:55 +08:00
yangdx
95c7a7d038
feat(db): Add data migration from LIGHTRAG_DOC_CHUNKS to LIGHTRAG_VDB_CHUNKS
2025-06-28 14:37:47 +08:00
yangdx
3a8a99b73d
feat(postgres): Implement text_chunks upsert for PGKVStorage
2025-06-28 14:37:35 +08:00
Ken Chen
6574dfb7ea
Fix accidentally hardcode max depth in searching upstream nodes
2025-06-28 11:40:39 +08:00
Ken Chen
b586bdc02f
Fix accidentally hardcode label in searching upstream nodes
2025-06-28 10:50:56 +08:00
yangdx
0f51ec48f1
fix: streaming error when only_need_context=True returns empty results
...
Prevents NoneType async iteration error by handling None responses
in stream_generator and ensuring kg_query returns valid strings.
2025-06-28 09:18:06 +08:00
Ken Chen
7c8f65d020
Add search on neighbor nodes which are source to selected one
2025-06-28 08:50:32 +08:00
yangdx
a506753548
Fix linting
2025-06-27 02:33:20 +08:00
yangdx
60777d535b
fix: prevent Path Traversal vulnerability in upload endpoint
...
- Add sanitize_filename() function to validate and clean uploaded filenames
- Remove path separators, traversal sequences, and control characters
- Verify final paths stay within input directory using Path.resolve()
- Return HTTP 400 errors for unsafe filenames
- Prevents directory traversal attacks like ../../../etc/passwd
2025-06-27 02:33:05 +08:00
yangdx
44daf51501
Fix edge_degree to handle non-existent nodes
2025-06-27 01:37:10 +08:00
Ken Chen
f40bc43d5e
Fix nodes & edges are missing when retrieving knowledge subgraph by selecting particular node_id
2025-06-26 23:11:31 +08:00
Daniel.y
c740401b7f
Merge pull request #1654 from a-bruhn/azure-env-vars
...
Clean up azure env vars
2025-06-26 19:11:20 +08:00
yangdx
6e1ca8f461
Merge branch 'patch-1'
2025-06-26 18:45:23 +08:00
yangdx
fb3006b44d
Update requirements.txt
2025-06-26 18:45:01 +08:00
