4231 Commits

Author SHA1 Message Date
zrguo
3ead0489b8 Remove "rank", "weight", "keywords" 2025-07-15 21:47:33 +08:00
zrguo
1541034816 Add DEFAULT_RELATED_CHUNK_NUMBER 2025-07-15 21:35:12 +08:00
zrguo
42f1fd60f4 Update operate.py 2025-07-15 18:59:52 +08:00
zrguo
29e82723e6 Update operate.py 2025-07-15 18:57:57 +08:00
yangdx
93b25a65d5 Update webui assets 2025-07-15 18:10:00 +08:00
yangdx
bdcb280731 Merge branch 'main' into rerank 2025-07-15 18:09:01 +08:00
yangdx
6d66cde4ac Reorder query settings in web UI 2025-07-15 18:06:00 +08:00
zrguo
e254c3dd81 Update openai.py 2025-07-15 17:30:30 +08:00
yangdx
661a41f9eb Update webui assets 2025-07-15 17:25:39 +08:00
yangdx
1927cb2685 Fix linting 2025-07-15 17:24:57 +08:00
yangdx
7735970a3b Keep old query settings untouched 2025-07-15 17:24:13 +08:00
yangdx
26865c2cd0 Update env.example 2025-07-15 17:08:23 +08:00
yangdx
47341d3a71 Merge branch 'main' into rerank 2025-07-15 16:12:33 +08:00
yangdx
e8e1f6ab56 feat: centralize environment variable defaults in constants.py 2025-07-15 16:11:50 +08:00
Daniel.y
6d1260aafa
Merge pull request #1766 from HKUDS/fix-memgraph-max-nodes-issue
Fix Memgraph get_knowledge_graph issues
2025-07-15 16:07:04 +08:00
Daniel.y
aa638fb94d
Merge pull request #1783 from danielaskdd/remove-max-token-summary
feat: remove deprecated MAX_TOKEN_SUMMARY parameter to prevent LLM output truncation
2025-07-15 16:04:25 +08:00
zrguo
91d0f65476 Update QueryParam 2025-07-15 14:21:58 +08:00
yangdx
3da9f8aab4 Fix logging output condition in shared_storage.py. Early return if logging disabled 2025-07-15 13:38:05 +08:00
yangdx
ccc2a20071 feat: remove deprecated MAX_TOKEN_SUMMARY parameter to prevent LLM output truncation
- Remove MAX_TOKEN_SUMMARY parameter and related configurations
- Eliminate forced token-based truncation in entity/relationship descriptions
- Switch to fragment-count based summarization logic using FORCE_LLM_SUMMARY_ON_MERGE
- Update FORCE_LLM_SUMMARY_ON_MERGE default from 6 to 4 for better summarization
- Clean up documentation, environment examples, and API display code
- Preserve backward compatibility by graceful parameter removal

This change resolves issues where LLMs were forcibly truncating entity relationship
descriptions mid-sentence, leading to incomplete and potentially inaccurate knowledge
graph content. The new approach allows LLMs to generate complete descriptions while
still providing summarization when multiple fragments need to be merged.

Breaking Change: None - parameter removal is backward compatible
Fixes: Entity relationship description truncation issues
2025-07-15 12:26:33 +08:00
zrguo
9a9f0f2463 Update rerank_example & readme 2025-07-15 12:17:27 +08:00
zrguo
7c882313bb remove chunk_rerank_top_k 2025-07-15 11:52:34 +08:00
zrguo
86a0a4872e Update operate.py 2025-07-15 10:56:48 +08:00
DavIvek
2914b21b34 remove unused query parameter 2025-07-14 16:25:58 +02:00
DavIvek
9beb2456ec update subgraph query comment 2025-07-14 16:25:17 +02:00
DavIvek
45815f1eae remove redundant UNWIND 2025-07-14 15:39:39 +02:00
DavIvek
593ce552af run pre-commit 2025-07-14 14:26:39 +02:00
DavIvek
f961f1aa7d remove fallback query 2025-07-14 14:26:23 +02:00
DavIvek
81c93f6950 dont use mage procedure 2025-07-14 14:16:20 +02:00
zrguo
7edf087baa Update operate.py 2025-07-14 18:43:22 +08:00
yangdx
541653ef6d Merge branch 'main' into rerank 2025-07-14 18:11:11 +08:00
yangdx
9afe578fe7 Update webui assets 2025-07-14 17:56:51 +08:00
zrguo
c2da2fbe12 build 2025-07-14 17:19:28 +08:00
Daniel.y
1a760870df
Merge pull request #1765 from bun781/main
Add Cloudflare Workers AI support for serverless LLM/embedding
2025-07-14 17:15:58 +08:00
zrguo
2d7f87e936 Update settings.ts 2025-07-14 16:39:42 +08:00
zrguo
bbd91d3a18 Update operate.py 2025-07-14 16:37:25 +08:00
zrguo
4e425b1b59 Revert "update from main"
This reverts commit 1d0376d6a926ef60d641af4406dacf5b8bbb430f.
2025-07-14 16:29:00 +08:00
zrguo
1d0376d6a9 update from main 2025-07-14 16:27:49 +08:00
zrguo
c9cbd2d3e0 Merge branch 'main' into rerank 2025-07-14 16:24:29 +08:00
zrguo
ef2115d437 Update token limit 2025-07-14 15:53:48 +08:00
Daniel.y
e943591e68
Merge pull request #1779 from danielaskdd/fix-postgres-timezone
Fix: Resolve timezone handling problem in PostgreSQL storage
2025-07-14 04:20:38 +08:00
yangdx
7e988158a9 Fix: Resolve timezone handling problem in PostgreSQL storage
- Changed timestamp columns to naive UTC
- Added datetime formatting utilities
- Updated SQL templates for timestamp extraction
- Simplified timestamp migration logic
2025-07-14 04:12:52 +08:00
al1kss
e44e7296b2 fix: apply automatic ruff formatting 2025-07-14 00:28:45 +06:00
Daniel.y
375bfd57a4
Merge pull request #1778 from danielaskdd/add-ollama-num-ctx
feat: Refine summary logic and add dedicated Ollama num_ctx config
2025-07-14 02:13:08 +08:00
yangdx
b03bb48e24 feat: Refine summary logic and add dedicated Ollama num_ctx config
- Refactor the trigger condition for LLM-based summarization of entities and relations. Instead of relying on character length, the summary is now triggered when the number of merged description fragments exceeds a configured threshold. This provides a more robust and logical condition for consolidation.
- Introduce the `OLLAMA_NUM_CTX` environment variable to explicitly configure the context window size (`num_ctx`) for Ollama models. This decouples the model's context length from the `MAX_TOKENS` parameter, which is now specifically used to limit input for summary generation, making the configuration clearer and more flexible.
- Updated `README` files, `env.example`, and default values to reflect these changes.
2025-07-14 01:55:04 +08:00
yangdx
e8b3dfcf90 Bump api verion to 0182 2025-07-14 00:29:48 +08:00
Daniel.y
47588fa9c9
Merge pull request #1777 from danielaskdd/fix-postgres-field-len
Increase field lengths for entity and file paths for PostgreSQL
2025-07-14 00:27:44 +08:00
yangdx
157fb4c871 Increase field lengths for entity and file paths for PostgreSQL
- Expand entity_name length to 512 chars
- Increase source/target ID lengths
- Convert file_path to TEXT type
- Add migration logic
2025-07-14 00:24:54 +08:00
Daniel.y
568a809957
Merge pull request #1776 from danielaskdd/fix-redisk-conn-pool
Increase max length limits for Milvus storage fields
2025-07-13 23:26:08 +08:00
yangdx
187a623125 Increase max length limits for Milvus storage fields
- Extended entity_name max_length to 512
- Increased entity_type max_length to 128
- Expanded file_path limits to 1024
- Raised src_id/tgt_id limits to 512
2025-07-13 23:13:45 +08:00
Daniel.y
77b8fb9b77
Merge pull request #1775 from danielaskdd/fix-redisk-conn-pool
Hotfix: Resolves connection pool bugs for Redis
2025-07-13 22:57:18 +08:00