| 
							
							
								 Jyong | 1024fc623e | fix the ssrf of docx file extractor external images (#10237) | 2024-11-04 15:22:07 +08:00 |  | 
			
				
					| 
							
							
								 Jiang | 0c9e79cd67 | Add Lindorm as a VDB choice (#10202) Co-authored-by: jiangzhijie <jiangzhijie.jzj@alibaba-inc.com> | 2024-11-04 09:10:26 +08:00 |  | 
			
				
					| 
							
							
								 Shili Cao | b61baa87ec | fix: avoid unexpected error when create knowledge base with baidu vector database and wenxin embedding model (#10130) | 2024-10-31 21:34:23 +08:00 |  | 
			
				
					| 
							
							
								 Jyong | dad041c49f | fix issue: query is none when doing retrieval (#10129) | 2024-10-31 21:25:00 +08:00 |  | 
			
				
					| 
							
							
								 omr | 11ca1bec0b | fix: optimize unique document filtering with set (#10082) | 2024-10-31 16:32:58 +08:00 |  | 
			
				
					| 
							
							
								 zhuhao | 7433095240 | chore: use dify_config.TIDB_SPEND_LIMIT instead of constant value (#10038) | 2024-10-30 15:43:07 +08:00 |  | 
			
				
					| 
							
							
								 Jyong | 9ebd453b87 | add rerank check when doing mutil-retrieval (#9998) | 2024-10-30 11:17:39 +08:00 |  | 
			
				
					| 
							
							
								 powerfool | 878d13ef42 | Added OceanBase as an option for the vector store in Dify (#10010) | 2024-10-29 21:10:18 +08:00 |  | 
			
				
					| 
							
							
								 Jyong | 5580bcf870 | add tidb spend limit config (#9999) | 2024-10-29 17:51:13 +08:00 |  | 
			
				
					| 
							
							
								 roadgoat19 | c8ef9223e5 | feat: couchbase integration (#6165) Co-authored-by: crazywoola <427733928@qq.com>
Co-authored-by: Elliot Scribner <elliot.scribner@couchbase.com>
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
Co-authored-by: Bowen Liang <bowenliang@apache.org> | 2024-10-29 15:00:23 +08:00 |  | 
			
				
					| 
							
							
								 Jyong | f47177ecb4 | add top_k for es full text search (#9963) | 2024-10-28 23:04:54 +08:00 |  | 
			
				
					| 
							
							
								 virgosoy | 17cacf258e | fix: wrong element object (#9868) | 2024-10-25 22:32:41 +08:00 |  | 
			
				
					| 
							
							
								 Jyong | 18106a4fc6 | add tidb on qdrant type (#9831) Co-authored-by: Zhaofeng Miao <522856232@qq.com> | 2024-10-25 13:57:03 +08:00 |  | 
			
				
					| 
							
							
								 Zixuan Cheng | 88dec6ef2b | Added description for .ppt, specify the reason for unstructured.io (#9452) Co-authored-by: crazywoola <427733928@qq.com> | 2024-10-24 22:13:06 +08:00 |  | 
			
				
					| 
							
							
								 Jyong | 5f11fe521d | remove unstructured pdf extract (#9794) | 2024-10-24 18:13:05 +08:00 |  | 
			
				
					| 
							
							
								 Jyong | 3e9d271b52 | nltk security issue and upgrade unstructured (#9558) | 2024-10-23 16:23:55 +08:00 |  | 
			
				
					| 
							
							
								 ice yao | ceb2c4f3ef | chore: reuse existing test functions with upstash vdb (#9679) | 2024-10-23 10:42:11 +08:00 |  | 
			
				
					| 
							
							
								 Zven | 8e7a752b2a | feat: add upstash as a new vector database provider (#9644) | 2024-10-23 09:16:35 +08:00 |  | 
			
				
					| 
							
							
								 -LAN- | 5f12c17355 | fix(core): use CreatedByRole enum for role consistency (#9607) | 2024-10-22 13:03:50 +08:00 |  | 
			
				
					| 
							
							
								 Bowen Liang | 4d9160ca9f | refactor: use dify_config to replace legacy usage of flask app's config (#9089) | 2024-10-22 11:01:32 +08:00 |  | 
			
				
					| 
							
							
								 -LAN- | e61752bd3a | feat/enhance the multi-modal support (#8818) | 2024-10-21 10:43:49 +08:00 |  | 
			
				
					| 
							
							
								 ice yao | 2155bba5b0 | fix: update mismatch vector type (#9462) | 2024-10-18 08:21:41 +08:00 |  | 
			
				
					| 
							
							
								 zhuhao | b90ad587c2 | refactor: move the embedding to the rag module and abstract the rerank runner for extension (#9423) | 2024-10-17 19:12:42 +08:00 |  | 
			
				
					| 
							
							
								 zhuhao | 86594851cb | refactor: update the default values of top-k parameter in vdb to be consistent (#9367) | 2024-10-16 16:00:21 +08:00 |  | 
			
				
					| 
							
							
								 Jyong | 50635e9c15 | Fix/economical knowledge retrieval (#9396) | 2024-10-16 15:13:45 +08:00 |  | 
			
				
					| 
							
							
								 zhuhao | cd7ab6231f | refactor: Add an enumeration type and use the factory pattern to obtain the corresponding class (#9356) | 2024-10-15 12:51:13 +08:00 |  | 
			
				
					| 
							
							
								 ice yao | d15ba3939d | Add Volcengine VikingDB as new vector provider (#9287) | 2024-10-13 21:26:05 +08:00 |  | 
			
				
					| 
							
							
								 zhuhao | d97d3ff5fc | chore: add abstract decorator and output log when query embedding fails (#9264) | 2024-10-12 23:58:41 +08:00 |  | 
			
				
					| 
							
							
								 Shili Cao | 2ec6ffe478 | feat:support baidu vector db (#9185) | 2024-10-12 23:24:17 +08:00 |  | 
			
				
					| 
							
							
								 Jyong | 42b02b3a5f | Fix/agent external knowledge retrieval (#9241) | 2024-10-11 19:21:03 +08:00 |  | 
			
				
					| 
							
							
								 Jyong | 80b62d50f5 | Fix/add es num_candidates (#9225) | 2024-10-11 16:04:23 +08:00 |  | 
			
				
					| 
							
							
								 Jyong | cabdb4ef17 | fix retrieval resource positon missed (#9155) Co-authored-by: Bowen Liang <liangbowen@gf.com.cn> | 2024-10-11 10:32:42 +08:00 |  | 
			
				
					| 
							
							
								 Bowen Liang | 240b66d737 | chore: avoid implicit optional in type annotations of method (#8727) | 2024-10-09 14:36:43 +08:00 |  | 
			
				
					| 
							
							
								 Aurelius Huang | 4585cffce1 | fix: Compatible with special characters in pg full-text search. (#8921) Co-authored-by: Aurelius Huang <cm.huang@aftership.com> | 2024-09-30 16:32:23 +08:00 |  | 
			
				
					| 
							
							
								 Jyong | 9d221a5e19 | external knowledge api (#8913) Co-authored-by: Yi <yxiaoisme@gmail.com> | 2024-09-30 15:38:43 +08:00 |  | 
			
				
					| 
							
							
								 Zhaofeng Miao | 369e1e6f58 | feat(website-crawl): add jina reader as additional alternative for website crawling (#8761) | 2024-09-30 09:57:19 +08:00 |  | 
			
				
					| 
							
							
								 Bowen Liang | 74f58f29f9 | chore: bump ruff to 0.6.8 for fixing violation in SIM910 (#8869) | 2024-09-29 00:29:59 +08:00 |  | 
			
				
					| 
							
							
								 ice yao | 27e33fb15c | chore: fix wrong VectorType match case (#8857) | 2024-09-28 10:54:04 +08:00 |  | 
			
				
					| 
							
							
								 zhuhao | 55e6123db9 | feat: add min-connection and max-connection for pgvector (#8841) | 2024-09-27 18:16:20 +08:00 |  | 
			
				
					| 
							
							
								 8bitpd | 4c1063e1c5 | fix: AnalyticdbVector retrieval scores (#8803) | 2024-09-27 12:05:21 +08:00 |  | 
			
				
					| 
							
							
								 zhuhao | 008e0efeb0 | refactor: update delete method as an abstract method (#8794) | 2024-09-26 16:36:21 +08:00 |  | 
			
				
					| 
							
							
								 crazywoola | bf64ff215b | fix: . is missing in file_extension (#8736) | 2024-09-25 10:09:20 +08:00 |  | 
			
				
					| 
							
							
								 omr | 8fd297f8b4 | fix: redundant check for available_document_count (#8491) | 2024-09-22 13:39:41 +08:00 |  | 
			
				
					| 
							
							
								 Jyong | 7e611ffbf3 | multi-retrival use dataset's top-k (#8416) | 2024-09-14 21:48:44 +08:00 |  | 
			
				
					| 
							
							
								 Bowen Liang | a1104ab97e | chore: refurish python code by applying Pylint linter rules (#8322) | 2024-09-13 22:42:08 +08:00 |  | 
			
				
					| 
							
							
								 Bowen Liang | 6613b8f2e0 | chore: fix unnecessary string concatation in single line (#8311) | 2024-09-13 14:24:49 +08:00 |  | 
			
				
					| 
							
							
								 -LAN- | 08c486452f | fix: score_threshold handling in vector search methods (#8356) | 2024-09-13 14:24:35 +08:00 |  | 
			
				
					| 
							
							
								 Jyong | 49cee773c5 | fixed score threshold is none (#8342) | 2024-09-13 10:21:58 +08:00 |  | 
			
				
					| 
							
							
								 Bowen Liang | 40fb4d16ef | chore: refurbish Python code by applying refurb linter rules (#8296) | 2024-09-12 15:50:49 +08:00 |  | 
			
				
					| 
							
							
								 Bowen Liang | c69f5b07ba | chore: apply ruff E501 line-too-long linter rule (#8275) Co-authored-by: -LAN- <laipz8200@outlook.com> | 2024-09-12 14:00:36 +08:00 |  |