yangdx
bee4622052
fix: handle null bytes (0x00) in text processing
...
- Fix PostgreSQL encoding error by properly handling null bytes (0x00) in text processing.
- The clean_text function now removes null bytes from all input text during the indexing phase.
2025-02-21 13:18:26 +08:00
Yannick Stephan
678e0f9aea
Revert "Cleanup of code"
2025-02-20 15:09:43 +01:00
Yannick Stephan
439685e69c
Revert "removed get_knowledge_graph"
2025-02-20 14:29:36 +01:00
Yannick Stephan
c4562f71b9
cleanup extraction
2025-02-20 14:17:26 +01:00
Yannick Stephan
214e3e8ad5
fixed last update
2025-02-20 14:12:19 +01:00
Yannick Stephan
3e820cc68e
fixed default factory
2025-02-20 14:04:59 +01:00
Yannick Stephan
8413537ad2
cleanup
2025-02-20 13:44:17 +01:00
Yannick Stephan
4923f5c1d7
cleanup kg
2025-02-20 13:39:46 +01:00
Yannick Stephan
60717fd6be
cleanup storage state
2025-02-20 13:30:30 +01:00
Yannick Stephan
59bb75d4a1
added log path
2025-02-20 13:27:55 +01:00
Yannick Stephan
c7bc2c63cf
cleanup storages
2025-02-20 13:21:41 +01:00
Yannick Stephan
32e489865c
cleanup code
2025-02-20 13:18:17 +01:00
Yannick Stephan
72b978d6d5
cleanup
2025-02-20 13:13:38 +01:00
Yannick Stephan
32d0f1acb0
added docs and fields
2025-02-20 13:09:33 +01:00
Yannick Stephan
4b478d1c0f
added fields
2025-02-20 13:06:34 +01:00
Yannick Stephan
f5a93c7bb5
added fields
2025-02-20 13:06:16 +01:00
Yannick Stephan
2370a4336b
added field
2025-02-20 13:05:59 +01:00
Yannick Stephan
37addb7c01
added final
2025-02-20 13:05:35 +01:00
Yannick Stephan
bae21a6fad
added max paralle insert
2025-02-20 12:57:25 +01:00
Yannick Stephan
de56aeb7c5
removed lock
2025-02-20 12:54:52 +01:00
Yannick Stephan
26abae4733
Merge pull request #891 from YanSte/lock
...
added lock
2025-02-20 00:21:28 +01:00
Yannick Stephan
fa99d72269
added lock
2025-02-20 00:20:30 +01:00
Yannick Stephan
bf720b131b
Merge pull request #890 from YanSte/paralle-4
...
fixed the behaviour Multi paralle
2025-02-20 00:11:37 +01:00
Yannick Stephan
80a61d7e7a
fixed the behaviour
2025-02-20 00:09:46 +01:00
Yannick Stephan
f52c53b41c
Merge pull request #889 from YanSte/parelle-3
...
Multi batches
2025-02-19 23:55:59 +01:00
Yannick Stephan
efdc8a2d26
multi batches
2025-02-19 23:53:25 +01:00
Yannick Stephan
64e6765c9a
Merge pull request #888 from YanSte/parelle-2
...
Parelle
2025-02-19 23:47:36 +01:00
Yannick Stephan
4875283d9f
make it smalled
2025-02-19 23:45:51 +01:00
Yannick Stephan
0567a68c31
Merge pull request #887 from YanSte/paralle
...
Improved Paralles
2025-02-19 23:32:57 +01:00
Yannick Stephan
98d005dc1c
updated paralle
2025-02-19 23:32:21 +01:00
Yannick Stephan
cedb5f3975
Merge pull request #886 from YanSte/clean-2
...
removed get_knowledge_graph
2025-02-19 22:59:10 +01:00
Yannick Stephan
89c35c82c7
removed get_knowledge_graph
2025-02-19 22:57:46 +01:00
Yannick Stephan
4978379b9c
Merge pull request #885 from YanSte/remove-unsused
...
Cleanup of code
2025-02-19 22:54:58 +01:00
Yannick Stephan
eb3306f34c
cleanup
2025-02-19 22:52:49 +01:00
Yannick Stephan
3e118f0935
Merge pull request #882 from YanSte/cleaning
...
cleaned code
2025-02-19 22:08:47 +01:00
Yannick Stephan
8958046b74
cleaned code
2025-02-19 22:07:25 +01:00
Yannick Stephan
6f95ad92bf
Merge pull request #811 from da-luggas/main
...
Fixed broken ainsert_custom_kg()
2025-02-19 15:20:37 +01:00
Lukas Selch
701d8bb48e
Applied lint
2025-02-19 10:28:25 +01:00
Lukas Selch
bc630c8620
Renamed chunk_order_index and improve token calculation
2025-02-19 07:15:30 +01:00
Yannick Stephan
ccb117e1c6
Merge pull request #846 from ArnoChenFx/db-connection-and-storage-lifecycle
...
Refactor Database Connection Management and Improve Storage Lifecycle Handling
2025-02-18 22:39:31 +01:00
ArnoChen
ca170ce783
rename is_managed_by_server to auto_manage_storages_states
2025-02-19 05:27:38 +08:00
ArnoChen
6d8e627f85
improve MongoDB client management and storage init
2025-02-19 04:30:52 +08:00
Yannick Stephan
aa4a5cea7c
cleaned typing
2025-02-18 21:16:52 +01:00
ArnoChen
e194e04226
refactor database connection management and improve storage lifecycle handling
...
update
2025-02-19 03:49:05 +08:00
Yannick Stephan
3b30b7985b
fixed str enum
2025-02-17 18:26:07 +01:00
Lukas Selch
537e10303d
Fixed formatting
2025-02-17 15:25:50 +01:00
Lukas Selch
86f5a88db7
Fixed wrong variable name
2025-02-17 15:20:23 +01:00
Lukas Selch
7913304007
Fixed broken ainsert_custom_kg()
2025-02-17 15:12:35 +01:00
MdNazishArmanShorthillsAI
c2ff17d343
Added system prompt support in all modes
2025-02-17 16:45:00 +05:30
zrguo
9a1603f594
Merge pull request #795 from YanSte/make-clear-what-implemented-or-not
...
Enhancing ABC Enforcement and Standardizing Subclass Implementations
2025-02-17 16:03:22 +08:00