23 Commits

Author SHA1 Message Date
yangdx
087d5770b0 feat(storage): Add shared memory support for file-based storage implementations
This commit adds multiprocessing shared memory support to file-based storage implementations:
- JsonDocStatusStorage
- JsonKVStorage
- NanoVectorDBStorage
- NetworkXStorage

Each storage module now uses module-level global variables with multiprocessing.Manager() to ensure data consistency across multiple uvicorn workers. All processes will see
updates immediately when data is modified through ainsert function.
2025-02-25 11:10:13 +08:00
yangdx
b8543b8701 Remove unnecessary comment in networkx_impl.py 2025-02-24 09:55:03 +08:00
yangdx
9dd18ccd89 Simplify log message 2025-02-24 03:52:43 +08:00
yangdx
6cf555ebd5 Fix linting 2025-02-24 03:33:22 +08:00
yangdx
b4543561f6 Limit subgraph size to 500 nodes in NetworkXStorage
- Add max_graph_nodes check
- Reduce subgraph by degree
- Log graph size reduction
2025-02-24 03:32:33 +08:00
yangdx
b13c947360 Implement get_all_labels and get_knowledge_graph methods in NetworkXStorage 2025-02-24 02:37:42 +08:00
Yannick Stephan
678e0f9aea
Revert "Cleanup of code" 2025-02-20 15:09:43 +01:00
Yannick Stephan
439685e69c
Revert "removed get_knowledge_graph" 2025-02-20 14:29:36 +01:00
Yannick Stephan
c4562f71b9 cleanup extraction 2025-02-20 14:17:26 +01:00
Yannick Stephan
214e3e8ad5 fixed last update 2025-02-20 14:12:19 +01:00
Yannick Stephan
cedb5f3975
Merge pull request #886 from YanSte/clean-2
removed get_knowledge_graph
2025-02-19 22:59:10 +01:00
Yannick Stephan
89c35c82c7 removed get_knowledge_graph 2025-02-19 22:57:46 +01:00
Yannick Stephan
4978379b9c
Merge pull request #885 from YanSte/remove-unsused
Cleanup of code
2025-02-19 22:54:58 +01:00
Yannick Stephan
eb3306f34c cleanup 2025-02-19 22:52:49 +01:00
Saifeddine ALOUI
d3c9af909b
Update networkx_impl.py 2025-02-19 18:40:13 +01:00
Yannick Stephan
495b0ddbe0 fixed networkx 2025-02-19 13:48:18 +01:00
Yannick Stephan
011227e426 cleanup no required install 2025-02-18 20:27:59 +01:00
Yannick Stephan
a0844bca28 cleaned import 2025-02-16 14:45:45 +01:00
Yannick Stephan
3fef8201c6 added final, required methods and cleaned import 2025-02-16 14:38:09 +01:00
Yannick Stephan
931c31fa8c cleaned code 2025-02-16 13:55:30 +01:00
Yannick Stephan
882190a515 updated clean of what implemented on DocStatusStorage 2025-02-16 13:53:59 +01:00
zrguo
80451af839 fix linting errors 2025-01-27 23:21:34 +08:00
Saifeddine ALOUI
56e9c9f4d5
Moved the storages to kg folder 2025-01-27 09:59:26 +01:00