yangdx
362321204f
Merge branch 'main' into add-multi-worker-support
2025-02-25 11:15:12 +08:00
yangdx
087d5770b0
feat(storage): Add shared memory support for file-based storage implementations
...
This commit adds multiprocessing shared memory support to file-based storage implementations:
- JsonDocStatusStorage
- JsonKVStorage
- NanoVectorDBStorage
- NetworkXStorage
Each storage module now uses module-level global variables with multiprocessing.Manager() to ensure data consistency across multiple uvicorn workers. All processes will see
updates immediately when data is modified through ainsert function.
2025-02-25 11:10:13 +08:00
yangdx
9fd0ab185f
Removed unnecessary comment
2025-02-24 16:28:18 +08:00
yangdx
b8543b8701
Remove unnecessary comment in networkx_impl.py
2025-02-24 09:55:03 +08:00
yangdx
9dd18ccd89
Simplify log message
2025-02-24 03:52:43 +08:00
yangdx
6cf555ebd5
Fix linting
2025-02-24 03:33:22 +08:00
yangdx
b4543561f6
Limit subgraph size to 500 nodes in NetworkXStorage
...
- Add max_graph_nodes check
- Reduce subgraph by degree
- Log graph size reduction
2025-02-24 03:32:33 +08:00
yangdx
b13c947360
Implement get_all_labels and get_knowledge_graph methods in NetworkXStorage
2025-02-24 02:37:42 +08:00
Yannick Stephan
678e0f9aea
Revert "Cleanup of code"
2025-02-20 15:09:43 +01:00
Yannick Stephan
439685e69c
Revert "removed get_knowledge_graph"
2025-02-20 14:29:36 +01:00
Yannick Stephan
c4562f71b9
cleanup extraction
2025-02-20 14:17:26 +01:00
Yannick Stephan
214e3e8ad5
fixed last update
2025-02-20 14:12:19 +01:00
Yannick Stephan
cedb5f3975
Merge pull request #886 from YanSte/clean-2
...
removed get_knowledge_graph
2025-02-19 22:59:10 +01:00
Yannick Stephan
89c35c82c7
removed get_knowledge_graph
2025-02-19 22:57:46 +01:00
Yannick Stephan
4978379b9c
Merge pull request #885 from YanSte/remove-unsused
...
Cleanup of code
2025-02-19 22:54:58 +01:00
Yannick Stephan
eb3306f34c
cleanup
2025-02-19 22:52:49 +01:00
Saifeddine ALOUI
d3c9af909b
Update networkx_impl.py
2025-02-19 18:40:13 +01:00
Yannick Stephan
495b0ddbe0
fixed networkx
2025-02-19 13:48:18 +01:00
Yannick Stephan
011227e426
cleanup no required install
2025-02-18 20:27:59 +01:00
Yannick Stephan
a0844bca28
cleaned import
2025-02-16 14:45:45 +01:00
Yannick Stephan
3fef8201c6
added final, required methods and cleaned import
2025-02-16 14:38:09 +01:00
Yannick Stephan
931c31fa8c
cleaned code
2025-02-16 13:55:30 +01:00
Yannick Stephan
882190a515
updated clean of what implemented on DocStatusStorage
2025-02-16 13:53:59 +01:00
zrguo
80451af839
fix linting errors
2025-01-27 23:21:34 +08:00
Saifeddine ALOUI
56e9c9f4d5
Moved the storages to kg folder
2025-01-27 09:59:26 +01:00