78 Commits

Author SHA1 Message Date
zrguo
7dd6bd4ceb
Merge branch 'main' into main 2025-01-27 23:16:06 +08:00
zrguo
ba40a8de8b
Merge pull request #659 from danielaskdd/cvs_robustness
Enhance robustness of CVS processing ,Fix potential CSV parsing issues
2025-01-27 23:12:43 +08:00
Saifeddine ALOUI
0721ee303c
Fixed files list 2025-01-27 12:02:22 +01:00
yangdx
c8d384f15f Fix linting 2025-01-27 16:12:30 +08:00
yangdx
6d61b37c03 Add type ignore for pptx import 2025-01-27 16:07:03 +08:00
Saifeddine ALOUI
f307ed43f5 fixed linting 2025-01-27 02:10:24 +01:00
Saifeddine ALOUI
a68aebb124 translated docstrings to english and enhanced the webui 2025-01-27 02:07:06 +01:00
zrguo
bd2b3f334e
Merge pull request #650 from danielaskdd/Add-history-support-for-ollama-api
Add history support for ollama api
2025-01-27 06:34:10 +08:00
zrguo
28b139d074
Merge pull request #647 from 18277486571HYB/redis_impl
feat:  Added webui management, including file upload, text upload, Q&…
2025-01-27 06:32:15 +08:00
yangdx
03604d3186 Fix linting 2025-01-27 02:46:21 +08:00
yangdx
01288debd1 Ensure splash output flush to system log 2025-01-27 02:45:44 +08:00
yangdx
f045fc3d59 Update API endpoint documentation 2025-01-26 11:36:24 +08:00
hyb
cd5b1dc98f fix: light_server.py fix 2025-01-26 09:13:11 +08:00
yangdx
f8d26cb193 Update default history turns to 3 2025-01-26 05:19:51 +08:00
yangdx
25a58a6545 Fix linting 2025-01-26 05:10:57 +08:00
yangdx
9f80c1904f Refactoring command line argurements handling logic, add more RAG config to splash screen 2025-01-26 05:09:42 +08:00
yangdx
e4e42a8ec4 Fetch chunk size and chunk overlap size from .env file 2025-01-26 02:31:16 +08:00
yangdx
2719e07107 Convert OllamaMessage to dict in conversation history 2025-01-25 22:33:09 +08:00
yangdx
fb9df50ada Add conversation history support to chat API
- Added HISTORY_TURNS env variable
- Updated chat request data creation
- Modified server to handle history
- Added history to test cases
2025-01-25 22:14:40 +08:00
hyb
3dba406644 feat: Added webui management, including file upload, text upload, Q&A query, graph database management (can view tags, view knowledge graph based on tags), system status (whether it is good, data storage status, model status, path),request /webui/index.html 2025-01-25 18:38:46 +08:00
yangdx
cf2f83377c fix linting 2025-01-25 16:57:47 +08:00
yangdx
66dcc551ef Fix LLM binding variable name in create_app function
Corrected variable name from llm_binding_host
Updated conditional checks for LLM bindings
2025-01-25 16:29:59 +08:00
Saifeddine ALOUI
06c9e4e454 Fixed missing imports bug and fixed linting 2025-01-25 00:55:07 +01:00
Saifeddine ALOUI
e060fa6abb Now we can show the files in the health 2025-01-25 00:49:09 +01:00
Saifeddine ALOUI
c81da5a6d7 Fixed startup scan 2025-01-25 00:17:22 +01:00
Saifeddine ALOUI
34018cb1e0 Separated llms from the main llm.py file and fixed some deprication bugs 2025-01-25 00:11:00 +01:00
Saifeddine ALOUI
1776c1afcd fixed linting 2025-01-24 21:01:34 +01:00
zrguo
91422b0eb6
Merge pull request #644 from danielaskdd/Add-Ollama-generate-API-support
Add ollama generate api support
2025-01-25 01:52:59 +08:00
zrguo
13e4fa2e4a
Merge pull request #640 from ParisNeo/main
Upgraded docstrings for lightrag-server.py And added a simple front end to interact with the AI
2025-01-25 01:49:18 +08:00
Saifeddine ALOUI
cc3cd0b6dd
Moved splash screen to the end 2025-01-24 17:22:41 +01:00
Saifeddine ALOUI
7b42601ab8
Update lightrag_server.py 2025-01-24 17:14:15 +01:00
Saifeddine ALOUI
f30831dc9d
Update lightrag_server.py 2025-01-24 17:04:02 +01:00
yangdx
f30a69e201 Fix linting, remove redundant commentsr and clean up code for better readability 2025-01-24 23:50:47 +08:00
yangdx
11873625a3 Fix regex pattern for chat history detection
- Updated regex to match newline characters
- Added re.MULTILINE flag for multiline matching
- Improved logging for regex match results
- Enhanced query content cleaning process
- Ensured consistent chat history detection
2025-01-24 23:39:33 +08:00
yangdx
930b6cf006 Directly pass the session title or keyword generation request from Open WebUI to the underlying LLM 2025-01-24 23:33:12 +08:00
Saifeddine ALOUI
6e1f9ff00a
Update lightrag_server.py 2025-01-24 13:55:50 +01:00
Saifeddine ALOUI
a0c91d41b9
Fixed serving the webui 2025-01-24 13:54:49 +01:00
Saifeddine ALOUI
d9140a65e9
Merge pull request #1 from ParisNeo/patch-1
Patch 1
2025-01-24 13:52:54 +01:00
Saifeddine ALOUI
dfd7f74921
Added serving a web ui
Serving webui
2025-01-24 13:50:06 +01:00
Saifeddine ALOUI
c22e35f5d9
Merge branch 'HKUDS:main' into main 2025-01-24 13:38:20 +01:00
Saifeddine ALOUI
8171235f35
Added docstrings to lightrag_server.py
Added docstrings to lightrag_server.py
2025-01-24 13:37:43 +01:00
yangdx
385661b10e Removed query mode parsing and related tests
- Removed query mode parsing logic
- Removed test_generate_query_modes
- Simplified generate endpoint
- Updated test cases list
- Cleaned up unused code
2025-01-24 19:25:45 +08:00
yangdx
2c8885792c Refactor /api/generate:use llm_model_func directly 2025-01-24 18:39:43 +08:00
yangdx
b94cae9990 draft implementation of /api/generate endpoint 2025-01-24 18:18:14 +08:00
hyb
7b02fac7b9 feat: New ini file reading database configuration method for production environment convenience, modified Lightrag ainsert method - add.doc_keys retrieval method to only filter existing ones, but this will prevent failed documents from being stored again. Added -- chunk_Size and -- chunkoverlapped size for production environment convenience, and added llm_binding: openai-ollama for easy use of openai while also using ollama embedding 2025-01-24 17:10:19 +08:00
zrguo
afb30fe6c1
Merge branch 'main' into redis_impl 2025-01-24 16:27:40 +08:00
黄渝斌
3ea2ecbcbf
Merge branch 'main' into redis_impl 2025-01-23 23:02:53 +08:00
hyb
ff71952c8c feat: 新增ini文件读取数据库配置方式,方便生产环境,修改Lightrag ainsert方法_add_doc_keys获取方式,原来只过滤存在的,但这会让失败的文档无法再次存储,新增--chunk_size和--chunk_overlap_size方便生产环境,新增llm_binding:openai-ollama 方便用openai的同时使用ollama embedding 2025-01-23 22:58:57 +08:00
Soichi Sumi
a3306c4633
add "azure_openai" in llm_binding and embedding_binding 2025-01-23 21:30:57 +09:00
yangdx
11b618d434 Fix parameters missing in app creation in case openai is selected 2025-01-23 01:15:48 +08:00