KevinHuSh
4153a36683
truncate text to fitin embedding model ( #692 )
...
### What problem does this PR solve?
### Type of change
- [x] Refactoring
2024-05-09 11:35:08 +08:00
Fakai Zhao
de839fc3f0
optimize srv broker and executor logic ( #630 )
...
### What problem does this PR solve?
Optimize task broker and executor for reduce memory usage and deployment
complexity.
### Type of change
- [x] Performance Improvement
- [x] Refactoring
### Change Log
- Enhance redis utils for message queue(use stream)
- Modify task broker logic via message queue (1.get parse event from
message queue 2.use ThreadPoolExecutor async executor )
- Modify the table column name of document and task (process_duation ->
process_duration maybe just a spelling mistake)
- Reformat some code style(just what i see)
- Add requirement_dev.txt for developer
- Add redis container on docker compose
---------
Co-authored-by: Kevin Hu <kevinhu.sh@gmail.com>
2024-05-07 11:43:33 +08:00
KevinHuSh
674b3aeafd
fix disable and enable llm setting in dialog ( #616 )
...
### What problem does this PR solve?
#614
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2024-04-30 11:04:14 +08:00
KevinHuSh
2af74cc494
refine docker layers ( #606 )
...
### What problem does this PR solve?
### Type of change
- [x] Performance Improvement
2024-04-29 17:57:40 +08:00
KevinHuSh
9d60a84958
refactor code ( #583 )
...
### What problem does this PR solve?
### Type of change
- [x] Refactoring
2024-04-28 13:19:54 +08:00
KevinHuSh
66f8d35632
Refactor ( #537 )
...
### What problem does this PR solve?
### Type of change
- [x] Refactoring
2024-04-25 14:14:28 +08:00
KevinHuSh
453c29170f
make sure the models will not be load twice ( #422 )
...
### What problem does this PR solve?
#381
### Type of change
- [x] Refactoring
2024-04-18 09:37:23 +08:00
KevinHuSh
890561703b
Add bce-embedding and fastembed ( #383 )
...
### What problem does this PR solve?
Issue link:#326
### Type of change
- [x] New Feature (non-breaking change which adds functionality)
2024-04-16 16:42:19 +08:00
Anush
826ad6a33a
feat: FastEmbed embedding support ( #291 )
...
### Description
Following up on https://github.com/infiniflow/ragflow/pull/275 , this PR
adds support for FastEmbed model configurations.
The options are not exhaustive. You can find the full list
[here](https://qdrant.github.io/fastembed/examples/Supported_Models/ ).
P.S. I ran into OOM issues when building the image.
### Type of change
- [x] New Feature (non-breaking change which adds functionality)
---------
Co-authored-by: KevinHuSh <kevinhu.sh@gmail.com>
2024-04-15 15:58:06 +08:00
KevinHuSh
91068edf16
Support Xinference ( #320 )
...
### What problem does this PR solve?
Issue link:#299
### Type of change
- [x] New Feature (non-breaking change which adds functionality)
2024-04-11 18:22:25 +08:00
KevinHuSh
3708b97db9
Support Ollama ( #261 )
...
### What problem does this PR solve?
Issue link:#221
### Type of change
- [x] New Feature (non-breaking change which adds functionality)
2024-04-08 19:20:57 +08:00
KevinHuSh
e876f58b4c
refine readme ( #170 )
2024-03-29 14:38:15 +08:00
KevinHuSh
38e5737067
add base url for OpenAI ( #166 )
2024-03-28 19:15:16 +08:00
KevinHuSh
a5384446e3
let's load model from local ( #163 )
2024-03-28 16:10:47 +08:00
KevinHuSh
bf2e3d7fc1
refine OpenAi Api ( #159 )
2024-03-27 17:55:45 +08:00
KevinHuSh
fd7fcb5baf
apply pep8 formalize ( #155 )
2024-03-27 11:33:46 +08:00
KevinHuSh
979b3a5b4b
support snapshot download from local ( #153 )
...
* support snapshot download from local
* let snapshot download from local
2024-03-27 09:53:42 +08:00
KevinHuSh
da21320b88
fix plainPdf bugs ( #152 )
2024-03-26 15:11:07 +08:00
KevinHuSh
8a57f2afd5
change callback strategy, add timezone to docker ( #96 )
2024-03-05 12:08:41 +08:00
KevinHuSh
a8294f2168
Refine resume parts and fix bugs in retrival using sql ( #66 )
2024-02-19 19:22:17 +08:00
KevinHuSh
5e0a689c43
refactor retieval_test, add SQl retrieval methods ( #61 )
2024-02-08 17:01:01 +08:00
KevinHuSh
e32ef75e99
Test chat API and refine ppt chunker ( #42 )
2024-01-23 19:45:36 +08:00
KevinHuSh
484e5abc1f
llm configuation refine and trievalTest API refine ( #40 )
2024-01-19 19:51:57 +08:00
KevinHuSh
9bf75d4511
add dialog api ( #33 )
2024-01-17 20:20:42 +08:00
KevinHuSh
c372afe40a
change licence ( #28 )
...
* add front end code
* change licence
2024-01-17 09:39:50 +08:00
KevinHuSh
3198faf2d2
add alot of api ( #23 )
...
* clean rust version project
* clean rust version project
* build python version rag-flow
* add alot of api
2024-01-15 19:47:25 +08:00
KevinHuSh
30791976d5
build python version rag-flow ( #21 )
...
* clean rust version project
* clean rust version project
* build python version rag-flow
2024-01-15 08:46:22 +08:00
