57 Commits

Author SHA1 Message Date
Alonso Guevara
c8aefb23cb
v0.2.0 (#700)
* v0.2.0

* Update 0.2.0.json

* Update CHANGELOG.md
v0.2.0
2024-07-24 23:02:03 -04:00
Alonso Guevara
ac6f240e29
Add autoresolve and update publish workflows (#698) 2024-07-24 19:54:11 -06:00
王俊
60520dc8c3
fix the llm organization parameter is ineffective during queries (#612)
* fix the organization parameter is ineffective during queries

* add semver impact document

---------

Co-authored-by: Alonso Guevara <alonsog@microsoft.com>
2024-07-24 15:52:01 -06:00
Alonso Guevara
2a95e6771c
Update issue templates (#675)
* Update issue templates

* Quick fix

* Quick fix

* Template fix

* Remove required
2024-07-24 14:01:44 -06:00
Kapil Sachdeva
e8df283b24
fix - in run_local_search(), avoid re-reading create_final_nodes.parquet file (#592) 2024-07-24 15:26:37 -04:00
Julian Whiting
a1138216f0
Fix/few shot selection (#530)
* try to always use at least 3 few shot examples

* add args for auto tune

* use context-based KNN to select most relevant chunks

* enforce at least 3 few shot examples for generated prompts

* utils for content-based KNN

* sem version

* fix callback arg

* fixes

* switch back to no op callbacks

* make n few shot, user controlled. default to 2"
2024-07-24 13:24:00 -06:00
Josh Bradley
2ddee65c29
Read/write files as binary utf-8 (#639) 2024-07-24 13:28:22 -04:00
Kartik Chopra
54f48d6f2a
chore: fixes typo in introduction document (#637)
chore: fixes typo

Co-authored-by: Josh Bradley <joshbradley@microsoft.com>
2024-07-24 07:46:49 -04:00
Ikko Eltociear Ashimine
5d025ae9b5
docs: update docsite/index.md (#552)
ino -> into

Co-authored-by: Alonso Guevara <alonsog@microsoft.com>
2024-07-22 17:49:01 -06:00
Josh Bradley
4c6562cfd1
Update CODEOWNERS (#658) 2024-07-22 16:16:32 -06:00
Fabian Schwarzkopf
309abc982f
add community sample with interactive graph visualization (#569)
* add sample with interactive knowledge graph and result context visualization

* Some formatting and good practices

---------

Co-authored-by: Alonso Guevara <alonsog@microsoft.com>
2024-07-16 17:55:39 -06:00
dependabot[bot]
ec43e3a12d
Bump ruff from 0.5.1 to 0.5.2 (#560)
* Bump ruff from 0.5.1 to 0.5.2

Bumps [ruff](https://github.com/astral-sh/ruff) from 0.5.1 to 0.5.2.
- [Release notes](https://github.com/astral-sh/ruff/releases)
- [Changelog](https://github.com/astral-sh/ruff/blob/main/CHANGELOG.md)
- [Commits](https://github.com/astral-sh/ruff/compare/0.5.1...0.5.2)

---
updated-dependencies:
- dependency-name: ruff
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

* Fix ruff

* semver

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Alonso Guevara <alonsog@microsoft.com>
2024-07-16 17:19:30 -06:00
dependabot[bot]
12f2be05a4
Bump coverage from 7.5.4 to 7.6.0 (#559)
Bumps [coverage](https://github.com/nedbat/coveragepy) from 7.5.4 to 7.6.0.
- [Release notes](https://github.com/nedbat/coveragepy/releases)
- [Changelog](https://github.com/nedbat/coveragepy/blob/master/CHANGES.rst)
- [Commits](https://github.com/nedbat/coveragepy/compare/7.5.4...7.6.0)

---
updated-dependencies:
- dependency-name: coverage
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-07-16 15:45:51 -06:00
dependabot[bot]
804f54cb7b
Bump pyright from 1.1.370 to 1.1.371 (#558)
Bumps [pyright](https://github.com/RobertCraigie/pyright-python) from 1.1.370 to 1.1.371.
- [Release notes](https://github.com/RobertCraigie/pyright-python/releases)
- [Commits](https://github.com/RobertCraigie/pyright-python/compare/v1.1.370...v1.1.371)

---
updated-dependencies:
- dependency-name: pyright
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-07-16 15:19:44 -06:00
dependabot[bot]
0aa1c31611
Bump lancedb from 0.9.0 to 0.10.0 (#557)
Bumps [lancedb](https://github.com/lancedb/lancedb) from 0.9.0 to 0.10.0.
- [Release notes](https://github.com/lancedb/lancedb/releases)
- [Changelog](https://github.com/lancedb/lancedb/blob/main/release_process.md)
- [Commits](https://github.com/lancedb/lancedb/compare/python-v0.9.0...python-v0.10.0)

---
updated-dependencies:
- dependency-name: lancedb
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-07-16 12:18:17 -06:00
dependabot[bot]
5a79d0c6e2
Bump tenacity from 8.4.2 to 8.5.0 (#556)
Bumps [tenacity](https://github.com/jd/tenacity) from 8.4.2 to 8.5.0.
- [Release notes](https://github.com/jd/tenacity/releases)
- [Commits](https://github.com/jd/tenacity/compare/8.4.2...8.5.0)

---
updated-dependencies:
- dependency-name: tenacity
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Alonso Guevara <alonsog@microsoft.com>
2024-07-15 20:33:13 -06:00
Alonso Guevara
ce462515d8
Local search llm params (#533)
* initialize config with  LocalSearchConfig and GlobalSearchConfig

* init_content LocalSearchConfig and GlobalSearchConfig

* rollback MAP_SYSTEM_PROMPT

* Small changes before merging. Notebook rollback

* Semver

---------

Co-authored-by: glide-the <2533736852@qq.com>
2024-07-15 13:01:56 -06:00
Alonso Guevara
5b283f2d29
Wrap file loading to catch exceptions and skip files (#532)
* Add exception handling to protect against loading faulty files

* Semver
2024-07-12 16:05:37 -06:00
Kylin
ec37389005
[bugfix]Fix chunk.choices[0].delta.content is None in query response (#520)
fix llm response content is None in query
2024-07-11 22:17:30 -06:00
s106916
ff7ac0512c
[bug] fix chunk.choices[0].delta NoneType (#509)
* fix chunk.choices[0].delta NoneType

* Fix delta none on query calls

---------

Co-authored-by: Alonso Guevara <alonsog@microsoft.com>
2024-07-11 20:50:57 -06:00
Alonso Guevara
53fcafd57f
Fix Mixed LLM settings for completions and embeddings (#517)
* Fixed an issue where base OpenAI embeddings can't work with Azure OpenAI LLM

* Removed redundant None from else

* Format

---------

Co-authored-by: Kenny Stryker <nggkenny@gmail.com>
2024-07-11 17:09:04 -06:00
wangJm
af74cae191
Modify the URL comment to make it correct. (#482)
Co-authored-by: Alonso Guevara <alonsog@microsoft.com>
2024-07-11 16:19:54 -06:00
Alonso Guevara
a0caadb320
Fix encoding model parameter in prompt auto templating (#500)
* Fix encoding model parameter in prompt tune

* Format changes
2024-07-11 16:12:25 -06:00
Kylin
c7da7f1afb
[compatibility issue] Support open source LLM model to prompt-tune (#505)
Compatibility update: support non-open ai model to prompt-tune

Co-authored-by: Alonso Guevara <alonsog@microsoft.com>
2024-07-11 12:03:30 -06:00
Alonso Guevara
7a9c9071c1
Change defaults for CHUNK_SIZE, CHUNK_OVERLAP and GLEANINGS (#499)
* enlarge the chunk size to reduce the cost and time greatly to 1/4

* Change default gleanings, chunk_size and chunk_overlap

* Update patch-20240710114442871595.json

---------

Co-authored-by: KylinMountain <kose2livs@gmail.com>
2024-07-11 10:22:27 -06:00
Alonso Guevara
c3852b0749
Fix/prompt tuning report rating (#496)
* add community report ranking to cli

* use tuned ratings in generated community report rankings

* update report generation template

* add new import paths to init

* add community report generation prompt and util function

* add rating generator, update init paths

* add report rating generation prompt

* update report generation template

* typo

* add semantic release

* Add missing docstring

* Format

* is is

* Format ruff

---------

Co-authored-by: Julian Whiting <j2whitin@gmail.com>
2024-07-10 15:55:21 -06:00
Alonso Guevara
aff2f79ae2
Feat/language in autotemplating (#468)
* Add language parameter on prompt tuning

* Semver and docs

* Fix typo
2024-07-10 13:56:54 -06:00
dependabot[bot]
607344022c
Bump textual from 0.70.0 to 0.72.0 (#462)
Bumps [textual](https://github.com/Textualize/textual) from 0.70.0 to 0.72.0.
- [Release notes](https://github.com/Textualize/textual/releases)
- [Changelog](https://github.com/Textualize/textual/blob/main/CHANGELOG.md)
- [Commits](https://github.com/Textualize/textual/compare/v0.70.0...v0.72.0)

---
updated-dependencies:
- dependency-name: textual
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-07-09 12:20:47 -06:00
dependabot[bot]
5f34d2d153
Bump JamesIves/github-pages-deploy-action from 4.6.1 to 4.6.3 (#425)
Bumps [JamesIves/github-pages-deploy-action](https://github.com/jamesives/github-pages-deploy-action) from 4.6.1 to 4.6.3.
- [Release notes](https://github.com/jamesives/github-pages-deploy-action/releases)
- [Commits](https://github.com/jamesives/github-pages-deploy-action/compare/v4.6.1...v4.6.3)

---
updated-dependencies:
- dependency-name: JamesIves/github-pages-deploy-action
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-07-09 11:55:17 -06:00
dependabot[bot]
cf4ac7fb13
Bump ruff from 0.5.0 to 0.5.1 (#422)
Bumps [ruff](https://github.com/astral-sh/ruff) from 0.5.0 to 0.5.1.
- [Release notes](https://github.com/astral-sh/ruff/releases)
- [Changelog](https://github.com/astral-sh/ruff/blob/main/CHANGELOG.md)
- [Commits](https://github.com/astral-sh/ruff/compare/0.5.0...0.5.1)

---
updated-dependencies:
- dependency-name: ruff
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-07-09 11:33:50 -06:00
YangJiaqi
b1d1cb9b4b
Update auto_prompt_tuning.md (#406)
Co-authored-by: Alonso Guevara <alonsog@microsoft.com>
2024-07-09 07:40:18 -06:00
dependabot[bot]
b53b91e849
Bump pyright from 1.1.369 to 1.1.370 (#421)
Bumps [pyright](https://github.com/RobertCraigie/pyright-python) from 1.1.369 to 1.1.370.
- [Release notes](https://github.com/RobertCraigie/pyright-python/releases)
- [Commits](https://github.com/RobertCraigie/pyright-python/compare/v1.1.369...v1.1.370)

---
updated-dependencies:
- dependency-name: pyright
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-07-09 07:36:47 -06:00
Kylin
e2572c7fab
[bug fix]Fix community_report config doesn't work in settings.yaml (#405)
* fix community_report doesn't work in settings.yaml

* add semversioner

* fix unittest about community report to community reports of env

---------

Co-authored-by: Alonso Guevara <alonsog@microsoft.com>
2024-07-08 22:48:02 -06:00
dependabot[bot]
f46d5d5743
Bump pydantic from 2.8.0 to 2.8.2 (#420)
Bumps [pydantic](https://github.com/pydantic/pydantic) from 2.8.0 to 2.8.2.
- [Release notes](https://github.com/pydantic/pydantic/releases)
- [Changelog](https://github.com/pydantic/pydantic/blob/main/HISTORY.md)
- [Commits](https://github.com/pydantic/pydantic/compare/v2.8.0...v2.8.2)

---
updated-dependencies:
- dependency-name: pydantic
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-07-08 19:26:29 -06:00
dependabot[bot]
64c2e72b64
Bump certifi from 2024.6.2 to 2024.7.4 (#391)
Bumps [certifi](https://github.com/certifi/python-certifi) from 2024.6.2 to 2024.7.4.
- [Commits](https://github.com/certifi/python-certifi/compare/2024.06.02...2024.07.04)

---
updated-dependencies:
- dependency-name: certifi
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-07-08 18:54:34 -06:00
Steven Truitt
2f5330497b
Update README.md (#439)
Added additional disclaimer about the potential costs of the indexing stage given some feedback that the costs were surprising.

Co-authored-by: Alonso Guevara <alonsog@microsoft.com>
2024-07-08 17:49:15 -06:00
Alonso Guevara
dd113422d4
Add issue templates (#448) 2024-07-08 17:34:18 -06:00
Alonso Guevara
b912081f1b
Add N parameter support (#390)
* Add N parameter support

* Fix unit tests

* Add new env vars to param testing
2024-07-08 14:04:49 -06:00
AbdulHamid Merii
a22003c302
Fix/syntax error in overview.md (#364)
Co-authored-by: Alonso Guevara <alonsog@microsoft.com>
2024-07-05 13:50:36 -06:00
glide-the
6865d60133
Fix/feat: Implementation of Minute-Based Rate Limiting in CommunityReportsExtractor Using asyncio and async_mode (#373)
* RateLimiter: The original TpmRpmLLMLimiter strategy did not account for minute-based rate limiting when scheduled. The RateLimiter was introduced to ensure that the CommunityReportsExtractor could be scheduled to adhere to rate configurations on a per-minute basis.

RateLimiter scheduled: using asyncio and async_mode

Additionally, some key loading issues for rpm = "REQUESTS_PER_MINUTE" and tpm = "TOKENS_PER_MINUTE" were fixed. Configuration loading was also enhanced to include temperature = "TEMPERATURE" and top_p = "TOP_P" settings.

* RateLimiter scheduled: using asyncio and async_mode

* Additionally, some key loading issues for rpm = "REQUESTS_PER_MINUTE" and tpm = "TOKENS_PER_MINUTE" were fixed. Configuration loading was also enhanced to include temperature = "TEMPERATURE" and top_p = "TOP_P" settings.

* Format

* Semversioner

* Format and cleanup

---------

Co-authored-by: Alonso Guevara <alonsog@microsoft.com>
2024-07-05 13:41:11 -06:00
Alonso Guevara
daca75ff79
Fix/autotuning limit overflow (#363)
* Fix when limit exceeds the df length

* Semversioner
2024-07-04 14:37:18 -06:00
Alonso Guevara
88dd444dcb
Fix/333 broken link (#352)
* Fix broken link on docs to prompt tuning

* Semversioner
2024-07-03 12:38:36 -06:00
Josh Bradley
04159f46b3
Update indexing cli (#332) 2024-07-03 12:32:51 -04:00
Alonso Guevara
bea9e5da8c
Update README.md (#348) 2024-07-03 10:13:16 -06:00
Alonso Guevara
f0843b2bec
Update index.md (#349) 2024-07-03 10:12:44 -06:00
Alonso Guevara
ffeadc6d9c
Update dictionary.txt (#350) 2024-07-03 10:01:18 -06:00
Alonso Guevara
751e0caa4a
Add paper links and badges to Readme. (#326) 2024-07-02 16:08:13 -06:00
Zi Nean Teoh
f865e66fa2
Fix dead link due to typo (#320)
Co-authored-by: Alonso Guevara <alonsog@microsoft.com>
2024-07-02 15:23:41 -06:00
Alex Chao
63a2b9639b
[Documentation] Add bullet point directing people to the Github Discussions tab (#324)
Update README.md

Add bullet point directing people to the Github Discussions tab
2024-07-02 14:53:19 -06:00
Alonso Guevara
a81efe58c7
Fix docsite base url (#319)
* Fix docsite base url

* Semversioner
v0.1.1
2024-07-01 23:40:54 +00:00