7 Commits

Author	SHA1	Message	Date
Florian Hardow	0b39ce6431	fetch experiment run results from dc (#2960) ... * feat: fetch results for DeepsetCloudExperiments * chore: test DC fetch predicitons for eval run * chore: switch to dict iteration with .items() * chore: update DC url to fetch predictions from * chore: update doc strings for fetching eval run results * chore: update DeepsetCloudExperiments description, change function names for fetching predictions of an eval run * chore: test for DeepsetCloudExperiments.get_run_results * chore: adjust request mock for test_get_eval_run_results * chore: push first row of dataframe into variable for test checks * chore: adjust mock data to correct data types * chore: make documentation more readable with line breaks * chore: update documentation for eval run result fetching	2022-08-10 15:02:36 +02:00
tstadel	ab443aab28	Fix match_context tests in test_utils.py (#2725) ... * fix match_context tests * fix naming of test * pin rapidfuzz to 2.0.13	2022-06-24 13:23:00 +02:00
tstadel	df6ebeb087	Do not show success message on failed evalset upload (#2639) ... * Do not show success message on failed evalset upload * Update Documentation & Code Style Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>	2022-06-08 08:31:25 +02:00
tstadel	0efad96e08	DC SDK: Add possibility to upload evaluation sets to DC (#2610) ... * Add possibility to upload evaluation sets to DC * fix test_eval sas comparisons * quickwin docstring feedback changes * Add hint about annotation tool and mark optional and required columns * minor changes to docstrings	2022-05-31 17:08:19 +02:00
tstadel	fc25adf959	Create eval runs on deepset Cloud (#2534) ... * add EvaluationRunClient * Update Documentation & Code Style * temporarily resolve names to ids * Update Documentation & Code Style * add delete and update methods * minor fixes * add experiments facade * dummy implement start_run() * start eval runs added * Update Documentation & Code Style * fix merge * switch to names on api level * add create eval_run test * Update Documentation & Code Style * further tests added * update docstrings * add docstrings * add missing tags param, fix docstrings * refactor _get_evaluation_sets * fix mypy Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>	2022-05-30 18:18:19 +02:00
tstadel	3ab4dac58d	Upload files to deepset Cloud (#2570) ... * added upload_files * Update Documentation & Code Style * expose file client via DeepsetCloud facade * Update Documentation & Code Style * tests added * Update Documentation & Code Style * always read file in binary mode and guess mimetype * add delete and list functions * fix method literals Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>	2022-05-23 17:05:56 +02:00
Sara Zan	ff4303c51b	[CI refactoring] Categorize tests into folders (#2554) ... * Categorize tests into folders * Fix linux_ci.yml and an import * Wrong path	2022-05-17 09:55:53 +01:00