11 Commits

Author SHA1 Message Date
ahmetkca
62ea978d6c Add more test for GithubRepositoryReader and fix
Fix for filtering file extensions and directories.
Partial test coverage for GithubRepositoryReader.
Conditional import for llama_index and gpt_index
2023-02-28 00:08:01 -05:00
ahmetkca
2adbb24a2c change import path for extra files to absolute 2023-02-14 23:42:18 -05:00
ahmetkca
e12e7f5cd9 change the import path for extras 2023-02-14 23:31:05 -05:00
ahmetkca
14cfdf75b1 Docs(FilterType): Add documentation for FilterType enum
- Add documentation for FilterType enum
- Explain what the enum is used for
- Describe the attributes of the enum
2023-02-13 03:49:43 -05:00
ahmetkca
de761cd341 Refactor(BaseReader): Check filter files
- Refactor `_check_filter_files` to `_check_filter_file_extensions` in `BaseReader`
- Ignoring files due to filter
2023-02-13 01:49:31 -05:00
ahmetkca
91c6bf33cd Refactor(GithubRepositoryReader): Add filter for directories and files
- Add filter for directories and files in GithubRepositoryReader
- Ignore directories and files that do not pass the filter
- Print out if directory or file is ignored due to filter
2023-02-13 01:46:58 -05:00
ahmetkca
1bf025dd31 Refactor(GithubRepositoryReader): Add github_client argument
- Add github_client argument to GithubRepositoryReader constructor
- Set default value for github_client argument
- Update docstring to reflect changes
2023-02-13 01:02:47 -05:00
ahmetkca
0f82eb0e57 temp 2023-02-12 04:01:39 -05:00
ahmetkca
6227d7496e Refactor(Github Repo): Move github_client and utils to modules
* Moved github_client.py and utils.py from loader_hub/github_repo to modules/github_repo
* Updated import statements in base.py to reflect the new location
2023-02-12 03:52:27 -05:00
ahmetkca
f36f2e795e test imports when downloaded from gpt_index 2023-02-12 03:28:32 -05:00
ahmetkca
fbffd7e4fa add github repository, test a new way to download loader 2023-02-12 03:04:12 -05:00