rvztz 7fd61e3a7f

Adds data source properties to git connectors (#1280) ...

Adds data source properties to git connectors:
-  data_created
-  date_modified
-  version
-  record_locator
These properties are instantiated when supported by the connector.

Separates the logic between fetching the file from source and
`get_file`. Retrieves file metadata when any of the properties are
called.

Adds logic to check if file exists in the remote source. For connectors
that don't directly support it, adds exception handling to check any
issues while retrieving the file.

---------

Co-authored-by: ryannikolaidis <1208590+ryannikolaidis@users.noreply.github.com>
Co-authored-by: rvztz <rvztz@users.noreply.github.com>

2023-10-10 22:56:56 +00:00

..

airtable-diff

feat: adds data source properties to airtable, confluence and discord (#1283)

2023-09-19 18:05:27 +00:00

azure

Refactor: support entire page OCR with ocr_mode and ocr_languages (#1579)

2023-10-06 22:54:49 +00:00

biomed-api

Refactor: support entire page OCR with ocr_mode and ocr_languages (#1579)

2023-10-06 22:54:49 +00:00

biomed-path/07/07

Fix/1209 tweak xycut ordering output (#1630)

2023-10-05 07:41:38 +00:00

box

feat: adds data source properties to fsspec-based connectors (#1279)

2023-09-15 05:56:44 +00:00

confluence-diff

feat: adds data source properties to airtable, confluence and discord (#1283)

2023-09-19 18:05:27 +00:00

delta-table

feat: adds data source properties to delta table connector. (#1464)

2023-09-27 17:46:01 -07:00

discord

feat: introduce language detection function for text partitioning function (#1453)

2023-09-26 18:09:27 +00:00

dropbox

feat: adds data source properties to fsspec-based connectors (#1279)

2023-09-15 05:56:44 +00:00

elasticsearch/movies

feat: introduce language detection function for text partitioning function (#1453)

2023-09-26 18:09:27 +00:00

gcs

feat: xlsx subtable extraction (#1585)

2023-10-04 13:30:23 -04:00

github

Adds data source properties to git connectors (#1280)

2023-10-10 22:56:56 +00:00

google-drive

built(test): exclude version metadata from google drive test (#1682)

2023-10-07 19:34:32 -07:00

jira-diff

feat: Adds data source properties to the Jira connector (#1516)

2023-10-04 20:04:18 -07:00

local-single-file

feat: introduce language detection function for text partitioning function (#1453)

2023-09-26 18:09:27 +00:00

local-single-file-with-encoding

fix: respect <pre> tag order in partition_html (#1197)

2023-08-25 04:14:48 +00:00

local-single-file-with-pdf-infer-table-structure

Refactor: support entire page OCR with ocr_mode and ocr_languages (#1579)

2023-10-06 22:54:49 +00:00

notion

feat: change default hi_res model to yolox quantized (#1607)

2023-10-04 03:28:47 +00:00

onedrive/utic-test-ingest-fixtures

feat: xlsx subtable extraction (#1585)

2023-10-04 13:30:23 -04:00

outlook

feat: adds data source properties to Sharepoint and Outlook (#1278)

2023-09-20 09:13:35 +00:00

pdf-fast-reprocess

feat: shrink bboxes by top left (#1633)

2023-10-06 05:16:11 +00:00

s3/small-pdf-set

Refactor: support entire page OCR with ocr_mode and ocr_languages (#1579)

2023-10-06 22:54:49 +00:00

s3-minio

Roman/s3 minio all cloud support (#1606)

2023-10-03 14:31:28 -04:00

salesforce

feat: improved salesforce partitioning (#1475)

2023-09-25 11:44:28 -07:00

Sharepoint

feat: xlsx subtable extraction (#1585)

2023-10-04 13:30:23 -04:00

slack

Adds data source properties to onedrive, reddit and slack (#1281)

2023-09-20 04:26:36 +00:00