Steve Canny 8ea203adf7

feat(chunking): composite text gets is_continuation (#2639) ...

**Summary**
Add `metadata.is_continuation = True` to metadata of second-and-later
text-split chunks formed from an oversized non-table element. Previously
this metadata was only present on text-split `TableChunk` elements.

This enables downstream filtering of intentionally redundant metadata on
chunk elements that may not be desired for all purposes.

---------

Co-authored-by: scanny <scanny@users.noreply.github.com>

2024-03-12 19:44:41 +00:00

..

airtable-diff

fix(ingest): canonicalize ingest JSON (#2080)

2023-11-15 00:52:58 -08:00

azure

fix: default hi_res model rely on inference setting (#2441)

2024-01-29 16:44:41 +00:00

biomed-api

build(release): release commit for 0.12.4 (#2525)

2024-02-08 21:18:29 +00:00

biomed-path/07/07

fix: default hi_res model rely on inference setting (#2441)

2024-01-29 16:44:41 +00:00

box

drop python3.8 (#2372)

2024-01-09 23:37:30 +00:00

confluence-diff

fix(html): unequal row lengths in HTMLTable.text_as_html (#2345)

2024-01-04 21:53:19 +00:00

delta-table

chore: sensitive info connector audit (#2227)

2023-12-11 17:37:49 +00:00

discord

fix(ingest): canonicalize ingest JSON (#2080)

2023-11-15 00:52:58 -08:00

dropbox

drop python3.8 (#2372)

2024-01-09 23:37:30 +00:00

elasticsearch/movies

feat: improve sensitive data handling by fsspec connectors (#2194)

2023-12-05 20:55:19 +00:00

embed

build(release): release commit for 0.12.4 (#2525)

2024-02-08 21:18:29 +00:00

gcs

fix(html): unequal row lengths in HTMLTable.text_as_html (#2345)

2024-01-04 21:53:19 +00:00

github

fix(ingest): canonicalize ingest JSON (#2080)

2023-11-15 00:52:58 -08:00

google-drive

fix(ingest): canonicalize ingest JSON (#2080)

2023-11-15 00:52:58 -08:00

hubspot

rvztz/hubspot ingest connector (#1760)

2023-11-28 23:07:57 +00:00

jira-diff

fix(ingest): canonicalize ingest JSON (#2080)

2023-11-15 00:52:58 -08:00

local-single-file

fix: local connector with input path to single file (#2116)

2023-11-19 18:21:31 +00:00

local-single-file-basic-chunking

feat(chunking): composite text gets is_continuation (#2639)

2024-03-12 19:44:41 +00:00

local-single-file-with-encoding

fix: local connector with input path to single file (#2116)

2023-11-19 18:21:31 +00:00

local-single-file-with-pdf-infer-table-structure

build(release): release commit for 0.12.4 (#2525)

2024-02-08 21:18:29 +00:00

mongodb/sample-mongodb-data

feat: add MongoDB source connector (#2393)

2024-01-16 20:56:29 +00:00

notion

enhancement: detect headers in partition_pdf with fast strategy (#2455)

2024-02-23 16:56:09 +00:00

onedrive/utic-test-ingest-fixtures

fix(xlsx): xlsx subtable algorithm (#2534)

2024-02-13 20:29:17 -08:00

opensearch/movies

fix: change opensearch port (#2517)

2024-02-07 21:25:04 +00:00

outlook

fix(ingest): canonicalize ingest JSON (#2080)

2023-11-15 00:52:58 -08:00

pdf-fast-reprocess

enhancement: detect headers in partition_pdf with fast strategy (#2455)

2024-02-23 16:56:09 +00:00

s3

fix: default hi_res model rely on inference setting (#2441)

2024-01-29 16:44:41 +00:00

s3-minio

fix(ingest): canonicalize ingest JSON (#2080)

2023-11-15 00:52:58 -08:00

salesforce

enhancement: normalize Salesforce artifact extensions (#2402)

2024-01-16 10:36:00 +00:00

sftp/folder1

feat: Add sftp source connector (#2163)

2023-12-07 19:33:19 +00:00

Sharepoint

fix: handling of varied SharePoint date formats (#2591)

2024-02-28 16:11:53 +00:00

Sharepoint-with-permissions

bug: update sharepoint-with-permissions test to fix CI (#2589)

2024-03-06 17:15:36 +00:00

slack

fix(ingest): canonicalize ingest JSON (#2080)

2023-11-15 00:52:58 -08:00