13 Commits

Author	SHA1	Message	Date
Shubham Jagtap	fda5eb89f7	feat(ingest): enable stateful_ingestion by default for DataHub rest sink (#9934)	2024-03-05 11:18:03 -08:00
Shubham Jagtap	a187127ac5	feat(ingestion): file-based state checkpoint provider (#9029)	2023-11-10 14:36:00 -08:00
Mayuri Nehate	cc94ffbf6c	fix(ingest): stateful redundant run skip handler (#8467)	2023-08-28 15:03:31 +05:30
Harshal Sheth	f860ce95c0	feat(ingest): emit state payloads as soft-deleted (#7714)	2023-04-04 17:06:21 +00:00
Harshal Sheth	137f4500b6	feat(ingest/stateful): remove platform_instance_id from state urn (#6795)	2022-12-20 12:12:19 -05:00
Harshal Sheth	5584bfb469	refactor(ingest/stateful): remove get_last_state method (#6794)	2022-12-19 20:48:22 -05:00
Harshal Sheth	e9d50ed992	refactor(ingest/stateful): remove IngestionJobStateProvider (#6792)	2022-12-19 17:03:54 -05:00
Tamas Nemeth	e41b455e14	fix(ingest): bigquery - sharded table support improvements (#6789)	2022-12-19 18:57:37 +01:00
Harshal Sheth	8a537b0559	feat(ingest): add datahub state inspect command (#6763)	2022-12-15 18:55:36 -05:00
Harshal Sheth	2f95719dba	feat(ingest): remove source config from DatahubIngestionCheckpoint (#6722)	2022-12-14 12:39:21 -05:00
Harshal Sheth	68db859ca1	refactor(ingest): streamline two-tier db config validation (#5986)	2022-09-21 10:45:37 -07:00
Ravindra Lanka	ee68f09624	feat(ingestion): Refactor standard state-handling tasks into a common handler that are common across all stateful ingestion sources. (#5766)	2022-09-14 09:30:42 -07:00
Ravindra Lanka	f20382f956	feat(ingest): framework - client side changes for monitoring and reporting (#3807)	2022-02-02 13:19:15 -08:00