11 Commits

Author	SHA1	Message	Date
Harshal Sheth	a7dc9c9d22	feat(sdk): autogenerate urn types (#9257)	2023-11-30 18:11:36 -05:00
Andrew Sikowitz	40d17f00ea	feat(ingest/datahub): Improvements, bug fixes, and docs (#8735)	2023-08-29 14:33:40 -04:00
Mayuri Nehate	cc94ffbf6c	fix(ingest): stateful redundant run skip handler (#8467)	2023-08-28 15:03:31 +05:30
Andrew Sikowitz	526e626146	feat(ingest): Add DataHub source (#8561) ... Co-authored-by: Harshal Sheth <hsheth2@gmail.com>	2023-08-15 17:49:20 -04:00
Harshal Sheth	137f4500b6	feat(ingest/stateful): remove platform_instance_id from state urn (#6795)	2022-12-20 12:12:19 -05:00
Harshal Sheth	2f95719dba	feat(ingest): remove source config from DatahubIngestionCheckpoint (#6722)	2022-12-14 12:39:21 -05:00
Harshal Sheth	d08f5f7cdd	feat(ingest): replace base85's pickle with json (#6178)	2022-10-14 14:48:44 -07:00
Alexey Kravtsov	3c3ab64954	feat(ingest): implement compression for CheckpointState (#6007)	2022-09-26 10:18:42 -07:00
Harshal Sheth	68db859ca1	refactor(ingest): streamline two-tier db config validation (#5986)	2022-09-21 10:45:37 -07:00
Ravindra Lanka	ee68f09624	feat(ingestion): Refactor standard state-handling tasks into a common handler that are common across all stateful ingestion sources. (#5766)	2022-09-14 09:30:42 -07:00
Ravindra Lanka	f20382f956	feat(ingest): framework - client side changes for monitoring and reporting (#3807)	2022-02-02 13:19:15 -08:00