12 Commits

Author	SHA1	Message	Date
Harshal Sheth	137f4500b6	feat(ingest/stateful): remove platform_instance_id from state urn (#6795)	2022-12-20 12:12:19 -05:00
Harshal Sheth	8a537b0559	feat(ingest): add datahub state inspect command (#6763)	2022-12-15 18:55:36 -05:00
Harshal Sheth	6152b5e9f7	feat(ingest): simplify more stateful ingestion state (#6762)	2022-12-15 11:33:29 -05:00
Harshal Sheth	2f95719dba	feat(ingest): remove source config from DatahubIngestionCheckpoint (#6722)	2022-12-14 12:39:21 -05:00
Harshal Sheth	cf3db168ac	feat(ingest): start simplifying stateful ingestion state (#6740)	2022-12-13 10:05:57 +01:00
Harshal Sheth	d08f5f7cdd	feat(ingest): replace base85's pickle with json (#6178)	2022-10-14 14:48:44 -07:00
Ravindra Lanka	055e4082da	fix(ingestion): fix percent change computation in stale_entity_removal (#6121)	2022-10-04 20:40:59 -07:00
Alexey Kravtsov	3c3ab64954	feat(ingest): implement compression for CheckpointState (#6007)	2022-09-26 10:18:42 -07:00
Harshal Sheth	68db859ca1	refactor(ingest): streamline two-tier db config validation (#5986)	2022-09-21 10:45:37 -07:00
Ravindra Lanka	ee68f09624	feat(ingestion): Refactor standard state-handling tasks into a common handler that are common across all stateful ingestion sources. (#5766)	2022-09-14 09:30:42 -07:00
Tamas Nemeth	63bc830cfe	Data domain containers ingestion (#4051)	2022-02-07 09:51:49 -08:00
Ravindra Lanka	f20382f956	feat(ingest): framework - client side changes for monitoring and reporting (#3807)	2022-02-02 13:19:15 -08:00