4 Commits

Author SHA1 Message Date
Chris Lee
4143fb901e
<refactor>[ingestions]: align the default kafka topics with PR #1756 (#1758) 2020-07-29 20:26:01 -07:00
cobolbaby
5dc61658f8
fix: correct the way to catch the exception (#1727)
* fix: modify the etl script dependency

* fix: Correct the way to catch the exception

* fix: Compatible with the following kafka cluster when the Kafka Topic message Key cannot be empty

* fix: Adjust the kafka message key; Improve the comment of field

* fix: Avro schema required for key

Co-authored-by: Cobolbaby <Zhang.Xing-Long@inventec.com>
2020-07-10 07:56:19 -07:00
Mars Lan
221c9af220
feature(ingest): add bigquery ETL script (#1711)
Also fix minor issues in the common script
2020-06-25 15:28:13 -07:00
Mars Lan
4fea6083f8
feature(etl): add SQLAlchemy-based ingestion script (#1708)
This replaces the old incomplete rdbms ETL script.
2020-06-22 21:25:55 -07:00