cobolbaby
5dc61658f8
fix: correct the way to catch the exception ( #1727 )
...
* fix: modify the etl script dependency
* fix: Correct the way to catch the exception
* fix: Compatible with the following kafka cluster when the Kafka Topic message Key cannot be empty
* fix: Adjust the kafka message key; Improve the comment of field
* fix: Avro schema required for key
Co-authored-by: Cobolbaby <Zhang.Xing-Long@inventec.com>
2020-07-10 07:56:19 -07:00
cobolbaby
ed128080e2
fix: modify the etl script dependency ( #1726 )
...
Co-authored-by: Cobolbaby <Zhang.Xing-Long@inventec.com>
2020-07-08 21:51:42 -07:00
Mars Lan
65bf623b8b
feat(ingest): add snowflake ETL script ( #1714 )
2020-06-25 19:05:38 -07:00
Mars Lan
682bb87a7e
feat(ingest): replace custom hive-etl with sql-based ETL ( #1713 )
...
This offloads most of the heavy lifting to SQLAlchemy.
Also add a docker file for testing
2020-06-25 19:04:56 -07:00
Mars Lan
5da55fe8d3
Update README.md
2020-06-25 16:32:22 -07:00
Mars Lan
52a54b9fda
feat(ingest): add PostgreSQL ETL script ( #1712 )
...
Also add a simple docker file for testing
2020-06-25 15:28:42 -07:00
Mars Lan
221c9af220
feature(ingest): add bigquery ETL script ( #1711 )
...
Also fix minor issues in the common script
2020-06-25 15:28:13 -07:00
Mars Lan
4fea6083f8
feature(etl): add SQLAlchemy-based ingestion script ( #1708 )
...
This replaces the old incomplete rdbms ETL script.
2020-06-22 21:25:55 -07:00
