3904 Commits

Author	SHA1	Message	Date
Harshal Sheth	38f75be8ad	gometa -> datahub	2021-02-15 18:29:27 -08:00
Harshal Sheth	0063c04460	gometa-ingest -> datahub ingest	2021-02-15 18:29:27 -08:00
Harshal Sheth	b91d0cf63b	Add bigquery and refactor others	2021-02-15 18:29:27 -08:00
Harshal Sheth	cbbdf0930a	Add snowflake	2021-02-15 18:29:27 -08:00
Harshal Sheth	d12497a3ff	Add postgres source	2021-02-15 18:29:27 -08:00
Harshal Sheth	e949e6ec9f	Remove extra files	2021-02-15 18:29:27 -08:00
Harshal Sheth	5666a50a7b	Add hive	2021-02-15 18:29:27 -08:00
Harshal Sheth	813e49856d	Start porting legacy scripts	2021-02-15 18:29:27 -08:00
Harshal Sheth	68da294514	Update README.md	2021-02-15 18:29:27 -08:00
Shirshanka Das	1bbaecfae1	Modifying README to bring in old content	2021-02-15 18:29:27 -08:00
Harshal Sheth	d0bc3c55db	Setup CI	2021-02-15 18:29:27 -08:00
Harshal Sheth	8960f4b57d	Remove codegen files	2021-02-15 18:29:27 -08:00
Harshal Sheth	08ed46eb69	Add docs for each source/sink	2021-02-15 18:29:27 -08:00
Harshal Sheth	f807bb44b8	Use type + config everywhere	2021-02-15 18:29:27 -08:00
Harshal Sheth	3678368ed3	Prune deps	2021-02-15 18:29:27 -08:00
Harshal Sheth	e0560e27ba	Start updating readme	2021-02-15 18:29:27 -08:00
Harshal Sheth	9332e6b878	Add isort to CI	2021-02-15 18:29:27 -08:00
Harshal Sheth	92d1368f5e	Disable ldap, enable mypy	2021-02-15 18:29:27 -08:00
Harshal Sheth	d483d23fd7	Allow/deny patterns for kafka source	2021-02-15 18:29:27 -08:00
Harshal Sheth	df3e3da45b	More autofixes	2021-02-15 18:29:27 -08:00
Harshal Sheth	7ca018aaa4	Remove unused imports	2021-02-15 18:29:27 -08:00
Harshal Sheth	43d5fac494	Black	2021-02-15 18:29:27 -08:00
Harshal Sheth	1de2bacca4	Fix serde test	2021-02-15 18:29:27 -08:00
Harshal Sheth	107cf043d9	Add a create method to pipeline	2021-02-15 18:29:27 -08:00
Harshal Sheth	b2449eedaa	Add serde tests	2021-02-15 18:29:27 -08:00
Harshal Sheth	648f53b553	Fix serde capabilities	2021-02-15 18:29:27 -08:00
Shirshanka Das	7e0a19c92f	bumping up test coverage to 80%	2021-02-15 18:29:27 -08:00
Shirshanka Das	7ba81d7087	remove old shell scripts	2021-02-15 18:29:27 -08:00
Harshal Sheth	ae88fbf727	Streamline serde	2021-02-15 18:29:27 -08:00
Harshal Sheth	761b27893b	Update readme with python 3.6 info	2021-02-15 18:29:27 -08:00
Harshal Sheth	0660991fb8	More python 3.6 compat	2021-02-15 18:29:27 -08:00
Harshal Sheth	42320081e1	Python 3.6 compat	2021-02-15 18:29:27 -08:00
Harshal Sheth	a87161cad7	Run black formatting on tests	2021-02-15 18:29:27 -08:00
Harshal Sheth	2307c59296	Add support for rich kafka config	2021-02-15 18:29:27 -08:00
Harshal Sheth	8c8653d85b	Also loosen mypy dep	2021-02-15 18:29:27 -08:00
Harshal Sheth	d533738efa	Remove py from deps	2021-02-15 18:29:27 -08:00
Harshal Sheth	29c1cfac4d	Rename yaml -> yml	2021-02-15 18:29:27 -08:00
Harshal Sheth	4a3e94986a	Enable mypy in CI	2021-02-15 18:29:27 -08:00
Harshal Sheth	b759205b52	Start checking files for mysql test	2021-02-15 18:29:27 -08:00
Harshal Sheth	36874970ce	Finish file sink	2021-02-15 18:29:27 -08:00
Harshal Sheth	75b01806ef	Use find_packages() in setup	2021-02-15 18:29:27 -08:00
Harshal Sheth	becc953f6e	Remove dead code - DynamicFactory	2021-02-15 18:29:27 -08:00
Harshal Sheth	23d675663b	Minor test runid renames	2021-02-15 18:29:27 -08:00
Harshal Sheth	2ef62149ea	Create examples directory	2021-02-15 18:29:27 -08:00
Harshal Sheth	fcd13000ef	Throw error when aspects are empty	2021-02-15 18:29:27 -08:00
Harshal Sheth	d801c3e1c4	Handle missing kafka schemas elegantly	2021-02-15 18:29:27 -08:00
Harshal Sheth	8ca8ef2d23	Fix kafka tests	2021-02-15 18:29:27 -08:00
Harshal Sheth	82c29d3c94	Properly extract kafka schema	2021-02-15 18:29:27 -08:00
Harshal Sheth	affd5728e6	Integrate kafka extract into source	2021-02-15 18:29:27 -08:00
Harshal Sheth	1e06bda07c	Fix dataclass mypy error	2021-02-15 18:29:27 -08:00