3975 Commits

Author	SHA1	Message	Date
Harshal Sheth	0310e97b5b	feat(ingest): capture table descriptions (#2157)	2021-03-02 11:49:37 -08:00
Harshal Sheth	dced25fef7	feat(ingest): switch quickstart to Python ingestion (#2158)	2021-03-02 11:48:26 -08:00
Pedro Silva	6c7668115f	feat(ingest): support alternative authentication in sql ingestion (#2156)	2021-03-02 11:47:47 -08:00
Harshal Sheth	11532a1cc3	build(docker): add large generated directories to dockerignore (#2151)	2021-03-02 10:48:55 -08:00
Harshal Sheth	9e73794022	ci(ingest): setup docker container for metadata ingestion (#2150)	2021-03-01 17:36:38 -08:00
Harshal Sheth	656d9c771b	feat(ingest): support Postgres PostGIS extensions (#2136)	2021-02-25 09:05:16 -08:00
Harshal Sheth	d2745ee9cd	ci(ingest): run apt update (#2135)	2021-02-23 20:51:23 -08:00
Harshal Sheth	ac064584ae	refactor(ingest): cleanup configuration models (#2134)	2021-02-23 15:55:31 -08:00
Harshal Sheth	2a184dd3d5	fix(ingest): gracefully handle unknown types (#2125)	2021-02-19 19:57:13 -08:00
Harshal Sheth	e096c61a32	fix(ingest): update sample MCEs based on MLModel changes (#2124)	2021-02-19 17:03:27 -08:00
Harshal Sheth	b2fc27dbe8	docs(ingest): add solutions for common install issues (#2123)	2021-02-18 20:06:30 -08:00
Harshal Sheth	76e0594b8b	feat(ingest): add support for LDAP ingestion (#2122)	2021-02-18 20:05:39 -08:00
Harshal Sheth	9336cbc743	test(ingest): verify the output of mssql (#2120)	2021-02-18 14:47:49 -08:00
Harshal Sheth	dfe00bfee8	feat(ingest): improve error reporting for pipelines (#2121)	2021-02-18 11:15:13 -08:00
Harshal Sheth	02ffa6fd54	docs(ingest): add example DAGs for Airflow (#2116)	2021-02-17 18:01:22 -08:00
RyanHolstien	ea86ade29b	feat: ML Model Backend Implementation (#1896) ... Co-authored-by: RyanHolstien <rholstien@expediagroup.com>	2021-02-17 13:28:13 -08:00
Harshal Sheth	fd4878a89d	docs(ingest): clarify docs for new ingestion framework (#2108)	2021-02-16 15:31:13 -08:00
Harshal Sheth	6e0c7ee37f	Add architecture diagram	2021-02-15 18:29:27 -08:00
Harshal Sheth	6b750fc4fb	Update docs	2021-02-15 18:29:27 -08:00
Harshal Sheth	347148b79b	Update python workflow	2021-02-15 18:29:27 -08:00
Harshal Sheth	2d901a087a	Remove docker scripts	2021-02-15 18:29:27 -08:00
Harshal Sheth	38f75be8ad	gometa -> datahub	2021-02-15 18:29:27 -08:00
Harshal Sheth	0063c04460	gometa-ingest -> datahub ingest	2021-02-15 18:29:27 -08:00
Harshal Sheth	b91d0cf63b	Add bigquery and refactor others	2021-02-15 18:29:27 -08:00
Harshal Sheth	cbbdf0930a	Add snowflake	2021-02-15 18:29:27 -08:00
Harshal Sheth	d12497a3ff	Add postgres source	2021-02-15 18:29:27 -08:00
Harshal Sheth	e949e6ec9f	Remove extra files	2021-02-15 18:29:27 -08:00
Harshal Sheth	5666a50a7b	Add hive	2021-02-15 18:29:27 -08:00
Harshal Sheth	813e49856d	Start porting legacy scripts	2021-02-15 18:29:27 -08:00
Harshal Sheth	68da294514	Update README.md	2021-02-15 18:29:27 -08:00
Shirshanka Das	1bbaecfae1	Modifying README to bring in old content	2021-02-15 18:29:27 -08:00
Harshal Sheth	d0bc3c55db	Setup CI	2021-02-15 18:29:27 -08:00
Harshal Sheth	8960f4b57d	Remove codegen files	2021-02-15 18:29:27 -08:00
Harshal Sheth	08ed46eb69	Add docs for each source/sink	2021-02-15 18:29:27 -08:00
Harshal Sheth	f807bb44b8	Use type + config everywhere	2021-02-15 18:29:27 -08:00
Harshal Sheth	3678368ed3	Prune deps	2021-02-15 18:29:27 -08:00
Harshal Sheth	e0560e27ba	Start updating readme	2021-02-15 18:29:27 -08:00
Harshal Sheth	9332e6b878	Add isort to CI	2021-02-15 18:29:27 -08:00
Harshal Sheth	92d1368f5e	Disable ldap, enable mypy	2021-02-15 18:29:27 -08:00
Harshal Sheth	d483d23fd7	Allow/deny patterns for kafka source	2021-02-15 18:29:27 -08:00
Harshal Sheth	df3e3da45b	More autofixes	2021-02-15 18:29:27 -08:00
Harshal Sheth	7ca018aaa4	Remove unused imports	2021-02-15 18:29:27 -08:00
Harshal Sheth	43d5fac494	Black	2021-02-15 18:29:27 -08:00
Harshal Sheth	1de2bacca4	Fix serde test	2021-02-15 18:29:27 -08:00
Harshal Sheth	107cf043d9	Add a create method to pipeline	2021-02-15 18:29:27 -08:00
Harshal Sheth	b2449eedaa	Add serde tests	2021-02-15 18:29:27 -08:00
Harshal Sheth	648f53b553	Fix serde capabilities	2021-02-15 18:29:27 -08:00
Shirshanka Das	7e0a19c92f	bumping up test coverage to 80%	2021-02-15 18:29:27 -08:00
Shirshanka Das	7ba81d7087	remove old shell scripts	2021-02-15 18:29:27 -08:00
Harshal Sheth	ae88fbf727	Streamline serde	2021-02-15 18:29:27 -08:00