41 Commits

Author SHA1 Message Date
Harshal Sheth
8ff905f0d3
docs(ingest): update metadata-ingestion dev guide (#12779) 2025-03-07 11:22:17 -08:00
Aseem Bansal
262dd76518
dev: remove black in favor of ruff for formatting (#12378) 2025-01-18 15:06:20 +05:30
Aseem Bansal
765bf80282
dev(ingest): move from isort to ruff (#12364) 2025-01-16 16:48:21 +05:30
Aseem Bansal
2226820ad1
dev(ingest): use ruff instead of flake8 (#12359) 2025-01-16 08:19:07 +05:30
Harshal Sheth
cfe65ccb3c
chore(ingest): speed up lintFix command (#12346) 2025-01-15 10:59:20 -08:00
Tamas Nemeth
f6760436b7
feat(ingestion/dagster): Dagster assetless ingestion (#11262)
Co-authored-by: shubhamjagtap639 <shubham.jagtap@gslab.com>
2024-10-24 16:06:00 +02:00
Harshal Sheth
1bea570b8d
docs(ingest): add docs on pydantic compatibility (#11423) 2024-09-20 13:22:15 -07:00
dushayntAW
6204cba2bb
fix(ingestion/prefect-plugin): Prefect plugin (#10643)
Co-authored-by: shubhamjagtap639 <shubham.jagtap@gslab.com>
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
2024-08-29 15:40:10 +02:00
Mayuri Nehate
9568a4254d
feat: separate great-expectations action package (#11096)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-08-21 12:13:36 -04:00
dushayntAW
12455f95d7
doc(ingestion/airflow-plugin): update for developers (#10633) 2024-06-06 14:31:39 +05:30
Harshal Sheth
07ef677ad3
feat(ingest): loosen airflow plugin dependencies requirements (#10106) 2024-03-27 22:32:53 +01:00
Tamas Nemeth
7e5610f358
feat(ingest/dagster): Dagster source (#10071)
Co-authored-by: shubhamjagtap639 <shubham.jagtap@gslab.com>
2024-03-25 13:28:35 +01:00
Harshal Sheth
1498c36875
chore(cli): drop support for python 3.7 (#9731) 2024-01-29 10:50:47 -08:00
tom
f7f0b14f37
fix(ingestion/metabase): Fetch Dashboards through Collections (#9631)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-01-25 17:51:41 -08:00
Harshal Sheth
ca518d6c78
feat(ingest): remove librdkafka hacks (#9507) 2023-12-21 20:28:45 -05:00
Harshal Sheth
9deb7be3fc
fix(ingest): refactor test markers + fix disk space issues in CI (#8938) 2023-10-03 20:17:49 -07:00
Mayuri Nehate
e867dbc3da
ci: separate airflow build and test (#8688)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-08-30 14:08:42 -07:00
Hyejin Yoon
04ecf4f75a
docs(docs): add native versioning (#8714) 2023-08-25 14:10:13 -07:00
Aseem Bansal
535e1abe44
chore(ci): fix CI failing due to lint (#7863) 2023-04-20 16:53:36 +05:30
Harshal Sheth
66f255e805
docs(ingest): add guidelines around proactive version pinning (#7534) 2023-03-10 10:16:01 -08:00
Harshal Sheth
376fffeebc
docs(ingest): add more guidelines for writing sources (#7451) 2023-02-28 11:53:43 -08:00
Harshal Sheth
d02701d91c
docs(ingest): add ingestion configs guide (#7438) 2023-02-26 16:04:23 -08:00
Peter Szalai
b496994e06
docs(ingestion): Improve developer docs (#5644) 2022-08-15 12:41:23 -07:00
Harshal Sheth
355c129c7c
chore(ingest): drop python 3.6 support (#5521) 2022-08-10 15:00:31 -07:00
Aseem Bansal
2b77468b7b
doc(ingest): update golden file command (#4992) 2022-05-24 22:22:19 -07:00
Sagar Tiwari
830f2b0d6f
fix(docs): Update developing.md to mention directory context (#4899) 2022-05-11 10:00:37 -07:00
Aseem Bansal
f3d01009df
docs(ingest): fix command for running quick tests (#3942) 2022-01-21 07:40:31 -08:00
mayurinehate
1d7ec8dba8
feat(ingest): add nifi source (#3681) 2021-12-08 14:56:31 -08:00
Swaroop Jagadish
46861600fa
feat(build): add incremental builds for python (#3647) 2021-11-30 18:01:56 -08:00
aseembansal-gogo
2c901f7cf9
fix(docs): fix docs for developing on metadata ingestion (#3353) 2021-10-11 22:49:00 -07:00
John Joyce
8c9c696cdd
feat(ingest): Adding an Okta Integration to extract Users, Groups, Group Membership (#3043) 2021-08-11 18:49:16 -07:00
Kevin Hu
8a23d0eac9
fix(docs): update metadata ingestion dev guide (#3039) 2021-08-08 15:28:41 -07:00
Harshal Sheth
be39037b10
build(ingest): reduce dependencies for dev install (#2872) 2021-07-14 20:02:48 -07:00
Harshal Sheth
c05459b446
docs: upgrade docusaurus, minor ingestion updates (#2774) 2021-06-27 23:38:38 -07:00
Harshal Sheth
deca4a5073
docs(ingest): add a guide for writing sources (#2575) 2021-05-24 12:23:03 -07:00
Harshal Sheth
a47400f18e
build(ingest): use gradle in commands + docs (#2531) 2021-05-11 19:03:20 -07:00
Harshal Sheth
36922c1746
docs: enable better syntax highlighting (#2529) 2021-05-11 15:16:12 -07:00
Harshal Sheth
90108f4aba
docs(ingest): add gradle build step to developing setup as well (#2479) 2021-04-30 21:07:51 -07:00
Harshal Sheth
41cd52f9e2
feat(ingest): add Airflow lineage backend (#2368) 2021-04-12 17:40:15 -07:00
Harshal Sheth
518de354d9
fix(ingest): support python3 -m datahub (#2359) 2021-04-07 14:58:58 -07:00
Harshal Sheth
bd78b84bd3
feat(ingest): start airflow integration + metadata builders (#2331) 2021-04-05 19:11:28 -07:00