65 Commits

Author SHA1 Message Date
Hyejin Yoon
e24ef15e77
docs: use sphinx-markdown-builder for sdk doc generation (#13721) 2025-06-13 16:50:19 +09:00
Hyejin Yoon
f986315582
doc: Acryl to DataHub, datahubproject.io to datahub.com (#13252)
Co-authored-by: Jay <159848059+jayacryl@users.noreply.github.com>
2025-04-28 10:34:33 -04:00
Andrew Sikowitz
d138a64a6a
ci(graphql,workflows): Format .md, .graphql, and workflow .yml files via prettier (#13220) 2025-04-16 16:55:51 -07:00
Sergio Gómez Villamor
60b769fbf6
feat(ariflow-plugin): ability to disable datajob lineage (#13187) 2025-04-14 16:15:19 +02:00
Rasnar
38e240e916
feat(ingest/airflow): platform_instance support in Airflow plugin (#12751)
Co-authored-by: rasnar <11248833+Rasnar@users.noreply.github.com>
Co-authored-by: Sergio Gómez Villamor <sgomezvillamor@gmail.com>
2025-04-04 09:26:58 +02:00
Kevin Karch
cd05c0f2fe
docs(ingest): more specific CLL limitation language (#13061) 2025-04-02 13:12:25 -04:00
Harshal Sheth
d3ef859802
fix(airflow): drop airflow 2.3 and 2.4 support (#13004) 2025-03-28 12:58:50 -07:00
Tamas Nemeth
0093aa8185
chore(ingestion/airflow): Example custom operator with sql parsing (#12959) 2025-03-27 09:18:29 +01:00
Harshal Sheth
9759a58d04
docs(ingest): add more details on SQL parser limitations (#12669) 2025-02-21 16:16:07 -08:00
Tamas Nemeth
b3a76cb308
feat(ingest/airflow): Add way to disable Airflow plugin without a restart (#12098) 2024-12-16 11:29:13 -08:00
Harshal Sheth
bc4c7c633e
docs(ingest): add docs on the SQL parser (#12103) 2024-12-12 13:51:24 -08:00
Harshal Sheth
2babbe6b0f
feat(airflow): drop Airflow < 2.3 support + make plugin v2 the default (#12056) 2024-12-09 11:08:49 -08:00
Harshal Sheth
d7ccf3b2c3
docs(airflow): add known limitations for automatic lineage (#11652) 2024-10-17 16:36:18 -07:00
dushayntAW
f13dae1cd2
fix(airflow): add dag AllowDenyPattern config (#11472)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-10-11 10:46:01 -07:00
Harshal Sheth
0414443b77
feat(airflow): add a render_templates config parameter (#11537) 2024-10-09 18:24:38 -07:00
Tamas Nemeth
ee2a9781d6
fix(ingest/dagster): Fixing path to the dagster logo (#11489)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-09-27 22:50:04 +02:00
dushayntAW
6204cba2bb
fix(ingestion/prefect-plugin): Prefect plugin (#10643)
Co-authored-by: shubhamjagtap639 <shubham.jagtap@gslab.com>
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
2024-08-29 15:40:10 +02:00
Tamas Nemeth
1893b7b2dc
feat(ingest/dagster): Add automatic snowflake_pandas_io_manager asset capture (#11189)
Co-authored-by: shubhamjagtap639 <shubham.jagtap@gslab.com>
Co-authored-by: John Joyce <john@acryl.io>
2024-08-28 09:22:11 +02:00
Harshal Sheth
3d4b3b900d
fix(airflow): fix tox tests + update docs (#11125) 2024-08-12 10:15:42 -07:00
Harshal Sheth
2369032077
docs(airflow): update min version for plugin v2 (#11065) 2024-08-01 10:05:49 -07:00
Ellie O'Neil
f73149a059
docs(airflow): example query to get datajobs for a dataflow (#11034) 2024-07-31 17:01:09 +05:30
Hyejin Yoon
a6eb1f47c2
docs: standardize terminology to DataHub Cloud (#11003) 2024-07-30 09:52:51 +09:00
Tamas Nemeth
f4fb89e799
feat(ingest/spark): Promote beta plugin (#10881)
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
2024-07-25 14:46:32 +02:00
Francesco Macagno
750aab9a51
feat: allow task ownership as group (#10742) 2024-06-19 11:14:30 +02:00
dushayntAW
177a50f9a7
fix(ingestion/airflow-plugin): airflow remove old tasks (#10485) 2024-06-10 15:24:20 +05:30
dushayntAW
12455f95d7
doc(ingestion/airflow-plugin): update for developers (#10633) 2024-06-06 14:31:39 +05:30
Harshal Sheth
c1e7574b57
feat(ingest/airflow): support BigQueryInsertJobOperator (#10452) 2024-05-15 22:07:22 +02:00
Tamas Nemeth
d08f36f14b
feat(spark/openlineage): Use Openlineage 1.13.1 in Spark Plugin (#10433)
- Use Openlineage 1.13.1 in Spark Plugin
- Add retry option to datahub client and Spark Plugin
- Add OpenLineage integration doc
2024-05-07 11:15:46 +02:00
Aseem Bansal
d3fb698d8d
fix(ingest): make gms url configuration resilient in rest emitter (#10316) 2024-04-18 14:46:32 +05:30
Harshal Sheth
76b5783e70
feat(ingest/airflow): support disabling iolet materialization (#10305) 2024-04-17 17:07:22 -07:00
Tamas Nemeth
7e5610f358
feat(ingest/dagster): Dagster source (#10071)
Co-authored-by: shubhamjagtap639 <shubham.jagtap@gslab.com>
2024-03-25 13:28:35 +01:00
Peng G
ea0ae8cb54
feat(airflow) Override datajob external_url (#9681)
Co-authored-by: Peng Gao <pgao@slack-corp.com>
2024-02-07 09:28:30 +01:00
Harshal Sheth
0d9aa26410
fix(ingest/airflow): compat with pluggy 1.0 (#9365) 2023-12-04 20:00:57 -05:00
Harshal Sheth
a8476ee657
fix(airflow): support inlet datajobs correctly in v1 plugin (#9331) 2023-11-30 18:34:48 -05:00
Jia (Jason) Teoh
c348f841c6
docs(airflow): update plugin setup docs to include UI setup approach (#9253) 2023-11-16 18:05:56 -06:00
Harshal Sheth
ec13847f54
feat(airflow): make RUN_IN_THREAD configurable (#9226) 2023-11-14 14:25:26 -05:00
Harshal Sheth
a300b39f15
feat(ingest/airflow): airflow plugin v2 (#8853) 2023-10-04 16:23:15 +05:30
Hyejin Yoon
52156193b6
docs(lineage): Lineage docs refactoring (#8899) 2023-10-04 08:43:59 +00:00
Mayuri Nehate
e867dbc3da
ci: separate airflow build and test (#8688)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-08-30 14:08:42 -07:00
Harshal Sheth
022d1d0784
docs(ingest/airflow): add capture_executions to docs (#8662) 2023-08-20 04:44:28 +05:30
matthew-coudert-cko
5e45db9e60
docs(airflow): add docs on custom operators (#7913)
Co-authored-by: John Joyce <john@acryl.io>
2023-06-15 12:46:25 +05:30
Indy Prentice
7391e805dd
docs(lineage): document timestamp filtering in lineage feature (#8174)
Co-authored-by: Indy Prentice <indy@Indys-MacBook-Pro.local>
2023-06-06 16:21:46 -07:00
Harshal Sheth
f314d896b9
docs(airflow): add debug guide on url generation (#7885)
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
2023-04-25 12:25:25 -07:00
Aseem Bansal
0e04e0c80f
docs(airflow): update with information for new plugin (#7732) 2023-04-04 15:20:02 +05:30
cburroughs
cc0772f8d8
feat(ingest): unbundle airflow plugin emitter dependencies (#7493)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-03-07 09:07:42 -08:00
Paul Logan
d2719cf0af
Saas docs migration (#6603) 2023-02-16 15:44:04 -06:00
Maggie Hays
0426f5cd4a
docs(lineage): Updating Lineage feature guide (#6257) 2023-01-25 15:36:04 -06:00
Chris Collins
cbd32b36d2
feat(docs) Add feature guide for Manual Lineage (#6933)
Co-authored-by: John Joyce <john@acryl.io>
2023-01-09 16:22:59 -08:00
Harshal Sheth
7d7da15742
docs(ingest/airflow): clarify Airflow 1.x docs for airflow plugin (#6761) 2022-12-14 23:48:06 +01:00
Harshal Sheth
9c04c63813
docs(ingest): airflow - clarify docs around 1.x compat (#6436) 2022-11-14 21:30:42 -08:00