117 Commits

Author SHA1 Message Date
dushayntAW
2e496d599a
fix(ingestion/airflow-plugin): pipeline tasks discoverable in search (#10819) 2024-07-02 15:29:16 +05:30
Harshal Sheth
6f1f7691a0
fix(airflow): fix airflow snowflake tests (#10803) 2024-06-28 13:03:58 +05:30
dushayntAW
190f09ad7a
fix(ingestion/airflow-plugin): emit browsePathV2 (#10738) 2024-06-20 14:23:22 +05:30
Francesco Macagno
750aab9a51
feat: allow task ownership as group (#10742) 2024-06-19 11:14:30 +02:00
dushayntAW
b2ba837987
fix(ingestion/airflow-plugin): fixed the failing pipeline (#10737) 2024-06-18 14:04:09 +02:00
Harshal Sheth
5da77df75d
feat(ingest/airflow): fix materialize_iolets bug (#10613) 2024-06-12 15:07:00 +02:00
dushayntAW
177a50f9a7
fix(ingestion/airflow-plugin): airflow remove old tasks (#10485) 2024-06-10 15:24:20 +05:30
Harshal Sheth
2e14f70864
test(ingest/sql): refactor CLL generator + add tests (#10580) 2024-05-23 18:11:22 -07:00
Harshal Sheth
ebb95b8a9a
fix(ingest/airflow): fix support for bigquery insert job operator (#10567) 2024-05-22 07:38:36 +02:00
Harshal Sheth
c1e7574b57
feat(ingest/airflow): support BigQueryInsertJobOperator (#10452) 2024-05-15 22:07:22 +02:00
dushayntAW
a86ec7b088
fix(ingestion/airflow-plugin): bumping up the openlineage-airflow version (#10457) 2024-05-09 13:00:40 +05:30
dushayntAW
4d20c22a49
fix(ingestion/airflow-plugin): warning log for non-materialized iolets (#10421) 2024-05-08 14:11:16 +05:30
dushayntAW
6f02001501
fix(ingest/airflow-plugin): emit the operation aspect (#10402) 2024-05-03 19:20:00 +05:30
Hyejin Yoon
f9dbe985d3
fix: make next as default version & create redirection (#10309)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-04-19 15:12:32 +09:00
Aseem Bansal
d3fb698d8d
fix(ingest): make gms url configuration resilient in rest emitter (#10316) 2024-04-18 14:46:32 +05:30
Harshal Sheth
76b5783e70
feat(ingest/airflow): support disabling iolet materialization (#10305) 2024-04-17 17:07:22 -07:00
Marcin Szymański
47bf1f9858
fix(ingestion/airflow-plugin): replace deprecated calls (#10238) 2024-04-10 10:16:44 -07:00
Harshal Sheth
3d1571dd6f
fix(airflow): disable OL regardless of plugin status (#10250) 2024-04-09 10:54:12 +02:00
dushayntAW
b6c4d9c0bb
fix(ingestion/airflow-plugin): emit tag to create tag entities (#10216) 2024-04-08 17:30:50 +05:30
Harshal Sheth
f38b626d3d
fix(build): avoid nested gradle commands (#10198) 2024-04-04 12:46:00 -07:00
Harshal Sheth
32a2de4dfc
feat(ingest/airflow): allow plugin to load on listener exception (#10152) 2024-03-28 12:43:37 -07:00
Harshal Sheth
07ef677ad3
feat(ingest): loosen airflow plugin dependencies requirements (#10106) 2024-03-27 22:32:53 +01:00
Harshal Sheth
1598070899
fix(ci): simplify python release process (#10133) 2024-03-25 21:46:57 -04:00
Harshal Sheth
630f2a13f6
feat(ingest): check for private import path usages (#10059) 2024-03-18 14:59:18 -07:00
Harshal Sheth
0c7ca4cd3e
docs(ingest/lookml): update known discrepancy list (#9941)
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
2024-02-29 12:39:32 -08:00
Harshal Sheth
02f41b74b6
feat(ingest): use uv for python package installs (#9885) 2024-02-26 15:02:47 -08:00
Harshal Sheth
0d780e5f8f
feat(ingest): sql parsing aggregator (#9786) 2024-02-09 16:27:45 -05:00
Peng G
ea0ae8cb54
feat(airflow) Override datajob external_url (#9681)
Co-authored-by: Peng Gao <pgao@slack-corp.com>
2024-02-07 09:28:30 +01:00
Harshal Sheth
1498c36875
chore(cli): drop support for python 3.7 (#9731) 2024-01-29 10:50:47 -08:00
Harshal Sheth
5adb799f13
fix(cli): fix example data contract yaml + update airflow codecov (#9707) 2024-01-26 23:02:52 +01:00
Harshal Sheth
388b3ec0ac
fix(ingest/airflow): fix plugin support for airflow 2.5.0 (#9719) 2024-01-26 23:01:48 +01:00
Andrew Sikowitz
53c7790f9a
feat(ingest/metabase): Use new sql parser; reduce error reporting levels (#9714) 2024-01-25 10:36:59 +01:00
david-leifker
943bb57cbc
feat(backend): structured properties and forms (#9626)
Co-authored-by: Chris Collins <chriscollins3456@gmail.com>
Co-authored-by: RyanHolstien <RyanHolstien@users.noreply.github.com>
2024-01-22 11:46:04 -06:00
Harshal Sheth
14dee5723d
feat(ingest/airflow): support airflow 2.8 dataset listeners (#9664) 2024-01-19 16:18:15 -08:00
Harshal Sheth
ecda3e6187
feat(ingest): pydantic v2 compatibility (#9434) 2023-12-18 18:26:33 -05:00
Harshal Sheth
0d9aa26410
fix(ingest/airflow): compat with pluggy 1.0 (#9365) 2023-12-04 20:00:57 -05:00
Harshal Sheth
f9fd9467ef
feat(ingest): clean up DataHubRestEmitter return type (#9286)
Co-authored-by: Andrew Sikowitz <andrew.sikowitz@acryl.io>
2023-11-30 21:00:43 -05:00
Harshal Sheth
a8476ee657
fix(airflow): support inlet datajobs correctly in v1 plugin (#9331) 2023-11-30 18:34:48 -05:00
Harshal Sheth
ec13847f54
feat(airflow): make RUN_IN_THREAD configurable (#9226) 2023-11-14 14:25:26 -05:00
Harshal Sheth
19aa215068
feat(ingest/dbt): dbt column-level lineage (#8991) 2023-11-13 19:00:30 -05:00
Shubham Jagtap
bb7300251f
feat(ingestion/airflow): support datajobs as task inlets (#9211)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-11-10 15:59:18 -08:00
Harshal Sheth
86d2b08d2b
docs(ingest): inherit capabilities from superclasses (#9174) 2023-11-06 15:58:07 -05:00
richenc
8b1d2094aa
feat(airflow): retry callback, support ExternalTaskSensor subclasses (#8514)
Co-authored-by: Richie Chen <richie.chen@hulu.com>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-10-27 10:36:47 -07:00
Harshal Sheth
8fb95e88a1
feat(sqlparser): parse create DDL statements (#9002) 2023-10-23 12:40:42 -07:00
Harshal Sheth
a300b39f15
feat(ingest/airflow): airflow plugin v2 (#8853) 2023-10-04 16:23:15 +05:30
Harshal Sheth
6c6216aaa2
fix(airflow): fix provider loading exception (#8861) 2023-09-20 12:00:23 -07:00
Harshal Sheth
449cc9ba91
ci: make wheel builds more robust (#8815) 2023-09-12 13:15:05 -07:00
Harshal Sheth
f7fee743bf
fix(ingest): use epoch 1 for dev build versions (#8824) 2023-09-12 13:11:01 -07:00
Mayuri Nehate
f649d6fc17
feat(airflow-plugin): add package type information (#8795) 2023-09-06 10:38:35 -07:00
Mayuri Nehate
e867dbc3da
ci: separate airflow build and test (#8688)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-08-30 14:08:42 -07:00