117 Commits

Author SHA1 Message Date
Hyejin Yoon
f986315582
doc: Acryl to DataHub, datahubproject.io to datahub.com (#13252)
Co-authored-by: Jay <159848059+jayacryl@users.noreply.github.com>
2025-04-28 10:34:33 -04:00
Aseem Bansal
49ee849382
chore: update lint dependencies (#13316)
Co-authored-by: Andrew Sikowitz <andrew.sikowitz@acryl.io>
2025-04-25 20:29:11 +05:30
Aseem Bansal
64829a3279
chore(build): upgrade dependencies (#13286) 2025-04-23 14:49:40 +05:30
Harshal Sheth
82fafceba4
ci(airflow): separate airflow constraints from deps (#13291) 2025-04-22 13:54:15 -07:00
Harshal Sheth
a88e15c0d2
fix(ci): ensure extra airflow requirements are respected (#13289) 2025-04-22 12:08:28 -07:00
Sergio Gómez Villamor
60b769fbf6
feat(ariflow-plugin): ability to disable datajob lineage (#13187) 2025-04-14 16:15:19 +02:00
Aseem Bansal
2a75a981ca
chore(ci): upgrade ruff version (#13125) 2025-04-09 11:24:07 +05:30
Sergio Gómez Villamor
4e48e098dc
fix(ingestion): fixes missing platform instance aspect for DataFlow entitiy (#13080) 2025-04-06 08:19:47 +02:00
Rasnar
38e240e916
feat(ingest/airflow): platform_instance support in Airflow plugin (#12751)
Co-authored-by: rasnar <11248833+Rasnar@users.noreply.github.com>
Co-authored-by: Sergio Gómez Villamor <sgomezvillamor@gmail.com>
2025-04-04 09:26:58 +02:00
Harshal Sheth
d3ef859802
fix(airflow): drop airflow 2.3 and 2.4 support (#13004) 2025-03-28 12:58:50 -07:00
kyungryun choi
26d9962a98
fix(airflow): fix logging typo (#13000) 2025-03-27 13:41:37 -07:00
Tamas Nemeth
0093aa8185
chore(ingestion/airflow): Example custom operator with sql parsing (#12959) 2025-03-27 09:18:29 +01:00
Aseem Bansal
d1494c2252
dev: upgrade ruff, remove 2 ruff ignore rules (#12702) 2025-02-24 14:07:57 +05:30
Aseem Bansal
effd4825f3
dev: reduce log in gradle commands (#12677) 2025-02-20 13:47:48 +05:30
Harshal Sheth
79f844b208
chore(py): add unused-noqa lint rule (#12615) 2025-02-13 08:28:48 -08:00
Harshal Sheth
7472c535d3
feat(ci): add pytest hooks for updating golden files (#12581) 2025-02-12 15:32:31 -08:00
Tamas Nemeth
22e012a209
feat(ingestion/airflow): Add support for mutiple datahub emitter (#12398) 2025-01-29 16:44:31 +01:00
Harshal Sheth
a8d6c54965
feat(sdk): move version info to dedicated file (#12456) 2025-01-24 11:35:39 -08:00
Aseem Bansal
262dd76518
dev: remove black in favor of ruff for formatting (#12378) 2025-01-18 15:06:20 +05:30
Aseem Bansal
436b74cd3a
dev: move from flake8,isort to ruff (#12375) 2025-01-17 23:50:13 +05:30
Aseem Bansal
76e46b89db
dev(ingest): move modules from isort,flake8 to ruff (#12373) 2025-01-17 21:38:29 +05:30
Harshal Sheth
03e3f46175
fix(airflow): fix tests with Airflow 2.4 (#12279) 2025-01-07 07:46:35 -08:00
Harshal Sheth
ed8639e401
chore(python): test with python 3.11 (#11280)
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
Co-authored-by: Mayuri Nehate <33225191+mayurinehate@users.noreply.github.com>
2024-12-27 10:46:49 -08:00
Tamas Nemeth
b3a76cb308
feat(ingest/airflow): Add way to disable Airflow plugin without a restart (#12098) 2024-12-16 11:29:13 -08:00
Harshal Sheth
ecf6c8c588
feat(airflow): add DatahubRestHook.make_graph method (#12116) 2024-12-15 10:27:50 -05:00
Harshal Sheth
2babbe6b0f
feat(airflow): drop Airflow < 2.3 support + make plugin v2 the default (#12056) 2024-12-09 11:08:49 -08:00
Steffen Grohsschmiedt
49b6284ebf
fix(airflow): fix AthenaOperator extraction (#11857)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-12-03 16:16:44 -08:00
Chakru
85b42e3ea5
build(coverage): enable code coverage for java and python (#11992)
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2024-12-02 19:27:43 -06:00
Harshal Sheth
411e1a30ff
feat(airflow): show dag/task logs in CI (#11981) 2024-12-02 09:53:02 -08:00
JaeMoo Han
418259b8c4
fix(airflow): remove trino to presto mapping (#11925)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-11-25 12:13:26 -08:00
Tamas Nemeth
435792ca2e
fix(ingest/airflow): Add log to dag emit (#11880) 2024-11-18 17:00:22 +01:00
Harshal Sheth
be1b8806a7
fix(airflow): fix lint related to dag_run field (#11616) 2024-10-15 14:09:41 +05:30
dushayntAW
f13dae1cd2
fix(airflow): add dag AllowDenyPattern config (#11472)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-10-11 10:46:01 -07:00
Harshal Sheth
771cc9ffe4
feat(airflow): add airflow 2.10 to test matrix (#11579) 2024-10-10 09:30:43 -07:00
Harshal Sheth
0414443b77
feat(airflow): add a render_templates config parameter (#11537) 2024-10-09 18:24:38 -07:00
Andrew Sikowitz
3e3a05f09c
test(ingest/mcp_diff): Fallback to overwriting file on more complicated diffs (#11407)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-09-18 16:40:08 -07:00
dushayntAW
fca86bc5a9
fix(airflow): added support for jinja template for datahub emitter operator (#11300) 2024-09-17 12:57:45 -07:00
Harshal Sheth
1d83131601
fix(ingest/airflow): simplify env configuration (#11371) 2024-09-17 12:54:03 -07:00
Harshal Sheth
dfa97758a1
chore(py): cleanup python CI (#11324) 2024-09-11 10:49:16 -07:00
Aseem Bansal
15c1cfc386
ci(build): update outdated action & pin deepdiff lib (#11260) 2024-08-28 19:53:42 +05:30
Tamas Nemeth
1893b7b2dc
feat(ingest/dagster): Add automatic snowflake_pandas_io_manager asset capture (#11189)
Co-authored-by: shubhamjagtap639 <shubham.jagtap@gslab.com>
Co-authored-by: John Joyce <john@acryl.io>
2024-08-28 09:22:11 +02:00
Mayuri Nehate
9568a4254d
feat: separate great-expectations action package (#11096)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-08-21 12:13:36 -04:00
dushayntAW
0e698173fe
fix(ingestion/airflow-plugin): fixed missing inlet/outlets (#11101)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-08-18 20:30:27 -04:00
Harshal Sheth
3d4b3b900d
fix(airflow): fix tox tests + update docs (#11125) 2024-08-12 10:15:42 -07:00
Harshal Sheth
840b15083a
fix(sql-parser): prevent bad urns from alter table lineage (#11092) 2024-08-08 14:05:55 -07:00
Harshal Sheth
f78b6c08fb
fix(py): remove dep on types-pkg_resources (#11076) 2024-08-02 17:27:54 +05:30
Tamas Nemeth
123e84cfed
fix(airflow/build): Pinning mypy (#10972) 2024-07-23 12:30:34 -07:00
Harshal Sheth
3733a408fd
chore(airflow): add python 3.11 w/ Airflow 2.9 to CI (#10941) 2024-07-19 10:03:12 +05:30
Ellie O'Neil
0b64de8f2b
fix(airflow): Add comma parsing of owners to DataJobs (#10903) 2024-07-17 14:58:25 -07:00
Harshal Sheth
bb24651264
fix(airflow): add error handling around render_template() (#10907) 2024-07-16 12:27:37 -07:00