Fredrik Sannholm
e0aa812621
feat(ingest): allow extracting snowflake tags ( #6500 )
2023-01-04 16:05:23 -05:00
Harshal Sheth
6bc85502ba
feat(ingest): add include_table_location_lineage flag for SQL common ( #6934 )
2023-01-04 14:30:33 -05:00
Aseem Bansal
7e73ae7483
fix(ci): managed ingestion test fix ( #6946 )
2023-01-04 18:35:17 +05:30
dependabot[bot]
3f706133ff
chore(deps): bump json5 from 1.0.1 to 1.0.2 in /datahub-web-react ( #6931 )
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Aseem Bansal <asmbansal2@gmail.com>
2023-01-04 17:07:08 +05:30
dependabot[bot]
0fded4d402
chore(deps): bump json5 from 2.2.1 to 2.2.3 in /docs-website ( #6930 )
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-01-04 16:24:57 +05:30
John Joyce
22ee828236
feat(backend): Supporting Embeddable Previews for Dashboards, Charts, Datasets ( #6875 )
2023-01-03 15:40:39 -08:00
Peter Szalai
a629df5de2
fix(kafka-setup): Fix compose context for kafka-setup ( #6923 )
2023-01-03 08:12:31 -08:00
mohdsiddique
54ea8244de
feat(ingestion): PowerBI# Improve PowerBI source ingestion ( #6549 )
...
Co-authored-by: MohdSiddique Bagwan <mohdsiddique.bagwan@gslab.com>
2023-01-03 08:08:11 -08:00
Maggie Hays
65386315d0
docs(): Adding missing Platform logos ( #6892 )
2023-01-03 07:24:35 -08:00
Peter Szalai
a164bdabe2
fix(es-setup): create data stream on non-aws ( #6926 )
2023-01-03 09:52:45 +01:00
cc
4209d6f3dd
fix(ingest/metabase): use card_id in dashboard to chart lineage ( #6583 )
...
Co-authored-by: 陈城 <cheng.chen@tenclass.com>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2022-12-30 17:27:09 -05:00
Harshal Sheth
e9176d2cd2
docs(ingest/looker): fix typos + update lookml github action example ( #6910 )
2022-12-30 20:54:43 +01:00
Harshal Sheth
b9677229a1
chore(ingest): loosen pyspark and pydeequ deps ( #6908 )
2022-12-30 20:53:38 +01:00
Harshal Sheth
62a2aa94f6
feat: remove jq requirement + tweak modeldocgen args ( #6904 )
...
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
2022-12-30 14:02:57 -05:00
Stijn De Haes
b796db1caf
fix(ingest/airflow): reorder imports to avoid cyclical dependencies ( #6719 )
...
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2022-12-30 13:12:25 -05:00
Harshal Sheth
092d4c808d
fix(cli): fix delete urn cli bug + stricter type annotations ( #6903 )
2022-12-30 11:36:00 +01:00
Pedro Silva
594fc1bf5a
fix(cli): Make datahub quickstart work with latest docker compose in M1 ( #6891 )
...
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2022-12-30 11:33:18 +01:00
Tamas Nemeth
e81a3ad26d
fix(ingest): profiling (bigquery) - Address biquery profiling query error due to timestamp vs data mismatch ( #6874 )
2022-12-30 11:32:43 +01:00
Harshal Sheth
1b889022f0
test(ingest/kafka-connect): make docker setup more reliable ( #6902 )
2022-12-30 11:31:33 +01:00
Harshal Sheth
dfc5c6bfce
chore(ingest): remove inferred args to MCPW, part 1 ( #6819 )
2022-12-30 01:26:47 -05:00
Tamas Nemeth
ead0074169
deprecate(ingest): bigquery - Removing bigquery-legacy source ( #6851 )
...
Co-authored-by: John Joyce <john@acryl.io>
2022-12-29 13:19:05 -08:00
david-leifker
c845866521
test(misc): misc test updates ( #6890 )
2022-12-29 11:26:42 -06:00
Marvin Rösch
5167ed40ef
fix(ingest): trino - fall back to default table comment method for all Trino query errors ( #6873 )
2022-12-29 18:11:21 +01:00
Aseem Bansal
0bbe6d693e
fix(ci): reduce flakiness in add_users, siblings smoke test ( #6883 )
2022-12-29 21:47:25 +05:30
Aseem Bansal
5755d2ca9e
fix(ingest): okta undefined variable error ( #6882 )
2022-12-29 20:24:22 +05:30
John Joyce
218f3c3414
refactor(docs): Correctly spell elasticsearch in docs ( #6880 )
2022-12-29 15:21:24 +01:00
Aseem Bansal
b8664d6630
fix(lint): pin pydantic version ( #6886 )
2022-12-29 19:36:14 +05:30
Aseem Bansal
1d0bb1cd8a
refactor(smoke): use env variables ( #6866 )
2022-12-29 17:16:43 +05:30
david-leifker
122c024bab
refactor(gradle): move the local docker registry to common location ( #6881 )
2022-12-29 15:08:36 +05:30
Harshal Sheth
667ca8632d
feat(ingest): avoid embedding serialized json in metadata files ( #6742 )
2022-12-28 19:28:38 -05:00
david-leifker
b5275acab8
test(mce-consumer): mockbeans ( #6878 )
2022-12-28 16:18:10 -06:00
John Joyce
1503ef38f9
docs(adding users): Refreshing the docs for adding new DataHub Users ( #6879 )
2022-12-28 13:54:42 -08:00
Meenakshi Kamalaseshan Radha
d9b71cea19
feat(ui) - Add a custom error message for bulk edit to add clarity ( #6775 )
...
Co-authored-by: Kamalaseshan Radha <mkamalas@LAMU02DN212MD6R.uhc.com>
2022-12-28 13:22:21 -08:00
Aseem Bansal
1fb46b82c8
chore(ci): update dependencies docs-website ( #6871 )
2022-12-28 13:21:47 -08:00
Harshal Sheth
b474315e07
fix(ingest): conditionally include env in assertion guid ( #6811 )
2022-12-28 11:35:20 -08:00
david-leifker
d8af0b43bd
fix(runid): always update runid, except when queued ( #6876 )
2022-12-28 13:09:30 -06:00
Mayuri Nehate
2129496c98
feat(ingest/snowflake): handle failures gracefully and raise permission failures ( #6748 )
2022-12-28 08:20:37 -08:00
Peter Szalai
9c794af4a7
feat(CI): add venv caching ( #6843 )
...
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2022-12-28 13:22:47 +01:00
jx2lee
988b3d476c
docs(google-analytics): Correct grammatical error in README.md ( #6870 )
2022-12-28 12:01:53 +00:00
Tamas Nemeth
25b5a12b9d
feat(ingest): bigquery/snowflake - Store last profile date in state ( #6832 )
2022-12-28 12:09:18 +01:00
Harshal Sheth
8e0f4078b8
chore(ingest): loosen additional requirements ( #6868 )
2022-12-28 12:08:53 +01:00
david-leifker
cb6314c51d
fix(elasticsearch): fixes out of order runId writes ( #6845 )
...
Co-authored-by: leifker <dleifker@gmail.com>
Co-authored-by: Pedro Silva <pedro@acryl.io>
2022-12-27 17:50:11 -06:00
cccs-eric
ec8a4e0eab
feat(ingest): upgrade pydantic version ( #6858 )
...
This PR also removes the requirement on docker-compose v1 and makes our tests use v2 instead.
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2022-12-27 17:06:16 -05:00
Harshal Sheth
d851140048
chore(ingest): loosen requirements file ( #6867 )
2022-12-27 22:39:12 +01:00
Mayuri Nehate
14b48489d4
feat(ingest): pass timeout config in kafka admin client api calls ( #6863 )
2022-12-27 12:45:11 -08:00
david-leifker
a5b5abf270
fix(kafka): datahub-upgrade job ( #6864 )
2022-12-27 12:35:48 -06:00
Aseem Bansal
bef87abd6c
refactor(graphql): make graphqlengine easier to use ( #6865 )
2022-12-27 22:58:12 +05:30
Harshal Sheth
31260888fc
feat(ingest/airflow): support raw dataset urns in airflow lineage ( #6854 )
...
* feat(ingest/airflow): support dataset Urns in airflow lineage
This PR also
- resolves a reported circular import issue
- refactors the Airflow tests to reduce duplication
* fix test
2022-12-27 08:59:26 +01:00
Mayuri Nehate
69a2347db1
feat(ingest): update profiling to fetch configurable number of sample values ( #6859 )
2022-12-27 08:57:26 +01:00
david-leifker
10ea10ce85
fix(security): require signed/encrypted jwt tokens ( #6565 )
...
* fix(security): require unsigned/encrypted jwt tokens
* Add import
Co-authored-by: Pedro Silva <pedro@acryl.io>
2022-12-26 19:45:32 +00:00
