12076 Commits

Author SHA1 Message Date
Chris Collins
b8f8a10ee2
fix(ui) Merge duplicate schema fields on siblings regardless of casing (#7413)
Co-authored-by: Pedro Silva <pedro@acryl.io>
2023-02-28 15:56:02 -08:00
Harshal Sheth
2c3e3c203f
docs(ingest): add details about backwards compatibility guarantees (#7439) 2023-02-28 13:33:58 -08:00
Shirshanka Das
17e85979dd
refactor(ingest): subtypes - standardize (#7437) 2023-02-28 13:11:07 -08:00
Harshal Sheth
28b973e9e5
fix(smoke): add missing test resource (#7455) 2023-02-28 13:08:11 -08:00
Harshal Sheth
376fffeebc
docs(ingest): add more guidelines for writing sources (#7451) 2023-02-28 11:53:43 -08:00
Harshal Sheth
73493c577b
refactor(ingest): avoid allowing extras for all DataHubGraphConfig (#7448) 2023-02-28 10:42:31 -08:00
Harshal Sheth
639bbcfa86
chore(ingest/glue): cleanup deprecated underlying_platform config (#7449) 2023-02-28 10:41:54 -08:00
nachiket-juneja
e07cd2090b
Feat/s3 ingestion enhancement to update schema from latest partition (#7410)
Co-authored-by: Prashant Singh Thakur <prashant.thakur@nucleusteq.com>
2023-02-28 08:58:28 +01:00
Harshal Sheth
3b8b5e8aa4
chore(ingest): cleanup unused files/vars in tests (#7450) 2023-02-28 08:07:34 +01:00
Tamas Nemeth
62e33e03a3
fix(ingest/unity): Use assigned metastore if not metastore listed in unity catalog (#7446) 2023-02-28 08:06:28 +01:00
John Joyce
d54e3b81cf
fix(lineage): Fixing Timeline Lineage Filters (#7435) 2023-02-27 16:00:57 -08:00
Tamas Nemeth
77d072b522
fix(ingest/athena): Fix athena source if dbname is not specified in the connection string (#7417) 2023-02-27 22:15:29 +01:00
Aseem Bansal
cb7f1c6dc3
feat(tests): allow use of system auth for test session (#7445) 2023-02-27 22:41:06 +05:30
Aseem Bansal
b203dd2895
fix(analytics): date ranges being queried in charts (#7444) 2023-02-27 21:42:40 +05:30
Aseem Bansal
c12f3491a2
refactor(tests): extract common code (#7441) 2023-02-27 19:06:16 +05:30
Tamas Nemeth
1b53c03794
fix(ingest/snowflake): fixing Snowflake state issue (#7443) 2023-02-27 13:59:30 +01:00
Tamas Nemeth
14a660428e
fix(ingest/bigquery): Querying table metadata details in batch properly (#7429) 2023-02-27 11:10:24 +01:00
Harshal Sheth
d02701d91c
docs(ingest): add ingestion configs guide (#7438) 2023-02-26 16:04:23 -08:00
Aseem Bansal
4e7233d45f
fix(analytics): remove zero values being added in charts (#7425) 2023-02-25 14:09:07 +05:30
John Joyce
5e77e68352
feat(queries): Adding Tooltips to Queries Tab (#7421) 2023-02-24 16:04:23 -08:00
Jeff Merrick
285177b2b2
docs(website): fix homepage logo sizing (#7430) 2023-02-24 16:03:13 -08:00
david-leifker
dae7d9cc95
fix(recommendations): fix recommendations on homepage (#7433) 2023-02-24 14:23:14 -08:00
Shirshanka Das
221b1ae801
fix(ingest): lookml - add support for includes, extends, view_name i… (#7428) 2023-02-24 12:05:21 -08:00
Tamas Nemeth
3a4c9a69f6
fix(ingest/bigquery): Fixing double quoting in profiling approx count query (#7416) 2023-02-24 09:39:52 +01:00
Shirshanka Das
95750317e1
refactor(ingest): lookml - fix up golden files in normalized form (#7423) 2023-02-24 00:10:18 -08:00
Andrew Sikowitz
0532cc9056
fix(ingest/bigquery) Filter upstream lineage by list of existing tables (#7415)
Co-authored-by: mayurinehate <mayuri.nehate@gslab.com>
- Creates global stores table_refs and view_upstream_tables when extracting lineage
- Moves lineage processing to the end, after schema processing
- Adds `project_ids` config option to specify multiple projects to ingest; adds corresponding tests
- Changes `created` timestamps to `auditStamp` on `UpstreamClass`; uses VIEW type for lineage identified through view ddl parsing
2023-02-23 19:40:00 -05:00
lutongzero
8820c4bee9
fix(frontend) support utf-8 charset (#7405) 2023-02-23 11:14:30 -05:00
Aseem Bansal
3e037e05d5
docs(managed datahub): release notes for v0.2.1 (#7414) 2023-02-23 18:15:19 +05:30
RyanHolstien
4e250cbd51
feat(elasticsearch): support searchAfter (#7235) 2023-02-22 19:03:14 -06:00
Tamas Nemeth
4c1bf18f9a
feat(ingest/bigquery) - Emit cross-project usage from gcp logs (#7364) 2023-02-22 18:53:35 -05:00
Andrew Sikowitz
e82e284982
fix(ingest/kafka): Remove topic from kafka browse path (#7398) 2023-02-22 18:38:08 -05:00
RyanHolstien
98f3f93442
feat(auth): REST API authorization (#6614) 2023-02-22 15:45:45 -06:00
Alexey Kravtsov
79aa66ab0a
feat(frontend): add additional tabs to glossary terms view (#7392)
Adds tabs for "Contained by" and "Inherited by" on the Glossary Related Terms tab.
2023-02-22 16:30:47 -05:00
Mayuri Nehate
d436ab9f9b
feat(ingest/kafka-connect): add config to lowercase urns, do not emit… (#7393)
Co-authored-by: John Joyce <john@acryl.io>
2023-02-22 11:42:44 -08:00
Maggie Hays
0cdf817499
docs(logo) add VanMoof logo to site (#7402) 2023-02-22 11:34:51 -06:00
amartinson193
3bc9638be8
Update metadata-models-custom README.md (#7400) 2023-02-22 12:23:00 -05:00
Mayuri Nehate
5db133619f
fix(ingest/bigquery): Prefer parsed lineage for view over lineage from audit logs (#7408) 2023-02-22 11:51:04 -05:00
Pedro Silva
4f8a5c3800
feat(timeBasedLineage): add feature flag for always producing MCL (#7407) 2023-02-22 15:52:51 +00:00
Andrew Sikowitz
c5c2bdb983
fix(ingest/bigquery): Correctly upsert lineage_map when parsing view ddl (#7403) 2023-02-22 11:57:01 +01:00
david-leifker
571970cf62
Dockerize updates (#7387) 2023-02-22 15:43:11 +05:30
Andrew Sikowitz
2764c44977
fix(ingest): Do not require platform_instance for stateful ingestion (#7397) 2023-02-21 21:27:44 -05:00
david-leifker
36037cf288
fix(search): exact match updates per review (#7385) 2023-02-21 17:01:07 -06:00
Aseem Bansal
324fc8ee9f
chore(ci): update base dependencies (#7390)
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-02-21 16:07:51 -06:00
Chris Collins
2de779adbf
fix(docs): Update transformers docs to note not minting urns (#7399) 2023-02-21 13:29:36 -08:00
서재권(Data Platform)
3068e7f0b1
fix(ingest/oracle) add database name to oracle urn name (#7016) 2023-02-21 13:50:24 -05:00
Jeff Merrick
a572c4f5d6
docs(website): Add airtel logo (#7395) 2023-02-21 22:14:46 +05:30
Andrew Sikowitz
1402e88e3a
build(idea): mark metadata-ingestion sources and tests (#7394) 2023-02-21 09:50:03 -05:00
Aseem Bansal
f8a73005d4
chore(ci): relax bigquery dependency (#7309) 2023-02-21 08:33:00 +01:00
david-leifker
237933cc8d
build(scan): enable trivy scan ingestion-base (#7389) 2023-02-21 11:15:15 +05:30
david-leifker
eea95be4fc
chore(bump): bump hadoop client and fix exclusion name (#7386) 2023-02-20 19:53:59 -06:00