11753 Commits

Author SHA1 Message Date
Tamas Nemeth
3a4c9a69f6
fix(ingest/bigquery): Fixing double quoting in profiling approx count query (#7416) 2023-02-24 09:39:52 +01:00
Shirshanka Das
95750317e1
refactor(ingest): lookml - fix up golden files in normalized form (#7423) 2023-02-24 00:10:18 -08:00
Andrew Sikowitz
0532cc9056
fix(ingest/bigquery) Filter upstream lineage by list of existing tables (#7415)
Co-authored-by: mayurinehate <mayuri.nehate@gslab.com>
- Creates global stores table_refs and view_upstream_tables when extracting lineage
- Moves lineage processing to the end, after schema processing
- Adds `project_ids` config option to specify multiple projects to ingest; adds corresponding tests
- Changes `created` timestamps to `auditStamp` on `UpstreamClass`; uses VIEW type for lineage identified through view ddl parsing
2023-02-23 19:40:00 -05:00
lutongzero
8820c4bee9
fix(frontend) support utf-8 charset (#7405) 2023-02-23 11:14:30 -05:00
Aseem Bansal
3e037e05d5
docs(managed datahub): release notes for v0.2.1 (#7414) 2023-02-23 18:15:19 +05:30
RyanHolstien
4e250cbd51
feat(elasticsearch): support searchAfter (#7235) 2023-02-22 19:03:14 -06:00
Tamas Nemeth
4c1bf18f9a
feat(ingest/bigquery) - Emit cross-project usage from gcp logs (#7364) 2023-02-22 18:53:35 -05:00
Andrew Sikowitz
e82e284982
fix(ingest/kafka): Remove topic from kafka browse path (#7398) 2023-02-22 18:38:08 -05:00
RyanHolstien
98f3f93442
feat(auth): REST API authorization (#6614) 2023-02-22 15:45:45 -06:00
Alexey Kravtsov
79aa66ab0a
feat(frontend): add additional tabs to glossary terms view (#7392)
Adds tabs for "Contained by" and "Inherited by" on the Glossary Related Terms tab.
2023-02-22 16:30:47 -05:00
Mayuri Nehate
d436ab9f9b
feat(ingest/kafka-connect): add config to lowercase urns, do not emit… (#7393)
Co-authored-by: John Joyce <john@acryl.io>
2023-02-22 11:42:44 -08:00
Maggie Hays
0cdf817499
docs(logo) add VanMoof logo to site (#7402) 2023-02-22 11:34:51 -06:00
amartinson193
3bc9638be8
Update metadata-models-custom README.md (#7400) 2023-02-22 12:23:00 -05:00
Mayuri Nehate
5db133619f
fix(ingest/bigquery): Prefer parsed lineage for view over lineage from audit logs (#7408) 2023-02-22 11:51:04 -05:00
Pedro Silva
4f8a5c3800
feat(timeBasedLineage): add feature flag for always producing MCL (#7407) 2023-02-22 15:52:51 +00:00
Andrew Sikowitz
c5c2bdb983
fix(ingest/bigquery): Correctly upsert lineage_map when parsing view ddl (#7403) 2023-02-22 11:57:01 +01:00
david-leifker
571970cf62
Dockerize updates (#7387) 2023-02-22 15:43:11 +05:30
Andrew Sikowitz
2764c44977
fix(ingest): Do not require platform_instance for stateful ingestion (#7397) 2023-02-21 21:27:44 -05:00
david-leifker
36037cf288
fix(search): exact match updates per review (#7385) 2023-02-21 17:01:07 -06:00
Aseem Bansal
324fc8ee9f
chore(ci): update base dependencies (#7390)
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-02-21 16:07:51 -06:00
Chris Collins
2de779adbf
fix(docs): Update transformers docs to note not minting urns (#7399) 2023-02-21 13:29:36 -08:00
서재권(Data Platform)
3068e7f0b1
fix(ingest/oracle) add database name to oracle urn name (#7016) 2023-02-21 13:50:24 -05:00
Jeff Merrick
a572c4f5d6
docs(website): Add airtel logo (#7395) 2023-02-21 22:14:46 +05:30
Andrew Sikowitz
1402e88e3a
build(idea): mark metadata-ingestion sources and tests (#7394) 2023-02-21 09:50:03 -05:00
Aseem Bansal
f8a73005d4
chore(ci): relax bigquery dependency (#7309) 2023-02-21 08:33:00 +01:00
david-leifker
237933cc8d
build(scan): enable trivy scan ingestion-base (#7389) 2023-02-21 11:15:15 +05:30
david-leifker
eea95be4fc
chore(bump): bump hadoop client and fix exclusion name (#7386) 2023-02-20 19:53:59 -06:00
david-leifker
ebec860bce
fix(search): fix search filters, handle detection of keyword subfield (#7372) 2023-02-20 19:27:10 -06:00
Aseem Bansal
8a1a24b989
feat(analytics): add monthly active users in highlights (#7341) 2023-02-20 14:17:31 -08:00
Tamas Nemeth
097d4e6bbd
fix(dep/json-schema): Fixing json-schema dependencies (#7383) 2023-02-20 14:02:08 -08:00
John Joyce
92cd2b2c1b
fix(lineage): Fix Upstream + Downstream Count in presence of Soft-Deleted / Non-Existent references (#7374) 2023-02-20 14:00:14 -08:00
david-leifker
bd11575d5f
chore(version): additional version bumps & suppressions (#7382) 2023-02-20 14:39:27 -06:00
John Joyce
08a215951c
feat(queries): Overhaul Queries Tab (#7366) 2023-02-20 11:10:18 -08:00
david-leifker
7bbabe0762
feat(elasticsearch): advanced query, identity autocomplete, exact match weight (#7354) 2023-02-20 09:42:17 -06:00
Andrew Sikowitz
8fd2cc5f20
fix(ingest/snowflake): Improve memory usage of metadata extraction (#7349) 2023-02-20 14:46:10 +01:00
Aseem Bansal
986086ae00
test(cli): add check for missing init files (#7378) 2023-02-20 18:41:12 +05:30
david-leifker
1df806d177
chore(versions): bump versions (#7358) 2023-02-20 11:32:05 +05:30
Sander Tan
bfc0fe1c4b
docs(): fix broken link (#7344) 2023-02-19 19:36:32 -08:00
Shirshanka Das
07e4d0696f
feat(ingest): json-schema - add json schema support for files and kaf… (#7361) 2023-02-19 08:43:13 -08:00
Andrew Sikowitz
a605f0752f
fix(deps): pin snowflake-connector-python (#7365)
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
2023-02-18 10:44:55 +01:00
Andrew Sikowitz
632f730803
fix(ingest/looker): do not instantiate LookerDashboardSource on test_connection (#7369) 2023-02-18 09:32:28 +01:00
Tim
ad742f14c8
refactor(ingest,athena): update athena sample recipe (#7368) 2023-02-17 16:24:24 -08:00
John Joyce
1b8ab4607e
fix(lineage): Include maxHops in Lineage Cache Key + misc UI improvements (#7351) 2023-02-17 15:49:42 -08:00
Teppo Naakka
702221089d
feat(powerbi): add chart entities to similar browsepath as dashboards (#7293)
Co-authored-by: John Joyce <john@acryl.io>
2023-02-17 13:38:48 -08:00
mohdsiddique
79f576e2e1
fix(ingestion): powerbi # continue ingestion if m-query parsing fail (#7360)
Co-authored-by: MohdSiddique Bagwan <mohdsiddique.bagwan@gslab.com>
2023-02-17 13:24:10 -08:00
Tamas Nemeth
32ab7949de
fix(ingestion/snowflake): Fixing stateful ingestion commit at Snowflake source (#7363) 2023-02-17 13:23:16 -08:00
Pedro Silva
50f7935d5b
fix(cli): Corrects search filter for delete (#7367) 2023-02-17 13:23:01 -08:00
Aseem Bansal
5690560b6e
feat(cli): make deprecations, renames easier to notice (#7310) 2023-02-17 22:50:41 +05:30
Tamas Nemeth
aa388f04c2
fix(ingest/bigquery): Increase batch size in metadata extraction if no partitioned table involved (#7252) 2023-02-17 11:49:47 +01:00
david-leifker
751289c9e3
fix(gradle): fix gradle command referenced in docs (#7318) 2023-02-16 18:27:53 -06:00