Harshal Sheth
195196ddf1
fix(ingest): redact auth info in curl commands ( #7496 )
2023-03-03 14:35:29 -08:00
Harshal Sheth
795d76b56c
fix(ingest/tableau): load project workbook hierarchy correctly ( #7483 )
2023-03-03 11:54:42 -08:00
Harshal Sheth
b4dd1d7d82
chore(ingest): pin acryl-datahub-classify ( #7485 )
2023-03-03 11:36:20 -05:00
Andrew Sikowitz
7a71b84296
refactor(ingest): Convert FileBackedDict to dataclass for cleaner init ( #7469 )
...
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-03-02 19:53:05 -08:00
mohdsiddique
29d171106b
feat(ingest/tableau): project path and container support ( #7426 )
...
Co-authored-by: mayurinehate <mayuri.nehate@gslab.com>
Co-authored-by: MohdSiddiqueBagwan <mohdsiddique.bagwan@gslab.com>
Co-authored-by: John Joyce <john@acryl.io>
2023-03-02 16:53:19 -08:00
david-leifker
7b939ab2a4
feat(elasticsearch): validate index.blocks.write setting ( #7478 )
2023-03-02 18:04:12 -06:00
Chris Collins
70f6985eb3
fix(ui) Standardize subtypes casing with View Definition tab ( #7477 )
2023-03-02 19:02:08 -05:00
Aditya Radhakrishnan
04a32d487f
tests(cypress): add improved Cypress tests for timeline lineage ( #7464 )
2023-03-02 15:02:06 -08:00
david-leifker
2849c2fc95
fix(search): per field analyzers for simple_query_string ( #7436 )
2023-03-02 14:48:22 -06:00
Kevin G
622688916c
fix(ingest/dbt): check for nodes key before accessing ( #7462 )
...
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-03-02 11:40:13 -08:00
Aseem Bansal
1adbc2cab0
chore(ci): upgrade GE version ( #7290 )
2023-03-02 10:47:38 -08:00
Peter Szalai
e9f060dae3
Add setup job labels to compose files ( #7473 )
2023-03-02 15:05:16 +01:00
Tamas Nemeth
3f88fb7d16
feat(ingest/bigquery) - Capture dataset labels in bigquery ( #7460 )
2023-03-02 11:41:19 +01:00
Harshal Sheth
49029943f9
fix(ingest): remove extraneous platform configs ( #7454 )
2023-03-02 01:10:35 -08:00
Thomas Memenga
18dd7298ad
fix(ingest/s3): propagate s3 endpoint to profiling ( #7431 )
2023-03-02 01:05:17 -08:00
Tony Ouyang
4f651b0d3d
fix(ingest/bigquery): update bigquery platform_instance capability ( #7467 )
2023-03-02 00:52:40 -08:00
Harshal Sheth
c648f7376a
refactor(ingest): use auto_stale_entity_removal in json schema source ( #7465 )
2023-03-02 08:25:41 +01:00
Harshal Sheth
619fad0ae1
fix(ingest/dbt): remove deprecated backcompat_skip_source_on_lineage_edge option ( #7466 )
2023-03-02 08:24:50 +01:00
Andrew Sikowitz
8101f0d47a
feat(ingest): Introduce FileBackedDict for offloading data to disk ( #7461 )
...
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
Also includes minor refactoring to the bigquery connector
2023-03-01 19:09:51 -05:00
Harshal Sheth
45feb01e3b
fix(ingest/bigquery): simplify type annotations for bigquery usage ( #7457 )
...
Co-authored-by: Andrew Sikowitz <andrew.sikowitz@acryl.io>
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
2023-03-01 08:38:36 -08:00
Aseem Bansal
555bafff1e
chore(ci): exclude duckdb from smoke test ( #7458 )
2023-03-01 19:29:02 +05:30
david-leifker
64acf353fc
docs(managed): v0.2.2 managed datahub release notes ( #7456 )
...
Co-authored-by: John Joyce <john@acryl.io>
2023-02-28 19:55:14 -06:00
Kirill Popov
10d389f895
fix(kafka-setup): configure sasl.mechanism in case SASL_PLAINTEXT ( #7447 )
2023-02-28 16:07:27 -08:00
Chris Collins
b8f8a10ee2
fix(ui) Merge duplicate schema fields on siblings regardless of casing ( #7413 )
...
Co-authored-by: Pedro Silva <pedro@acryl.io>
2023-02-28 15:56:02 -08:00
Harshal Sheth
2c3e3c203f
docs(ingest): add details about backwards compatibility guarantees ( #7439 )
2023-02-28 13:33:58 -08:00
Shirshanka Das
17e85979dd
refactor(ingest): subtypes - standardize ( #7437 )
2023-02-28 13:11:07 -08:00
Harshal Sheth
28b973e9e5
fix(smoke): add missing test resource ( #7455 )
2023-02-28 13:08:11 -08:00
Harshal Sheth
376fffeebc
docs(ingest): add more guidelines for writing sources ( #7451 )
2023-02-28 11:53:43 -08:00
Harshal Sheth
73493c577b
refactor(ingest): avoid allowing extras for all DataHubGraphConfig ( #7448 )
2023-02-28 10:42:31 -08:00
Harshal Sheth
639bbcfa86
chore(ingest/glue): cleanup deprecated underlying_platform config ( #7449 )
2023-02-28 10:41:54 -08:00
nachiket-juneja
e07cd2090b
Feat/s3 ingestion enhancement to update schema from latest partition ( #7410 )
...
Co-authored-by: Prashant Singh Thakur <prashant.thakur@nucleusteq.com>
2023-02-28 08:58:28 +01:00
Harshal Sheth
3b8b5e8aa4
chore(ingest): cleanup unused files/vars in tests ( #7450 )
2023-02-28 08:07:34 +01:00
Tamas Nemeth
62e33e03a3
fix(ingest/unity): Use assigned metastore if not metastore listed in unity catalog ( #7446 )
2023-02-28 08:06:28 +01:00
John Joyce
d54e3b81cf
fix(lineage): Fixing Timeline Lineage Filters ( #7435 )
2023-02-27 16:00:57 -08:00
Tamas Nemeth
77d072b522
fix(ingest/athena): Fix athena source if dbname is not specified in the connection string ( #7417 )
2023-02-27 22:15:29 +01:00
Aseem Bansal
cb7f1c6dc3
feat(tests): allow use of system auth for test session ( #7445 )
2023-02-27 22:41:06 +05:30
Aseem Bansal
b203dd2895
fix(analytics): date ranges being queried in charts ( #7444 )
2023-02-27 21:42:40 +05:30
Aseem Bansal
c12f3491a2
refactor(tests): extract common code ( #7441 )
2023-02-27 19:06:16 +05:30
Tamas Nemeth
1b53c03794
fix(ingest/snowflake): fixing Snowflake state issue ( #7443 )
2023-02-27 13:59:30 +01:00
Tamas Nemeth
14a660428e
fix(ingest/bigquery): Querying table metadata details in batch properly ( #7429 )
2023-02-27 11:10:24 +01:00
Harshal Sheth
d02701d91c
docs(ingest): add ingestion configs guide ( #7438 )
2023-02-26 16:04:23 -08:00
Aseem Bansal
4e7233d45f
fix(analytics): remove zero values being added in charts ( #7425 )
2023-02-25 14:09:07 +05:30
John Joyce
5e77e68352
feat(queries): Adding Tooltips to Queries Tab ( #7421 )
2023-02-24 16:04:23 -08:00
Jeff Merrick
285177b2b2
docs(website): fix homepage logo sizing ( #7430 )
2023-02-24 16:03:13 -08:00
david-leifker
dae7d9cc95
fix(recommendations): fix recommendations on homepage ( #7433 )
2023-02-24 14:23:14 -08:00
Shirshanka Das
221b1ae801
fix(ingest): lookml - add support for includes, extends, view_name i… ( #7428 )
2023-02-24 12:05:21 -08:00
Tamas Nemeth
3a4c9a69f6
fix(ingest/bigquery): Fixing double quoting in profiling approx count query ( #7416 )
2023-02-24 09:39:52 +01:00
Shirshanka Das
95750317e1
refactor(ingest): lookml - fix up golden files in normalized form ( #7423 )
2023-02-24 00:10:18 -08:00
Andrew Sikowitz
0532cc9056
fix(ingest/bigquery) Filter upstream lineage by list of existing tables ( #7415 )
...
Co-authored-by: mayurinehate <mayuri.nehate@gslab.com>
- Creates global stores table_refs and view_upstream_tables when extracting lineage
- Moves lineage processing to the end, after schema processing
- Adds `project_ids` config option to specify multiple projects to ingest; adds corresponding tests
- Changes `created` timestamps to `auditStamp` on `UpstreamClass`; uses VIEW type for lineage identified through view ddl parsing
2023-02-23 19:40:00 -05:00
lutongzero
8820c4bee9
fix(frontend) support utf-8 charset ( #7405 )
2023-02-23 11:14:30 -05:00
