3089 Commits

Author SHA1 Message Date
Andrew Sikowitz
589d354a57
perf(ingest): Increase default rest sink parallelism (#7675) 2023-03-23 19:43:20 -04:00
Shirshanka Das
3d81539c7e
fix(ingest): json-schema - nullability handling (#7667) 2023-03-23 23:07:30 +00:00
Mayuri Nehate
4ec34fc73b
feat(ingest/bigquery): emit create operation event for view (#7656) 2023-03-23 11:04:41 -07:00
Harshal Sheth
cf40aecb84
fix(cli/delete): include aspect name in dry-run message (#7664) 2023-03-22 22:25:33 -07:00
Harshal Sheth
3b519924e8
fix(cli): protect against timeseries get_aspects (#7665) 2023-03-22 22:04:11 -07:00
Shirshanka Das
f872ca9cba
feat(cli): add user and group commands to create users and groups (#7595)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-03-22 18:44:01 -07:00
rtol5
1938b843cf
fix(ingest/mode): prevent null last_saved_at values from breaking runs (#7630) 2023-03-22 16:12:12 -07:00
Andrew Sikowitz
95f99198af
fix(ingest/bigquery): Pass whether view is materialized; pass last_altered correctly (#7660) 2023-03-22 13:40:57 -04:00
Harshal Sheth
2722ad54d4
feat(cli): build and upload Python wheels in CI (#7537) 2023-03-22 21:31:32 +05:30
mohdsiddique
6d6d59141e
feat(ingestion): powerbi # uniquly identify the multiple instance of same platform (#7632)
Co-authored-by: MohdSiddiqueBagwan <mohdsiddique.bagwan@gslab.com>
Co-authored-by: John Joyce <john@acryl.io>
2023-03-21 09:27:29 -07:00
mohdsiddique
7efac2215d
feat(ingestion): powerbi # support platform instance (#7583)
Co-authored-by: MohdSiddiqueBagwan <mohdsiddique.bagwan@gslab.com>
Co-authored-by: John Joyce <john@acryl.io>
2023-03-21 09:07:31 -07:00
david-leifker
697e8e2647
fix(misc): misc fixes (#7633) 2023-03-21 19:42:50 +05:30
Harshal Sheth
482431bcf4
fix(ingest/superset): support superset v2 (#7588)
Co-authored-by: John Joyce <john@acryl.io>
2023-03-20 19:49:32 -07:00
Harshal Sheth
d54ff061a4
fix(ingest): remove get_platform_instance_id from stateful ingestion (#7572)
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
2023-03-20 17:35:10 -07:00
Harshal Sheth
cbd8e14b78
feat(ingest): add auto_materialize_referenced_tags helper (#7626) 2023-03-20 16:34:22 -07:00
alex-magno
6ab606b748
fix(ingest/dbt): introduce lowercase column urn option (#7418)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-03-20 10:37:19 -07:00
mohdsiddique
fc8757d25e
feat(ingestion): powerbi # Amazon Redshift lineage support (#7562)
Co-authored-by: MohdSiddiqueBagwan <mohdsiddique.bagwan@gslab.com>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-03-20 10:24:34 -07:00
Shirshanka Das
104c9811f5
fix(ingest/docs): improve matcher to include types with spaces in them (#7631) 2023-03-18 12:59:43 -07:00
Harshal Sheth
14ecba1e62
fix(docker): fix gradle quickstart version parsing (#7614) 2023-03-17 12:10:05 -04:00
Shirshanka Das
41d4c0b074
feat(ingest/docs): json-schema fixes, improvements to ingestion doc generation (#7615) 2023-03-17 15:58:14 +01:00
Harshal Sheth
89734587f7
feat(ingest): add urn modification helper (#7440)
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
2023-03-16 13:27:08 -07:00
Andrew Sikowitz
8c1fa04c87
fix(ingest/snowflake): Allow SnowflakeObjectAccessEntry.objectId to be None (#7601)
Co-authored-by: Pedro Silva <pedro@acryl.io>
2023-03-16 12:55:52 +01:00
Harshal Sheth
bcda510656
feat(cli): show image pull progress in quickstart (#7593)
Co-authored-by: John Joyce <john@acryl.io>
2023-03-16 12:28:51 +05:30
mohdsiddique
0a36826407
fix(ingest/powerbi): support each expression in m-query function invocation (#7541)
Co-authored-by: MohdSiddiqueBagwan <mohdsiddique.bagwan@gslab.com>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-03-15 09:06:29 -07:00
Harsha Mandadi
bf36c935fa
feat(ingest/s3): support path_specs of different S3 buckets in the same recipe (#7514) 2023-03-14 21:55:57 -07:00
Andrew Sikowitz
8dd7a85533
refactor(ingest): Use shared connection wrapper over connection cache (#7570) 2023-03-14 15:09:37 -07:00
Mayuri Nehate
70c9b20c6d
feat(ingest/kafka-connect): add stateful ingestion and platform instance support (#7526) 2023-03-14 13:59:54 -07:00
Harshal Sheth
cb6c3dc8dd
feat(ingest/snowflake): use auto_workunit_reporter helper (#7568) 2023-03-14 13:54:57 -07:00
Harshal Sheth
81ec296b06
feat(cli): switch default quickstart to v0.10.0 (#7567) 2023-03-13 21:42:05 -07:00
John Joyce
18f387c6ea
fix(cli): Adding exit code to correctly return failure or success (#7520)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
Co-authored-by: Aseem Bansal <asmbansal2@gmail.com>
2023-03-13 13:32:40 -07:00
Teppo Naakka
23830423f8
feat(ingest): powerbi # store powerbi entity descriptions (#7154)
Co-authored-by: John Joyce <john@acryl.io>
2023-03-13 13:31:21 -07:00
Harshal Sheth
fbfe43b1cb
feat(ingest): fix edge cases + interface cleanup for file-system APIs (#7533) 2023-03-13 13:14:53 -07:00
Shirshanka Das
9a3d3b40ef
feat(openapi): add relationships endpoint (#7547) 2023-03-11 17:25:50 -08:00
Harshal Sheth
759e51bb42
fix(ingest/looker): stringify looker user ids (#7531) 2023-03-10 12:00:37 -08:00
Shirshanka Das
a653b8ad30
fix(ingest): delta-lake - support assume aws role (#7524)
Co-authored-by: Dhanya Jayachandra <dhanyajayachandra@MacBook-Pro.local>
Co-authored-by: John Joyce <john@acryl.io>
2023-03-09 20:33:37 -08:00
Harshal Sheth
b82afa89f1
feat(ingest): enable joins across FileBackedDicts + add FileBackedList (#7506) 2023-03-09 15:22:03 -08:00
Harshal Sheth
91a8e5ea16
feat(ingest/powerbi): support PowerBI parameter references (#7523) 2023-03-09 11:14:55 -08:00
J Feldman
aa4228734c
feat(ingest/looker): upgrade to Looker API from 3.1 to 4.0 (#7411)
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2023-03-07 16:49:37 -08:00
NotYuki
bb9835cf21
feat(ingest/vertica): improve vertica type mappings (#7459)
Co-authored-by: Maxim Losnikov <maxim.losnikov@truv.com>
2023-03-07 15:17:38 -08:00
cburroughs
86264b19cf
fix(ingest): limit typing_extensions classes to those available in min version (#7490) 2023-03-07 15:12:20 -08:00
Harshal Sheth
630e80c7e1
fix(ingest): make quickstart error handling more robust (#7513) 2023-03-07 14:40:31 -08:00
Mayuri Nehate
df2c62fa84
fix(ingest/bigquery): fix missing materialized views (#7511)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-03-07 14:40:08 -08:00
Arun Vasudevan
e93a17e917
feat(ingest/postgres): support estimated row counts in profiling (#7476)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-03-07 11:08:09 -08:00
Peter Szalai
7207c348b8
feat(cli): finalizing quickstart config commit hash (#7509) 2023-03-07 10:47:45 -08:00
mohdsiddique
de719663ff
feat(ingestion): powerbi # support Google BigQuery table lineage (#7502)
Co-authored-by: MohdSiddiqueBagwan <mohdsiddique.bagwan@gslab.com>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-03-07 09:07:00 -08:00
Peter Szalai
1d33392761
feat(cli): introduce remote config for quickstart (#7424)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-03-07 13:14:24 +01:00
Mayuri Nehate
406b11a9ed
feat(ingest/GX): add urn lowercasing option for GX assertions (#7472) 2023-03-06 20:42:23 -08:00
Harshal Sheth
01ee351c4c
fix(ingest): prevent logging from blowing up on TypeErrors (#7497) 2023-03-03 14:36:55 -08:00
Harshal Sheth
195196ddf1
fix(ingest): redact auth info in curl commands (#7496) 2023-03-03 14:35:29 -08:00
Harshal Sheth
795d76b56c
fix(ingest/tableau): load project workbook hierarchy correctly (#7483) 2023-03-03 11:54:42 -08:00