3904 Commits

Author SHA1 Message Date
Shirshanka Das
f872ca9cba
feat(cli): add user and group commands to create users and groups (#7595)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-03-22 18:44:01 -07:00
rtol5
1938b843cf
fix(ingest/mode): prevent null last_saved_at values from breaking runs (#7630) 2023-03-22 16:12:12 -07:00
Harshal Sheth
d9231addd2
feat(docs-website): add vercel preview environment (#7644) 2023-03-22 12:28:52 -07:00
Andrew Sikowitz
95f99198af
fix(ingest/bigquery): Pass whether view is materialized; pass last_altered correctly (#7660) 2023-03-22 13:40:57 -04:00
Harshal Sheth
2722ad54d4
feat(cli): build and upload Python wheels in CI (#7537) 2023-03-22 21:31:32 +05:30
mohdsiddique
6d6d59141e
feat(ingestion): powerbi # uniquly identify the multiple instance of same platform (#7632)
Co-authored-by: MohdSiddiqueBagwan <mohdsiddique.bagwan@gslab.com>
Co-authored-by: John Joyce <john@acryl.io>
2023-03-21 09:27:29 -07:00
mohdsiddique
7efac2215d
feat(ingestion): powerbi # support platform instance (#7583)
Co-authored-by: MohdSiddiqueBagwan <mohdsiddique.bagwan@gslab.com>
Co-authored-by: John Joyce <john@acryl.io>
2023-03-21 09:07:31 -07:00
david-leifker
697e8e2647
fix(misc): misc fixes (#7633) 2023-03-21 19:42:50 +05:30
Harshal Sheth
482431bcf4
fix(ingest/superset): support superset v2 (#7588)
Co-authored-by: John Joyce <john@acryl.io>
2023-03-20 19:49:32 -07:00
Harshal Sheth
d54ff061a4
fix(ingest): remove get_platform_instance_id from stateful ingestion (#7572)
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
2023-03-20 17:35:10 -07:00
Harshal Sheth
cbd8e14b78
feat(ingest): add auto_materialize_referenced_tags helper (#7626) 2023-03-20 16:34:22 -07:00
alex-magno
6ab606b748
fix(ingest/dbt): introduce lowercase column urn option (#7418)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-03-20 10:37:19 -07:00
mohdsiddique
fc8757d25e
feat(ingestion): powerbi # Amazon Redshift lineage support (#7562)
Co-authored-by: MohdSiddiqueBagwan <mohdsiddique.bagwan@gslab.com>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-03-20 10:24:34 -07:00
Shirshanka Das
104c9811f5
fix(ingest/docs): improve matcher to include types with spaces in them (#7631) 2023-03-18 12:59:43 -07:00
Harshal Sheth
14ecba1e62
fix(docker): fix gradle quickstart version parsing (#7614) 2023-03-17 12:10:05 -04:00
Shirshanka Das
41d4c0b074
feat(ingest/docs): json-schema fixes, improvements to ingestion doc generation (#7615) 2023-03-17 15:58:14 +01:00
Aseem Bansal
c43d7dd9d2
chore(ci): fix flakiness, misc improvements (#7605) 2023-03-17 09:34:00 +05:30
Hyejin Yoon
38555385e1
docs: add new code examples on creating entities & fix minor typos (#7613)
Co-authored-by: Hyejin Yoon <yoonhyejin@Hyejins-MacBook-Pro.local>
Co-authored-by: Hyejin Yoon <yoonhyejin@ip-192-168-0-10.us-west-2.compute.internal>
2023-03-17 10:07:24 +09:00
Harshal Sheth
89734587f7
feat(ingest): add urn modification helper (#7440)
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
2023-03-16 13:27:08 -07:00
Andrew Sikowitz
8c1fa04c87
fix(ingest/snowflake): Allow SnowflakeObjectAccessEntry.objectId to be None (#7601)
Co-authored-by: Pedro Silva <pedro@acryl.io>
2023-03-16 12:55:52 +01:00
Harshal Sheth
bcda510656
feat(cli): show image pull progress in quickstart (#7593)
Co-authored-by: John Joyce <john@acryl.io>
2023-03-16 12:28:51 +05:30
mohdsiddique
0a36826407
fix(ingest/powerbi): support each expression in m-query function invocation (#7541)
Co-authored-by: MohdSiddiqueBagwan <mohdsiddique.bagwan@gslab.com>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-03-15 09:06:29 -07:00
Aseem Bansal
b2ecd7f968
chore(ci): update dependencies, fix smoke image build (#7580) 2023-03-15 21:07:30 +05:30
Harshal Sheth
b87e4c312a
fix(ingest): pin typeguard version for feast (#7591) 2023-03-15 13:27:20 +05:30
Harsha Mandadi
bf36c935fa
feat(ingest/s3): support path_specs of different S3 buckets in the same recipe (#7514) 2023-03-14 21:55:57 -07:00
Andrew Sikowitz
8dd7a85533
refactor(ingest): Use shared connection wrapper over connection cache (#7570) 2023-03-14 15:09:37 -07:00
Aseem Bansal
776806d348
fix(gms): convert obj to string, fix wrong setup (#7582) 2023-03-15 03:02:30 +05:30
Mayuri Nehate
70c9b20c6d
feat(ingest/kafka-connect): add stateful ingestion and platform instance support (#7526) 2023-03-14 13:59:54 -07:00
Harshal Sheth
cb6c3dc8dd
feat(ingest/snowflake): use auto_workunit_reporter helper (#7568) 2023-03-14 13:54:57 -07:00
Harshal Sheth
81ec296b06
feat(cli): switch default quickstart to v0.10.0 (#7567) 2023-03-13 21:42:05 -07:00
John Joyce
18f387c6ea
fix(cli): Adding exit code to correctly return failure or success (#7520)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
Co-authored-by: Aseem Bansal <asmbansal2@gmail.com>
2023-03-13 13:32:40 -07:00
Teppo Naakka
23830423f8
feat(ingest): powerbi # store powerbi entity descriptions (#7154)
Co-authored-by: John Joyce <john@acryl.io>
2023-03-13 13:31:21 -07:00
Harshal Sheth
fbfe43b1cb
feat(ingest): fix edge cases + interface cleanup for file-system APIs (#7533) 2023-03-13 13:14:53 -07:00
Paul Logan
cebc583345
docs(): re-add sources summary page (#7563)
Co-authored-by: Jeff Merrick <jeff@wireform.io>
2023-03-13 11:37:24 -07:00
Shirshanka Das
26cf0a71ab
fix(test): suppress s3 golden file test for specific paths (#7551) 2023-03-12 10:43:02 -07:00
Mayuri Nehate
dac3938077
chore(ingest): snowflake - bump up classification library version to 0.0.6 (#7542) 2023-03-12 10:20:32 -07:00
Shirshanka Das
9a3d3b40ef
feat(openapi): add relationships endpoint (#7547) 2023-03-11 17:25:50 -08:00
Harshal Sheth
759e51bb42
fix(ingest/looker): stringify looker user ids (#7531) 2023-03-10 12:00:37 -08:00
Harshal Sheth
66f255e805
docs(ingest): add guidelines around proactive version pinning (#7534) 2023-03-10 10:16:01 -08:00
Shirshanka Das
a653b8ad30
fix(ingest): delta-lake - support assume aws role (#7524)
Co-authored-by: Dhanya Jayachandra <dhanyajayachandra@MacBook-Pro.local>
Co-authored-by: John Joyce <john@acryl.io>
2023-03-09 20:33:37 -08:00
Harshal Sheth
b82afa89f1
feat(ingest): enable joins across FileBackedDicts + add FileBackedList (#7506) 2023-03-09 15:22:03 -08:00
Harshal Sheth
91a8e5ea16
feat(ingest/powerbi): support PowerBI parameter references (#7523) 2023-03-09 11:14:55 -08:00
J Feldman
aa4228734c
feat(ingest/looker): upgrade to Looker API from 3.1 to 4.0 (#7411)
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2023-03-07 16:49:37 -08:00
Mayuri Nehate
dc2a7d8a46
chore(ingest): remove unused dependency for bigquery (#7510)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-03-07 16:43:14 -08:00
NotYuki
bb9835cf21
feat(ingest/vertica): improve vertica type mappings (#7459)
Co-authored-by: Maxim Losnikov <maxim.losnikov@truv.com>
2023-03-07 15:17:38 -08:00
cburroughs
86264b19cf
fix(ingest): limit typing_extensions classes to those available in min version (#7490) 2023-03-07 15:12:20 -08:00
Harshal Sheth
630e80c7e1
fix(ingest): make quickstart error handling more robust (#7513) 2023-03-07 14:40:31 -08:00
Mayuri Nehate
df2c62fa84
fix(ingest/bigquery): fix missing materialized views (#7511)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-03-07 14:40:08 -08:00
Arun Vasudevan
e93a17e917
feat(ingest/postgres): support estimated row counts in profiling (#7476)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-03-07 11:08:09 -08:00
Peter Szalai
7207c348b8
feat(cli): finalizing quickstart config commit hash (#7509) 2023-03-07 10:47:45 -08:00